Solution Pluralism and Metaheuristics

Size: px
Start display at page:

Download "Solution Pluralism and Metaheuristics"

Transcription

1 1 / 27 Solution Pluralism and Metaheuristics Steven O. Kimbrough Ann Kuo LAU Hoong Chuin Frederic Murphy David Harlan Wood University of Pennsylvania University of Pennsylvania Singapore Management University Temple University University of Delaware July 28, 2011, Udine, IT, Metaheuristics International Conference

2 2 / 27 Outline 1 Introduction 2 Post-Solution Analysis of COMs 3 Extended Example GAP4_2 FoIs GAP4_2 IoIs 4 Further Areas of Opportunity 5 Discussion 6 End Matter

3 3 / 27 Recognizing this is a position paper... Distinction: the problem versus a model or representation of the problem. In OR, we don t solve the problem, we solve the model of the problem." So how do we solve the problem? Solution pluralism is a stance or default position, recommending finding many solutions for a model and using the resulting solution base (SoIs solutions of interest) for decision making.

4 4 / 27 How can models have more than one solution? Quadratic equation? We ll see examples, but 1 Solutions under different settings of parameters. 2 Solutions under different realizations of random variables. 3 In optimization models, solutions that are non-optimal for the model. 4 Combinations of the above.

5 5 / 27 Established examples Models with stochastic outputs; simulation models of various sorts. Sensitivity analysis of models; especially variance-based analyses, Monte Carlo methods. Robust optimization (in the uncertainty sense) Multi-objective optimization.

6 6 / 27 Post-solution analysis of constrained optimization models. Obtain a solution base from the neighborhood of the best solution(s), both feasible and infeasible. Example: Estimate the cost/benefit of altering constraint RHS values by making changes and evaluating solutions in the solution base. How do we generate a high-quality solution base? Positive results with FI-2Pop GA. In general, methods drawing on evolutionary computation are promising. Also, other kinds of population-based metaheuristics.

7 GAP4_2 FoIs GAP4_2 A representative GAP test problem. OR-Library, J.E. Beasley. uk/~mastjjb/jeb/info.html, [Beasley, 2009]. c machines, 30 jobs. 644 at optimum. Solved with FI-2Pop GA. FoIs: top 1000 feasible solutions, ranked by objective value. IoIs: top 1000 infeasible solutions, ranked by distance to feasibility. 7 / 27

8 GAP4_2 FoIs Can we find an optimal solution? Yes. Two! Optimal Solution A Optimal Solution B / 27

9 GAP4_2 FoIs Now let s compare them on their constraint slacks Comparison of Slacks Solution A= B= Decision makers may well prefer A over B or vice versa. 9 / 27

10 GAP4_2 FoIs Shadow-price-like questions Obj. Val A= B= Can the additional slack resources be usefully deployed? On which resources do we not have much opportunity for redeployment? (Ans: 2 & 5.) 10 / 27

11 GAP4_2 FoIs Shadow-price-like questions In both of my optimal solutions, constraint 1 has a slack of 2. Are there any good solutions available with a slack of at least 10? Yes. #23 has a slack on constraint 1 of 10 and an objective value of 640; #53, 11, 638; #97, 13, 636. What about constraint 2, which already has a slack of 5? #18, 641, 8; #68, 637, 15; #74, 637, 18. 3? At 0 or 1. #10, 642, 4; #39, 639, 8; #48, 638, 10. 4? At 1 or 2. #5, 643, 11. 5? At 0 or 1. #35, 639, 9. Plus, we can do combinations / 27

12 GAP4_2 FoIs Slacks for top 100 feasible solutions / 27

13 GAP4_2 FoIs Reduced-cost-like questions Job 25 is assigned to machine 2 in solution A and machine 3 in solution B. What s the best solution if we assign job 25 to machine 1? Answer: It has an objective value of 643. The solution is Its slacks: Job 25 to machine Obj. Val / 27

14 GAP4_2 IoIs Shadow-price-like questions Obj Is there opportunity to acquire more resources? To trade in slacks and surpluses? 14 / 27

15 GAP4_2 IoIs Shadow-price-like questions We re at 644, but we need to get to 651. Show me what I need to do. In the top 1000 IoIs there are 75 discovered solutions with objective values at or above / 27

16 GAP4_2 IoIs Shadow-price-like questions. 651? Obj A= B= Is there opportunity to acquire more resources? To trade in slacks and surpluses? 16 / 27

17 GAP4_2 IoIs Shadow-price-like questions. >651? Obj Is there opportunity to acquire more resources? To trade in slacks and surpluses? 17 / 27

18 GAP4_2 IoIs Reduced-cost-like questions Job 20 is assigned to machine 3 in solutions A and B, and to 3 (and sometimes 4) in all the FoIs. There are 57 solutions in the IoIs in which we assign job 20 to machine 2. What are the most promising of these solutions? 18 / 27

19 GAP4_2 IoIs Reduced-cost-like questions. 20 to 2? Obj Is there opportunity to acquire more resources? To trade in slacks and surpluses? Note: We do not find an opportunity with 20 assigned to 2 and z > / 27

20 20 / 27 GAP4_2 IoIs

21 Robust solutions under risk See Finding Robust-under-Risk Solutions for Flowshop Scheduling at MIC Constrained optimization models with imperfect knowledge of parameters. What if the parameters can be known under risk (in contrast to uncertainty)? One approach: 1 Obtain a solution base from the neighborhood of the best solution(s) to the static problem. 2 Evaluate the solutions in the solution base with Monte Carlo methods to find the most robust (to a given standard or measure). How do we get this solution base? Evolutionary computation. 21 / 27

22 22 / 27 Two-sided matching (stable matching) The problem(s)... Solution concept: stability Gale-Shapley and the deferred acceptance algorithm Wide use in practice. Issues: unfairness, non-simple matching conditions, etc. What about social welfare? Equity? Response: use evolutionary computation to find solution bases of stable and nearly stable solutions. Evaluate these with respect to other criteria. (See paper cited in position paper.)

23 23 / 27 Redistricting (Work in progress.) Problem: gerrymandering. Courts require that districts be nearly equal in population and connected. Leaves plenty of room for gerrymandering. Broadly agreed: compactness of districts (e.g., low circumference) is violated with gerrymandering. One approach to response: 1 Find a solution base by minimizing non-compactness, subject to connectivity and population size constraints. 2 Let the political process haggle over a suitable solution base (e.g., solutions within X% of the most compact). 3 If the political process fails, let the courts choose a solution at random from the solution base. (Or use some other scheme.)

24 24 / 27 Pattern 1 Develop a (more or less) conventional model for the problem to hand. 2 Define, pragmatically, the SoIs solutions of interest. 3 Obtain multiple solutions, a solution base for the SoIs, by using evolutionary computation. 4 Deliberate to decision (build another model?) from information derived from the solution base.

25 25 / 27 Future research Obviously, lots to explore here. What works well, what doesn t? How else can these ideas be applied? Exploring ways to use the solution base effectively. Vistualization? Suggest: A big switch, from focusing on solving a model, to obtaining the SoIs for the model. An important reason to use metaheuristics.

26 26 / 27 Beasley, J. E. (Accessed July 27, 2009). OR-Library. World Wide Web. info.html.

27 27 / 27 $Id: Udine-MIC-2011-pluralism-beamer.tex :23:

Unveiling Hidden Values of Optimization Models with Metaheuristic Approach

Unveiling Hidden Values of Optimization Models with Metaheuristic Approach University of Pennsylvania ScholarlyCommons Publicly Accessible Penn Dissertations 1-1-2014 Unveiling Hidden Values of Optimization Models with Metaheuristic Approach Ann Kuo University of Pennsylvania,

More information

On the Contributions of Losers: The informational value of infeasible decisions.

On the Contributions of Losers: The informational value of infeasible decisions. On the Contributions of Losers: The informational value of infeasible decisions. Steven O. Kimbrough, Yulin Liu, Ming Lu, and David H. Wood 565 JMHH kimbrough@wharton.upenn.edu 215-898-5133 Draft presentation

More information

Some Thought-ettes on Artificial Agent Modeling and Its Uses

Some Thought-ettes on Artificial Agent Modeling and Its Uses Some Thought-ettes on Artificial Agent Modeling and Its Uses Steven O. Kimbrough University of Pennsylvania http://opim-sun.wharton.upenn.edu/ sok/ kimbrough@wharton.upenn.edu ECEG, Washington, D.C., 1/26/04

More information

Review Solutions, Exam 2, Operations Research

Review Solutions, Exam 2, Operations Research Review Solutions, Exam 2, Operations Research 1. Prove the weak duality theorem: For any x feasible for the primal and y feasible for the dual, then... HINT: Consider the quantity y T Ax. SOLUTION: To

More information

STATIC LECTURE 4: CONSTRAINED OPTIMIZATION II - KUHN TUCKER THEORY

STATIC LECTURE 4: CONSTRAINED OPTIMIZATION II - KUHN TUCKER THEORY STATIC LECTURE 4: CONSTRAINED OPTIMIZATION II - KUHN TUCKER THEORY UNIVERSITY OF MARYLAND: ECON 600 1. Some Eamples 1 A general problem that arises countless times in economics takes the form: (Verbally):

More information

2001 Dennis L. Bricker Dept. of Industrial Engineering The University of Iowa. Reducing dimensionality of DP page 1

2001 Dennis L. Bricker Dept. of Industrial Engineering The University of Iowa. Reducing dimensionality of DP page 1 2001 Dennis L. Bricker Dept. of Industrial Engineering The University of Iowa Reducing dimensionality of DP page 1 Consider a knapsack with a weight capacity of 15 and a volume capacity of 12. Item # Value

More information

Genetic Algorithm. Outline

Genetic Algorithm. Outline Genetic Algorithm 056: 166 Production Systems Shital Shah SPRING 2004 Outline Genetic Algorithm (GA) Applications Search space Step-by-step GA Mechanism Examples GA performance Other GA examples 1 Genetic

More information

Linear programs Optimization Geoff Gordon Ryan Tibshirani

Linear programs Optimization Geoff Gordon Ryan Tibshirani Linear programs 10-725 Optimization Geoff Gordon Ryan Tibshirani Review: LPs LPs: m constraints, n vars A: R m n b: R m c: R n x: R n ineq form [min or max] c T x s.t. Ax b m n std form [min or max] c

More information

Econ 2148, spring 2019 Statistical decision theory

Econ 2148, spring 2019 Statistical decision theory Econ 2148, spring 2019 Statistical decision theory Maximilian Kasy Department of Economics, Harvard University 1 / 53 Takeaways for this part of class 1. A general framework to think about what makes a

More information

Economics 2010c: Lectures 9-10 Bellman Equation in Continuous Time

Economics 2010c: Lectures 9-10 Bellman Equation in Continuous Time Economics 2010c: Lectures 9-10 Bellman Equation in Continuous Time David Laibson 9/30/2014 Outline Lectures 9-10: 9.1 Continuous-time Bellman Equation 9.2 Application: Merton s Problem 9.3 Application:

More information

Algorithms and Complexity theory

Algorithms and Complexity theory Algorithms and Complexity theory Thibaut Barthelemy Some slides kindly provided by Fabien Tricoire University of Vienna WS 2014 Outline 1 Algorithms Overview How to write an algorithm 2 Complexity theory

More information

Special cases of linear programming

Special cases of linear programming Special cases of linear programming Infeasible solution Multiple solution (infinitely many solution) Unbounded solution Degenerated solution Notes on the Simplex tableau 1. The intersection of any basic

More information

Expanding Choice in School Choice

Expanding Choice in School Choice Expanding Choice in School Choice Atila Abdulkadiroğlu Yeon-Koo Che Yosuke Yasuda October 15, Northwestern Seminar 1 Introduction Traditionally, students are assigned to public schools according to where

More information

Nonlinear Programming and the Kuhn-Tucker Conditions

Nonlinear Programming and the Kuhn-Tucker Conditions Nonlinear Programming and the Kuhn-Tucker Conditions The Kuhn-Tucker (KT) conditions are first-order conditions for constrained optimization problems, a generalization of the first-order conditions we

More information

Midterm Review. Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A.

Midterm Review. Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. Midterm Review Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/ yyye (LY, Chapter 1-4, Appendices) 1 Separating hyperplane

More information

Summary of the simplex method

Summary of the simplex method MVE165/MMG631,Linear and integer optimization with applications The simplex method: degeneracy; unbounded solutions; starting solutions; infeasibility; alternative optimal solutions Ann-Brith Strömberg

More information

Welcome to CPSC 4850/ OR Algorithms

Welcome to CPSC 4850/ OR Algorithms Welcome to CPSC 4850/5850 - OR Algorithms 1 Course Outline 2 Operations Research definition 3 Modeling Problems Product mix Transportation 4 Using mathematical programming Course Outline Instructor: Robert

More information

How to Take the Dual of a Linear Program

How to Take the Dual of a Linear Program How to Take the Dual of a Linear Program Sébastien Lahaie January 12, 2015 This is a revised version of notes I wrote several years ago on taking the dual of a linear program (LP), with some bug and typo

More information

Introduction to Mathematical Programming

Introduction to Mathematical Programming Introduction to Mathematical Programming Ming Zhong Lecture 22 October 22, 2018 Ming Zhong (JHU) AMS Fall 2018 1 / 16 Table of Contents 1 The Simplex Method, Part II Ming Zhong (JHU) AMS Fall 2018 2 /

More information

Slack Variable. Max Z= 3x 1 + 4x 2 + 5X 3. Subject to: X 1 + X 2 + X x 1 + 4x 2 + X X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0

Slack Variable. Max Z= 3x 1 + 4x 2 + 5X 3. Subject to: X 1 + X 2 + X x 1 + 4x 2 + X X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0 Simplex Method Slack Variable Max Z= 3x 1 + 4x 2 + 5X 3 Subject to: X 1 + X 2 + X 3 20 3x 1 + 4x 2 + X 3 15 2X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0 Standard Form Max Z= 3x 1 +4x 2 +5X 3 + 0S 1 + 0S 2

More information

Reformulation of chance constrained problems using penalty functions

Reformulation of chance constrained problems using penalty functions Reformulation of chance constrained problems using penalty functions Martin Branda Charles University in Prague Faculty of Mathematics and Physics EURO XXIV July 11-14, 2010, Lisbon Martin Branda (MFF

More information

Environment (E) IBP IBP IBP 2 N 2 N. server. System (S) Adapter (A) ACV

Environment (E) IBP IBP IBP 2 N 2 N. server. System (S) Adapter (A) ACV The Adaptive Cross Validation Method - applied to polling schemes Anders Svensson and Johan M Karlsson Department of Communication Systems Lund Institute of Technology P. O. Box 118, 22100 Lund, Sweden

More information

AM 121: Intro to Optimization Models and Methods

AM 121: Intro to Optimization Models and Methods AM 121: Intro to Optimization Models and Methods Fall 2017 Lecture 2: Intro to LP, Linear algebra review. Yiling Chen SEAS Lecture 2: Lesson Plan What is an LP? Graphical and algebraic correspondence Problems

More information

In the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight.

In the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight. In the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight. In the multi-dimensional knapsack problem, additional

More information

WORST CASE OPTIMIZATION USING CHEBYSHEV INEQUALITY

WORST CASE OPTIMIZATION USING CHEBYSHEV INEQUALITY WORST CASE OPTIMIZATION USING CHEBYSHEV INEQUALITY Kiyoharu Tagawa School of Science and Engineering, Kindai University, Japan tagawa@info.kindai.ac.jp Abstract In real-world optimization problems, a wide

More information

Strategies for dealing with Missing Data

Strategies for dealing with Missing Data Institut für Soziologie Eberhard Karls Universität Tübingen http://www.maartenbuis.nl What do we want from an analysis strategy? Simple example We have a theory that working for cash is mainly men s work

More information

PROBLEM SOLVING AND SEARCH IN ARTIFICIAL INTELLIGENCE

PROBLEM SOLVING AND SEARCH IN ARTIFICIAL INTELLIGENCE Artificial Intelligence, Computational Logic PROBLEM SOLVING AND SEARCH IN ARTIFICIAL INTELLIGENCE Lecture 4 Metaheuristic Algorithms Sarah Gaggl Dresden, 5th May 2017 Agenda 1 Introduction 2 Constraint

More information

Heterogeneity and Lotteries in Monetary Search Models

Heterogeneity and Lotteries in Monetary Search Models SÉBASTIEN LOTZ ANDREI SHEVCHENKO CHRISTOPHER WALLER Heterogeneity and Lotteries in Monetary Search Models We introduce ex ante heterogeneity into the Berentsen, Molico, and Wright monetary search model

More information

The key is that there are two disjoint populations, and everyone in the market is on either one side or the other

The key is that there are two disjoint populations, and everyone in the market is on either one side or the other Econ 805 Advanced Micro Theory I Dan Quint Fall 2009 Lecture 17 So... two-sided matching markets. First off, sources. I ve updated the syllabus for the next few lectures. As always, most of the papers

More information

Stochastic Analogues to Deterministic Optimizers

Stochastic Analogues to Deterministic Optimizers Stochastic Analogues to Deterministic Optimizers ISMP 2018 Bordeaux, France Vivak Patel Presented by: Mihai Anitescu July 6, 2018 1 Apology I apologize for not being here to give this talk myself. I injured

More information

Chap6 Duality Theory and Sensitivity Analysis

Chap6 Duality Theory and Sensitivity Analysis Chap6 Duality Theory and Sensitivity Analysis The rationale of duality theory Max 4x 1 + x 2 + 5x 3 + 3x 4 S.T. x 1 x 2 x 3 + 3x 4 1 5x 1 + x 2 + 3x 3 + 8x 4 55 x 1 + 2x 2 + 3x 3 5x 4 3 x 1 ~x 4 0 If we

More information

36106 Managerial Decision Modeling Linear Decision Models: Part II

36106 Managerial Decision Modeling Linear Decision Models: Part II 1 36106 Managerial Decision Modeling Linear Decision Models: Part II Kipp Martin University of Chicago Booth School of Business January 20, 2014 Reading and Excel Files Reading (Powell and Baker): Sections

More information

CS 598RM: Algorithmic Game Theory, Spring Practice Exam Solutions

CS 598RM: Algorithmic Game Theory, Spring Practice Exam Solutions CS 598RM: Algorithmic Game Theory, Spring 2017 1. Answer the following. Practice Exam Solutions Agents 1 and 2 are bargaining over how to split a dollar. Each agent simultaneously demands share he would

More information

Duality Theory, Optimality Conditions

Duality Theory, Optimality Conditions 5.1 Duality Theory, Optimality Conditions Katta G. Murty, IOE 510, LP, U. Of Michigan, Ann Arbor We only consider single objective LPs here. Concept of duality not defined for multiobjective LPs. Every

More information

Support vector machines Lecture 4

Support vector machines Lecture 4 Support vector machines Lecture 4 David Sontag New York University Slides adapted from Luke Zettlemoyer, Vibhav Gogate, and Carlos Guestrin Q: What does the Perceptron mistake bound tell us? Theorem: The

More information

Real-Time and Embedded Systems (M) Lecture 5

Real-Time and Embedded Systems (M) Lecture 5 Priority-driven Scheduling of Periodic Tasks (1) Real-Time and Embedded Systems (M) Lecture 5 Lecture Outline Assumptions Fixed-priority algorithms Rate monotonic Deadline monotonic Dynamic-priority algorithms

More information

Solving Numerical Optimization Problems by Simulating Particle-Wave Duality and Social Information Sharing

Solving Numerical Optimization Problems by Simulating Particle-Wave Duality and Social Information Sharing International Conference on Artificial Intelligence (IC-AI), Las Vegas, USA, 2002: 1163-1169 Solving Numerical Optimization Problems by Simulating Particle-Wave Duality and Social Information Sharing Xiao-Feng

More information

Dr. S. Bourazza Math-473 Jazan University Department of Mathematics

Dr. S. Bourazza Math-473 Jazan University Department of Mathematics Dr. Said Bourazza Department of Mathematics Jazan University 1 P a g e Contents: Chapter 0: Modelization 3 Chapter1: Graphical Methods 7 Chapter2: Simplex method 13 Chapter3: Duality 36 Chapter4: Transportation

More information

SENSITIVITY ANALYSIS IN LINEAR PROGRAMING: SOME CASES AND LECTURE NOTES

SENSITIVITY ANALYSIS IN LINEAR PROGRAMING: SOME CASES AND LECTURE NOTES SENSITIVITY ANALYSIS IN LINEAR PROGRAMING: SOME CASES AND LECTURE NOTES Samih Antoine Azar, Haigazian University CASE DESCRIPTION This paper presents case studies and lecture notes on a specific constituent

More information

Pareto Efficiency (also called Pareto Optimality)

Pareto Efficiency (also called Pareto Optimality) Pareto Efficiency (also called Pareto Optimality) 1 Definitions and notation Recall some of our definitions and notation for preference orderings. Let X be a set (the set of alternatives); we have the

More information

Recap Social Choice Fun Game Voting Paradoxes Properties. Social Choice. Lecture 11. Social Choice Lecture 11, Slide 1

Recap Social Choice Fun Game Voting Paradoxes Properties. Social Choice. Lecture 11. Social Choice Lecture 11, Slide 1 Social Choice Lecture 11 Social Choice Lecture 11, Slide 1 Lecture Overview 1 Recap 2 Social Choice 3 Fun Game 4 Voting Paradoxes 5 Properties Social Choice Lecture 11, Slide 2 Formal Definition Definition

More information

Differential Evolution: a stochastic nonlinear optimization algorithm by Storn and Price, 1996

Differential Evolution: a stochastic nonlinear optimization algorithm by Storn and Price, 1996 Differential Evolution: a stochastic nonlinear optimization algorithm by Storn and Price, 1996 Presented by David Craft September 15, 2003 This presentation is based on: Storn, Rainer, and Kenneth Price

More information

CHAPTER 1-2: SHADOW PRICES

CHAPTER 1-2: SHADOW PRICES Essential Microeconomics -- CHAPTER -: SHADOW PRICES An intuitive approach: profit maimizing firm with a fied supply of an input Shadow prices 5 Concave maimization problem 7 Constraint qualifications

More information

Introduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras

Introduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras Introduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras Module - 03 Simplex Algorithm Lecture 15 Infeasibility In this class, we

More information

LINEAR PROGRAMMING 2. In many business and policy making situations the following type of problem is encountered:

LINEAR PROGRAMMING 2. In many business and policy making situations the following type of problem is encountered: LINEAR PROGRAMMING 2 In many business and policy making situations the following type of problem is encountered: Maximise an objective subject to (in)equality constraints. Mathematical programming provides

More information

56:171 Operations Research Midterm Exam - October 26, 1989 Instructor: D.L. Bricker

56:171 Operations Research Midterm Exam - October 26, 1989 Instructor: D.L. Bricker 56:171 Operations Research Midterm Exam - October 26, 1989 Instructor: D.L. Bricker Answer all of Part One and two (of the four) problems of Part Two Problem: 1 2 3 4 5 6 7 8 TOTAL Possible: 16 12 20 10

More information

Adding Production to the Theory

Adding Production to the Theory Adding Production to the Theory We begin by considering the simplest situation that includes production: two goods, both of which have consumption value, but one of which can be transformed into the other.

More information

Real-time Scheduling of Periodic Tasks (1) Advanced Operating Systems Lecture 2

Real-time Scheduling of Periodic Tasks (1) Advanced Operating Systems Lecture 2 Real-time Scheduling of Periodic Tasks (1) Advanced Operating Systems Lecture 2 Lecture Outline Scheduling periodic tasks The rate monotonic algorithm Definition Non-optimality Time-demand analysis...!2

More information

Modeling Uncertainty in Linear Programs: Stochastic and Robust Linear Programming

Modeling Uncertainty in Linear Programs: Stochastic and Robust Linear Programming Modeling Uncertainty in Linear Programs: Stochastic and Robust Programming DGA PhD Student - PhD Thesis EDF-INRIA 10 November 2011 and motivations In real life, Linear Programs are uncertain for several

More information

Optimisation and Operations Research

Optimisation and Operations Research Optimisation and Operations Research Lecture 22: Linear Programming Revisited Matthew Roughan http://www.maths.adelaide.edu.au/matthew.roughan/ Lecture_notes/OORII/ School

More information

CSCI5654 (Linear Programming, Fall 2013) Lecture-8. Lecture 8 Slide# 1

CSCI5654 (Linear Programming, Fall 2013) Lecture-8. Lecture 8 Slide# 1 CSCI5654 (Linear Programming, Fall 2013) Lecture-8 Lecture 8 Slide# 1 Today s Lecture 1. Recap of dual variables and strong duality. 2. Complementary Slackness Theorem. 3. Interpretation of dual variables.

More information

How to Characterize Solutions to Constrained Optimization Problems

How to Characterize Solutions to Constrained Optimization Problems How to Characterize Solutions to Constrained Optimization Problems Michael Peters September 25, 2005 1 Introduction A common technique for characterizing maximum and minimum points in math is to use first

More information

Coin Changing: Give change using the least number of coins. Greedy Method (Chapter 10.1) Attempt to construct an optimal solution in stages.

Coin Changing: Give change using the least number of coins. Greedy Method (Chapter 10.1) Attempt to construct an optimal solution in stages. IV-0 Definitions Optimization Problem: Given an Optimization Function and a set of constraints, find an optimal solution. Optimal Solution: A feasible solution for which the optimization function has the

More information

Miloš Kopa. Decision problems with stochastic dominance constraints

Miloš Kopa. Decision problems with stochastic dominance constraints Decision problems with stochastic dominance constraints Motivation Portfolio selection model Mean risk models max λ Λ m(λ r) νr(λ r) or min λ Λ r(λ r) s.t. m(λ r) µ r is a random vector of assets returns

More information

3E4: Modelling Choice

3E4: Modelling Choice 3E4: Modelling Choice Lecture 6 Goal Programming Multiple Objective Optimisation Portfolio Optimisation Announcements Supervision 2 To be held by the end of next week Present your solutions to all Lecture

More information

Ann-Brith Strömberg. Lecture 4 Linear and Integer Optimization with Applications 1/10

Ann-Brith Strömberg. Lecture 4 Linear and Integer Optimization with Applications 1/10 MVE165/MMG631 Linear and Integer Optimization with Applications Lecture 4 Linear programming: degeneracy; unbounded solution; infeasibility; starting solutions Ann-Brith Strömberg 2017 03 28 Lecture 4

More information

Multiple Representations: Equations to Tables and Graphs Transcript

Multiple Representations: Equations to Tables and Graphs Transcript Algebra l Teacher: It s good to see you again. Last time we talked about multiple representations. If we could, I would like to continue and discuss the subtle differences of multiple representations between

More information

Lecture 17: Numerical Optimization October 2014

Lecture 17: Numerical Optimization October 2014 Lecture 17: Numerical Optimization 36-350 22 October 2014 Agenda Basics of optimization Gradient descent Newton s method Curve-fitting R: optim, nls Reading: Recipes 13.1 and 13.2 in The R Cookbook Optional

More information

4. Convex optimization problems

4. Convex optimization problems Convex Optimization Boyd & Vandenberghe 4. Convex optimization problems optimization problem in standard form convex optimization problems quasiconvex optimization linear optimization quadratic optimization

More information

Final Exam - Answer key

Final Exam - Answer key Fall2015 Final Exam - Answer key ARE211 Problem 1 (True/False) [36 points]: Answer whether each of the following is true (T), or false (IF). Each part is worth 4 points. Not much more than a small amount

More information

Thank you for your interest in the Support Resistance Strength Analyzer!

Thank you for your interest in the Support Resistance Strength Analyzer! This user manual refer to FXCM s Trading Station version of the indicator Support Resistance Strength Analyzer Thank you for your interest in the Support Resistance Strength Analyzer! This unique indicator

More information

Outline. Practical Point Pattern Analysis. David Harvey s Critiques. Peter Gould s Critiques. Global vs. Local. Problems of PPA in Real World

Outline. Practical Point Pattern Analysis. David Harvey s Critiques. Peter Gould s Critiques. Global vs. Local. Problems of PPA in Real World Outline Practical Point Pattern Analysis Critiques of Spatial Statistical Methods Point pattern analysis versus cluster detection Cluster detection techniques Extensions to point pattern measures Multiple

More information

...(iii), x 2 Example 7: Geetha Perfume Company produces both perfumes and body spray from two flower extracts F 1. The following data is provided:

...(iii), x 2 Example 7: Geetha Perfume Company produces both perfumes and body spray from two flower extracts F 1. The following data is provided: The LP formulation is Linear Programming: Graphical Method Maximize, Z = 2x + 7x 2 Subject to constraints, 2x + x 2 200...(i) x 75...(ii) x 2 00...(iii) where x, x 2 ³ 0 Example 7: Geetha Perfume Company

More information

5. Simulated Annealing 5.1 Basic Concepts. Fall 2010 Instructor: Dr. Masoud Yaghini

5. Simulated Annealing 5.1 Basic Concepts. Fall 2010 Instructor: Dr. Masoud Yaghini 5. Simulated Annealing 5.1 Basic Concepts Fall 2010 Instructor: Dr. Masoud Yaghini Outline Introduction Real Annealing and Simulated Annealing Metropolis Algorithm Template of SA A Simple Example References

More information

Multi-objective Quadratic Assignment Problem instances generator with a known optimum solution

Multi-objective Quadratic Assignment Problem instances generator with a known optimum solution Multi-objective Quadratic Assignment Problem instances generator with a known optimum solution Mădălina M. Drugan Artificial Intelligence lab, Vrije Universiteit Brussel, Pleinlaan 2, B-1050 Brussels,

More information

Robust Pareto Design of GMDH-type Neural Networks for Systems with Probabilistic Uncertainties

Robust Pareto Design of GMDH-type Neural Networks for Systems with Probabilistic Uncertainties . Hybrid GMDH-type algorithms and neural networks Robust Pareto Design of GMDH-type eural etworks for Systems with Probabilistic Uncertainties. ariman-zadeh, F. Kalantary, A. Jamali, F. Ebrahimi Department

More information

Metaheuristics and Local Search

Metaheuristics and Local Search Metaheuristics and Local Search 8000 Discrete optimization problems Variables x 1,..., x n. Variable domains D 1,..., D n, with D j Z. Constraints C 1,..., C m, with C i D 1 D n. Objective function f :

More information

Polynomial Models Studio Excel 2007 for Windows Instructions

Polynomial Models Studio Excel 2007 for Windows Instructions Polynomial Models Studio Excel 2007 for Windows Instructions A. Download the data spreadsheet, open it, and select the tab labeled Murder. This has the FBI Uniform Crime Statistics reports of Murder and

More information

Introduction to sensitivity analysis

Introduction to sensitivity analysis Introduction to sensitivity analysis BSAD 0 Dave Novak Summer 0 Overview Introduction to sensitivity analysis Range of optimality Range of feasibility Source: Anderson et al., 0 Quantitative Methods for

More information

FINANCIAL OPTIMIZATION

FINANCIAL OPTIMIZATION FINANCIAL OPTIMIZATION Lecture 1: General Principles and Analytic Optimization Philip H. Dybvig Washington University Saint Louis, Missouri Copyright c Philip H. Dybvig 2008 Choose x R N to minimize f(x)

More information

Sensitivity Analysis and Duality in LP

Sensitivity Analysis and Duality in LP Sensitivity Analysis and Duality in LP Xiaoxi Li EMS & IAS, Wuhan University Oct. 13th, 2016 (week vi) Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 1 /

More information

Math 381 Discrete Mathematical Modeling

Math 381 Discrete Mathematical Modeling Math 381 Discrete Mathematical Modeling Instructor: Sean Griffin Email: stgriff@uw.edu Office Hours: Wed/Fri 1-2pm in PDL C-552 TA: Varodom (Smart) Theplertboon Email: vthep@uw.edu Office Hours: Wed 2-4pm

More information

Convex Optimization & Lagrange Duality

Convex Optimization & Lagrange Duality Convex Optimization & Lagrange Duality Chee Wei Tan CS 8292 : Advanced Topics in Convex Optimization and its Applications Fall 2010 Outline Convex optimization Optimality condition Lagrange duality KKT

More information

CS261: A Second Course in Algorithms Lecture #9: Linear Programming Duality (Part 2)

CS261: A Second Course in Algorithms Lecture #9: Linear Programming Duality (Part 2) CS261: A Second Course in Algorithms Lecture #9: Linear Programming Duality (Part 2) Tim Roughgarden February 2, 2016 1 Recap This is our third lecture on linear programming, and the second on linear programming

More information

Metaheuristics and Local Search. Discrete optimization problems. Solution approaches

Metaheuristics and Local Search. Discrete optimization problems. Solution approaches Discrete Mathematics for Bioinformatics WS 07/08, G. W. Klau, 31. Januar 2008, 11:55 1 Metaheuristics and Local Search Discrete optimization problems Variables x 1,...,x n. Variable domains D 1,...,D n,

More information

Identification of Data Sets for a Robustness Analysis. RDDC Valcartier, 2 Université Laval 10 th ICCRTS

Identification of Data Sets for a Robustness Analysis. RDDC Valcartier, 2 Université Laval 10 th ICCRTS Identification of Data Sets for a Robustness Analysis Micheline Bélanger 1, Jean-Marc Martel 2, Adel Guitouni 1 1 RDDC Valcartier, 2 Université Laval 10 th ICCRTS Defence Research and Development Canada

More information

Fair Questions. Cynthia Dwork, Harvard University & MSR

Fair Questions. Cynthia Dwork, Harvard University & MSR Fair Questions Cynthia Dwork, Harvard University & MSR Outline Fairness in Classification: the one-shot case Metrics The Sui Generis Semantics of Composition Situational Awareness Beyond Classification

More information

Robust Optimal Taxation and Environmental Externalities

Robust Optimal Taxation and Environmental Externalities Robust Optimal Taxation and Environmental Externalities Xin Li Borghan Narajabad Ted Loch-Temzelides Department of Economics Rice University Outline Outline 1 Introduction 2 One-Energy-Sector Model 3 Complete

More information

Forecasting in the presence of recent structural breaks

Forecasting in the presence of recent structural breaks Forecasting in the presence of recent structural breaks Second International Conference in memory of Carlo Giannini Jana Eklund 1, George Kapetanios 1,2 and Simon Price 1,3 1 Bank of England, 2 Queen Mary

More information

Math Models of OR: Sensitivity Analysis

Math Models of OR: Sensitivity Analysis Math Models of OR: Sensitivity Analysis John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY 8 USA October 8 Mitchell Sensitivity Analysis / 9 Optimal tableau and pivot matrix Outline Optimal

More information

Some Fixed-Point Results for the Dynamic Assignment Problem

Some Fixed-Point Results for the Dynamic Assignment Problem Some Fixed-Point Results for the Dynamic Assignment Problem Michael Z. Spivey Department of Mathematics and Computer Science Samford University, Birmingham, AL 35229 Warren B. Powell Department of Operations

More information

Tabu Search. Biological inspiration is memory the ability to use past experiences to improve current decision making.

Tabu Search. Biological inspiration is memory the ability to use past experiences to improve current decision making. Tabu Search Developed by Fred Glover in the 1970 s. Dr Glover is a business professor at University of Colorado at Boulder. Developed specifically as a combinatorial optimization tool. Biological inspiration

More information

Terminology for Statistical Data

Terminology for Statistical Data Terminology for Statistical Data variables - features - attributes observations - cases (consist of multiple values) In a standard data matrix, variables or features correspond to columns observations

More information

Simple Dispatch Rules

Simple Dispatch Rules Simple Dispatch Rules We will first look at some simple dispatch rules: algorithms for which the decision about which job to run next is made based on the jobs and the time (but not on the history of jobs

More information

The discrete-time second-best day-to-day dynamic pricing scheme

The discrete-time second-best day-to-day dynamic pricing scheme The discrete-time second-best day-to-day dynamic pricing scheme Linghui Han, David Z.W. Wang & Chengjuan Zhu 25-07-2017 School of Civil & Environmental Engineering Nanyang Technological University, Singapore

More information

What do you do when you can t use money to solve your problems?

What do you do when you can t use money to solve your problems? Markets without money What do you do when you can t use money to solve your problems? Matching: heterosexual men and women marrying in a small town, students matching to universities, workers to jobs where

More information

Communication Engineering Prof. Surendra Prasad Department of Electrical Engineering Indian Institute of Technology, Delhi

Communication Engineering Prof. Surendra Prasad Department of Electrical Engineering Indian Institute of Technology, Delhi Communication Engineering Prof. Surendra Prasad Department of Electrical Engineering Indian Institute of Technology, Delhi Lecture - 41 Pulse Code Modulation (PCM) So, if you remember we have been talking

More information

Complexity Theory: The P vs NP question

Complexity Theory: The P vs NP question The $1M question Complexity Theory: The P vs NP question Lecture 28 (December 1, 2009) The Clay Mathematics Institute Millenium Prize Problems 1. Birch and Swinnerton-Dyer Conjecture 2. Hodge Conjecture

More information

Robust Local Search for Solving RCPSP/max with Durational Uncertainty

Robust Local Search for Solving RCPSP/max with Durational Uncertainty Journal of Artificial Intelligence Research 43 (2012) 43-86 Submitted 07/11; published 01/12 Robust Local Search for Solving RCPSP/max with Durational Uncertainty Na Fu Hoong Chuin Lau Pradeep Varakantham

More information

Sequencing problems with uncertain parameters and the OWA criterion

Sequencing problems with uncertain parameters and the OWA criterion Sequencing problems with uncertain parameters and the OWA criterion Adam Kasperski 1 Paweł Zieliński 2 1 Institute of Industrial Engineering and Management Wrocław University of Technology, POLAND 2 Institute

More information

GMM and SMM. 1. Hansen, L Large Sample Properties of Generalized Method of Moments Estimators, Econometrica, 50, p

GMM and SMM. 1. Hansen, L Large Sample Properties of Generalized Method of Moments Estimators, Econometrica, 50, p GMM and SMM Some useful references: 1. Hansen, L. 1982. Large Sample Properties of Generalized Method of Moments Estimators, Econometrica, 50, p. 1029-54. 2. Lee, B.S. and B. Ingram. 1991 Simulation estimation

More information

Computational Complexity. IE 496 Lecture 6. Dr. Ted Ralphs

Computational Complexity. IE 496 Lecture 6. Dr. Ted Ralphs Computational Complexity IE 496 Lecture 6 Dr. Ted Ralphs IE496 Lecture 6 1 Reading for This Lecture N&W Sections I.5.1 and I.5.2 Wolsey Chapter 6 Kozen Lectures 21-25 IE496 Lecture 6 2 Introduction to

More information

Particle swarm optimization approach to portfolio optimization

Particle swarm optimization approach to portfolio optimization Nonlinear Analysis: Real World Applications 10 (2009) 2396 2406 Contents lists available at ScienceDirect Nonlinear Analysis: Real World Applications journal homepage: www.elsevier.com/locate/nonrwa Particle

More information

Decision Theory Final Exam Last name I term: (09:50) Instructor: M. Lewandowski, PhD

Decision Theory Final Exam Last name I term: (09:50) Instructor: M. Lewandowski, PhD Problem 1 [10p] Consider the probability density functions of the following six lotteries l1 l6: PDF l 1 l 2 l 3 l 4 l 5 l 6 2,00 0,00 0,10 0,00 0,50 0,50 0,00 0,00 0,50 0,00 0,50 0,00 0,00 0,90 3,00 0,00

More information

ENGI 5708 Design of Civil Engineering Systems

ENGI 5708 Design of Civil Engineering Systems ENGI 5708 Design of Civil Engineering Systems Lecture 10: Sensitivity Analysis Shawn Kenny, Ph.D., P.Eng. Assistant Professor Faculty of Engineering and Applied Science Memorial University of Newfoundland

More information

- Well-characterized problems, min-max relations, approximate certificates. - LP problems in the standard form, primal and dual linear programs

- Well-characterized problems, min-max relations, approximate certificates. - LP problems in the standard form, primal and dual linear programs LP-Duality ( Approximation Algorithms by V. Vazirani, Chapter 12) - Well-characterized problems, min-max relations, approximate certificates - LP problems in the standard form, primal and dual linear programs

More information

2 Linear Classifiers and Perceptrons

2 Linear Classifiers and Perceptrons Linear lassifiers and Perceptrons 7 Linear lassifiers and Perceptrons LASSIFIERS You are given sample of n observations, each with d features. Some observations belong to class ; some do not. Eample: Observations

More information

Stochastic optimization - how to improve computational efficiency?

Stochastic optimization - how to improve computational efficiency? Stochastic optimization - how to improve computational efficiency? Christian Bucher Center of Mechanics and Structural Dynamics Vienna University of Technology & DYNARDO GmbH, Vienna Presentation at Czech

More information

Optimization. Charles J. Geyer School of Statistics University of Minnesota. Stat 8054 Lecture Notes

Optimization. Charles J. Geyer School of Statistics University of Minnesota. Stat 8054 Lecture Notes Optimization Charles J. Geyer School of Statistics University of Minnesota Stat 8054 Lecture Notes 1 One-Dimensional Optimization Look at a graph. Grid search. 2 One-Dimensional Zero Finding Zero finding

More information

Outline. Roadmap for the NPP segment: 1 Preliminaries: role of convexity. 2 Existence of a solution

Outline. Roadmap for the NPP segment: 1 Preliminaries: role of convexity. 2 Existence of a solution Outline Roadmap for the NPP segment: 1 Preliminaries: role of convexity 2 Existence of a solution 3 Necessary conditions for a solution: inequality constraints 4 The constraint qualification 5 The Lagrangian

More information