Inverse Optimization for Linear Fractional Programming

Size: px
Start display at page:

Download "Inverse Optimization for Linear Fractional Programming"

Transcription

1 444 International Journal of Physical and Mathematical Sciences Vol 4, No 1 (2013) ISSN: International Journal of Physical and Mathematical Sciences journal homepage: Inverse Optimization for Linear Fractional Programming Sanjay Jain 1 *, Nitin Arya 2 1 *Department of Mathematical Sciences, Government College, Ajmer Affiliated to M. D. S. University, Ajmer , INDIA 2 Department of Mathematics, Government Engineering College, Jhalawar Research Scholar, Bhagwant University, Ajmer, INDIA 1* drjainsanjay@gmail.com, 2 nitin.arya1234@gmail.com RECEIVED DATE ( ) Abstract: In this paper, we have proposed an inverse optimization model for linear fractional programming (LFP) problem. In our proposed model, the parameters of the objective function are adjusted as little as possible (under L 1 norm), so that the given feasible solution become optimal. We formulate the inverse linear fractional programming (ILFP) problem as a linear programming problem having large number of variables, which can be solved by many existing methods or optimization software such as: TORA, EXCEL SOLVER etc. The method has been illustrated by a numerical example also. Keywords: Inverse optimization, Linear Fractional Programming, Complementary slackness. 1. Introduction The purpose of this paper is to present a brief taxonomy of an important group of programming problems which occur in certain branches of applied mathematics. A rough heading for these problems is Mathematical Programming Problem. Here special emphasis is given on inverse fractional programming problem. Recently, there has been interest in inverse optimization problems in the mathematical programming community and a variety of inverse optimization problems have been studied by researchers namely, minimum cost flow problem, NP complete problems, minimum spanning tree problem, shortest path problem, linear programming problem, inverse quadratic programming problem etc. Inverse optimization is a relatively new area of research and study of inverse optimization is useful in many branches. In mathematical programming problem, the cost, weights or penalties are not known with precision, but from the past experience or practice, it is plausible to call a solution x 0 or objective value z 0. In inverse problem, we generally assume a solution and to make it an optimal one (if possible), the parameter values associated with the decision variables in objective function or constraints are adjusted as little as possible (under L 1, L 2 or L norm). In numerical analysis, errors for solving the system Ax b are measured in terms of inverse optimization. Some interesting scenario in which solving the inverse problem is faster than solving for the optimal solution: An example is matroid intersection for representable matroids. For some algorithms, the solutions converge to the optimal in an inverse manner: An example is cost scaling algorithms for minimum cost flows. Burton and Toint [1] have first been considered inverse shortest path problem arising in seismic tomography used in predicting the movement of earthquakes. Since then a lot of work has been done on inverse optimization and plenty of inverse problems and their applications have found. Zhang and Liu [2] have first been calculating some inverse linear programming problem and further investigated inverse linear programming problems in [3]. Huang and Liu [4] studied on the inverse problem of linear programming problem and its applications. Ahuja and Orlin [5] provide various references in the area of inverse optimization and compile several applications in network flow problems with unit weight and develop combinatorial proofs of correctness. Amin and Emrouznejad [6] have considered applications of inverse problem. Zhang and Zhang [7,8] worked on inverse quadratic programming problems. Wang [9] has given the cutting plane algorithm for inverse integer programming problem and Hladik [10] have first been considered inverse problem for generalized linear fractional programming. Jain and Arya [11] provide some references in the field of inverse linear fractional programming problem. The linear fractional programming problem seeks to optimize the objective function of non negative variables of quotient form with linear functions in numerator and denominator subject to a set of linear and homogeneous constraints. Bajanilov [12] compiled the literature of Linear Fractional Programming: Theory, Methods, Applications and Software in the form of book. Charnes Cooper [13],

2 445 International Journal of Physical and Mathematical Sciences Vol 4, No 1 (2013) ISSN: Kantiswarup [14], Naganathan and Sakthivel [15], Chadha [16], Jain and Mangal [17, 19], Chadha and Chadha [18], Jain, Mangal and Parihar [20] and many researchers gave different methods for solving linear fractional programming problem. In the following section, we describe in brief how inverse optimization is applied on LFP. In the proposed method, first we consider a feasible solution x 0 and objective value z 0 and using the dual problem and primal dual relation (complementary slackness conditions), we adjust the cost vectors c to c and d to d in such a way that the given solution become optimal for the modified problem. Some standard transformations and L 1 norm are used to reformulate the inverse problem as a linear programming problem. Thus obtained linear programming problem have a large number of variables, and is solvable by any existing methods or optimization software such as: TORA, EXCEL SOLVER etc. 2. Problem Formulation In this section, we study the inverse linear fractional programming problem. We will consider the inverse version of the following linear fractional programming problem, which we shall subsequently refer to as primal problem: Maximize for all and J Where I and J denote the index set of decision variables and constraints respectively. In inverse problem, we fix a feasible solution x 0 and objective value z* and for making it optimal, we perturb the cost vectors c to and d to in such a way that and are minimum, where is some selected L 1 norm defined as. The inverse linear fractional programming (ILFP) problem under L 1 norm can be stated as follows: Minimize, for all, for all Which is a linear programming problem having large number of variables. The notations used in this problem are defined in the next section. 3. The Method The standard linear fractional programming problem is given as follows: Maximize for all and J (1) where,, I and J denote the index set of decision variables and constraints respectively. Dual of the above linear fractional programming problem proposed in [18] is the following linear program: Minimize z for all i I

3 446 International Journal of Physical and Mathematical Sciences Vol 4, No 1 (2013) ISSN: for all i I (2) Where y i is the dual variable associated with ith constraint in (1) and v j is the dual variable associated with each variable x j. If u is the slack variable associated with each constrains in primal problem (1) then the complementary slackness condition for linear fractional programming states that: ( x*,u*) solve (1) and (y*,z*,v*) solve (2) iff v* x* 0 and u* y* 0 In other way it can be written as: If If then then If x 0 is any feasible solution of primal problem and B is the index set of binding constraints in (1) with respect to x 0 (that is ), let L and F denote the index set of variables defined as and, then using these notations the complementary slackness conditions can be restate as: y i 0 for all i v j 0 We want to make x 0 an optimal solution of equation (1) by perturbing the cost vectors c to and d to, so replacing the cost vectors c to and d to and using the complementary slackness conditions in equation (2) gives the following characteristics of the cost vectors: (3) Now we also want to make the value of objective function (z) z* for the feasible solution x 0, so substituting z z* in (3) along with the objective function of primal problem (1) gives the following characteristics of the new cost vectors The inverse problem is to perturb the cost vectors c to and d to so that the feasible solution x 0 become an optimum solution to the modified problem with the objective value z* and also and are minimum, where is some (4) selected L 1 norm defined as.the inverse problem under L 1 norm can be stated as follows: Minimize

4 447 International Journal of Physical and Mathematical Sciences Vol 4, No 1 (2013) ISSN: The above problem is not a linear programming problem but it can be converted to a linear programming problem using a standard transformation. We know that minimizing and are equivalent to minimizing and (5) respectively, subject to the conditions: ; and ; (6) Using these transformations in (5) the inverse linear fractional programming problem can be restate as follows: Minimize, for all (7) Clearly it is a linear programming problem which is solvable by any existing method but due to complexity of the problem it can be solve by optimization software like TORA, EXCEL SOLVER etc. 4. Numerical Example Let the linear fraction programming problem be and is the optimal solution with the objective function value. Let is a feasible solution of above LFP problem and we want to make x 0 an optimal with the objective function value that both the constraints are binding with respect to feasible solution x 0 and also. It can be seen therefore by the complementary slackness conditions and. The inverse linear fractional programming problem is as follows: ; j 1, 2

5 448 International Journal of Physical and Mathematical Sciences Vol 4, No 1 (2013) ISSN: and for i 1,2, for j 1,2 Substituting the values a 11 1, a 12 1, a 21 3, a 22 1, b 1 4, b 2 6, c 1 2, c 2 3, c 0 1, d 1 1, d 2 1, d 0 4, and z* 1,625 in above equations and simplifying gives: Minimize ) and Optimal solution of the inverse problem using optimization software TORA

6 449 International Journal of Physical and Mathematical Sciences Vol 4, No 1 (2013) ISSN: We get y , q , q 2 0, Therefore, the modified cost using (7) is. All other cost coefficients will remain same. Using the modified costs the given LFP problem becomes We observe that the solution of the modified problem is x 1 1, x 2 3 and z and 5. Particular Case: If we substitute for all and in original problem, it reduces to linear programming problem and our proposed method reduces for inverse linear programming problem which is studied earlier by [5]. 6. Conclusion Inverse optimization is an important area in both academic research and practical applications. Using the inverse optimization this paper suggested an inversed based methodology for the solution of linear fractional programming problem. An illustration observation used to demonstrate the advantage of the new approach. REFERENCES [1] Burton, D. and Toint, Ph. L. (1992). On an instance of shortest paths problem, Mathematical Programming, 53,

7 450 International Journal of Physical and Mathematical Sciences Vol 4, No 1 (2013) ISSN: [2] Zhang, J., & Liu, Z. (1996). Calculating some inverse linear programming problems. Journal of Computational and Applied Mathematics, 72, [3] Zhang, J., & Liu, Z. (1999). A further study on inverse linear programming problems. Journal of Computational and Applied Mathematics, 106, [4] Huang, S., & Liu, Z. (1999). On the inverse problem of linear programming and its application to minimum weight perfect k matching. European Journal of Operational Research, 112, [5] Ahuja, R. K. & Orlin, J. B. (2001). Inverse Optimization. Operation Research, 49, [6] Amin, G. R., & Emrouznejad, A. (2007). Inverse Forecasting: A New approach for predictive modeling. Computers & Industrial Engineering. doi: /j.cie [7] Zhang, J. and Zhang, Li. (2009). Solving a class of inverse QP problems by a smoothing Newton method. Journal of Computational Mathematics, 27(6), [8] Zhang, J. and Zhang, Li. (2010). An Augmented Lagrangian Method for a Class of Inverse Quadratic Programming Problems. Applied Math. & Opt., 61(1), [9] Wang, Li. (2010). Cutting plane algorithm for the inverse mixed integer programming problem. Operation Research Letters, 37, [10] Hladik, M. (2010).Generalized linear fractional programming under interval uncertainty. Eur. J. Oper. Res., 205(1), [11] Jain, S. and Arya, N. (2012). Inverse linear fractional Programming: A new approach. Journal of Computer and Mathematical Sciences, 3(5), [12] Bajanilov, Erik B. (2003). Linear Fractional Programming: Theory, Methods, Applications and Software. Kluwer Academic Press. [13] Charnes, A. and Cooper, W. W. (1962). Programming with linear fractional functionals, Naval Research Log. Quart, 9, [14] Swarup, K. (1965) Linear Fractional Functionals Programming, Operations Research, 13, [15] Naganathan, E. R. and Sakthivel, S. (1998). A ratio multiplex algorithm to solve linear fractional programming problems. Opsearch, 35, [16] Chadha, S. S. (1999) A Linear Fractional Program with homogeneous Constraint, Opsearch, 36, [17] Jain, S. and Mangal, A. (2004). Modified Fourier elimination technique for fractional programming problem. Acharya Nagaarjuna International Journal of Mathematics and Information Technology, 1, [18] Chadha, S. S. and Chadha, V. (2007). Linear Fractional Programming and Duality. Operation Research, 49: [19] Jain, S. and Mangal, A. (2008). Extended Gauss elimination technique for integer solution of linear fractional programming. Journal of Indian Mathematical Society, 75, [20] Jain, S. and Mangal, A. and Parihar, P. (2011). Solution of fuzzy linear fractional programming problem. Opsearch, 48,

Inverse Optimization for Quadratic Programming Problems

Inverse Optimization for Quadratic Programming Problems Inverse Optimization for Quadratic Programming Problems SANJAY JAIN 1* NITIN ARYA 2 1 Department of Mathematical Sciences, Government College, Ajmer Affiliated to M. D. S. University, Ajmer - 305 001,

More information

CS711008Z Algorithm Design and Analysis

CS711008Z Algorithm Design and Analysis CS711008Z Algorithm Design and Analysis Lecture 8 Linear programming: interior point method Dongbo Bu Institute of Computing Technology Chinese Academy of Sciences, Beijing, China 1 / 31 Outline Brief

More information

arxiv: v1 [math.oc] 1 Apr 2017

arxiv: v1 [math.oc] 1 Apr 2017 Inverse Fractional Knapsack Problem with Profits and Costs Modification arxiv:1704.00145v1 [math.oc] 1 Apr 2017 Kien Trung Nguyen Huynh Duc Quoc We address in this paper the problem of modifying both profits

More information

INVERSE SPANNING TREE PROBLEMS: FORMULATIONS AND ALGORITHMS

INVERSE SPANNING TREE PROBLEMS: FORMULATIONS AND ALGORITHMS INVERSE SPANNING TREE PROBLEMS: FORMULATIONS AND ALGORITHMS P. T. Sokkalingam Department of Mathematics Indian Institute of Technology, Kanpur-208 016, INDIA Ravindra K. Ahuja Dept. of Industrial & Management

More information

Some Results in Duality

Some Results in Duality Int. J. Contemp. Math. Sciences, Vol. 4, 2009, no. 30, 1493-1501 Some Results in Duality Vanita Ben Dhagat and Savita Tiwari Jai Narain college of Technology Bairasia Road, Bhopal M.P., India vanita1_dhagat@yahoo.co.in

More information

4y Springer NONLINEAR INTEGER PROGRAMMING

4y Springer NONLINEAR INTEGER PROGRAMMING NONLINEAR INTEGER PROGRAMMING DUAN LI Department of Systems Engineering and Engineering Management The Chinese University of Hong Kong Shatin, N. T. Hong Kong XIAOLING SUN Department of Mathematics Shanghai

More information

CS-E4830 Kernel Methods in Machine Learning

CS-E4830 Kernel Methods in Machine Learning CS-E4830 Kernel Methods in Machine Learning Lecture 3: Convex optimization and duality Juho Rousu 27. September, 2017 Juho Rousu 27. September, 2017 1 / 45 Convex optimization Convex optimisation This

More information

A New Method for Optimization of Inefficient Cost Units In The Presence of Undesirable Outputs

A New Method for Optimization of Inefficient Cost Units In The Presence of Undesirable Outputs Available online at http://ijim.srbiau.ac.ir/ Int. J. Industrial Mathematics (ISSN 2008-5621) Vol. 10, No. 4, 2018 Article ID IJIM-01173, 8 pages Research Article A New Method for Optimization of Inefficient

More information

EFFICIENT ALGORITHMS FOR THE REVERSE SHORTEST PATH PROBLEM ON TREES UNDER THE HAMMING DISTANCE

EFFICIENT ALGORITHMS FOR THE REVERSE SHORTEST PATH PROBLEM ON TREES UNDER THE HAMMING DISTANCE Yugoslav Journal of Operations Research 27 (2017), Number 1, 46 60 DOI: 10.2298/YJOR150624009T EFFICIENT ALGORITHMS FOR THE REVERSE SHORTEST PATH PROBLEM ON TREES UNDER THE HAMMING DISTANCE Javad TAYYEBI*

More information

- Well-characterized problems, min-max relations, approximate certificates. - LP problems in the standard form, primal and dual linear programs

- Well-characterized problems, min-max relations, approximate certificates. - LP problems in the standard form, primal and dual linear programs LP-Duality ( Approximation Algorithms by V. Vazirani, Chapter 12) - Well-characterized problems, min-max relations, approximate certificates - LP problems in the standard form, primal and dual linear programs

More information

A Slacks-base Measure of Super-efficiency for Dea with Negative Data

A Slacks-base Measure of Super-efficiency for Dea with Negative Data Australian Journal of Basic and Applied Sciences, 4(12): 6197-6210, 2010 ISSN 1991-8178 A Slacks-base Measure of Super-efficiency for Dea with Negative Data 1 F. Hosseinzadeh Lotfi, 2 A.A. Noora, 3 G.R.

More information

Support Vector Machines: Maximum Margin Classifiers

Support Vector Machines: Maximum Margin Classifiers Support Vector Machines: Maximum Margin Classifiers Machine Learning and Pattern Recognition: September 16, 2008 Piotr Mirowski Based on slides by Sumit Chopra and Fu-Jie Huang 1 Outline What is behind

More information

A Chance-Constrained Programming Model for Inverse Spanning Tree Problem with Uncertain Edge Weights

A Chance-Constrained Programming Model for Inverse Spanning Tree Problem with Uncertain Edge Weights A Chance-Constrained Programming Model for Inverse Spanning Tree Problem with Uncertain Edge Weights 1 Xiang Zhang, 2 Qina Wang, 3 Jian Zhou* 1, First Author School of Management, Shanghai University,

More information

Duality and Projections

Duality and Projections Duality and Projections What s the use? thst@man.dtu.dk DTU-Management Technical University of Denmark 1 Outline Projections revisited... Farka s lemma Proposition 2.22 and 2.23 Duality theory (2.6) Complementary

More information

Lecture 5. Theorems of Alternatives and Self-Dual Embedding

Lecture 5. Theorems of Alternatives and Self-Dual Embedding IE 8534 1 Lecture 5. Theorems of Alternatives and Self-Dual Embedding IE 8534 2 A system of linear equations may not have a solution. It is well known that either Ax = c has a solution, or A T y = 0, c

More information

Lecture #21. c T x Ax b. maximize subject to

Lecture #21. c T x Ax b. maximize subject to COMPSCI 330: Design and Analysis of Algorithms 11/11/2014 Lecture #21 Lecturer: Debmalya Panigrahi Scribe: Samuel Haney 1 Overview In this lecture, we discuss linear programming. We first show that the

More information

Relation of Pure Minimum Cost Flow Model to Linear Programming

Relation of Pure Minimum Cost Flow Model to Linear Programming Appendix A Page 1 Relation of Pure Minimum Cost Flow Model to Linear Programming The Network Model The network pure minimum cost flow model has m nodes. The external flows given by the vector b with m

More information

Lecture 18: Optimization Programming

Lecture 18: Optimization Programming Fall, 2016 Outline Unconstrained Optimization 1 Unconstrained Optimization 2 Equality-constrained Optimization Inequality-constrained Optimization Mixture-constrained Optimization 3 Quadratic Programming

More information

Linear and Combinatorial Optimization

Linear and Combinatorial Optimization Linear and Combinatorial Optimization The dual of an LP-problem. Connections between primal and dual. Duality theorems and complementary slack. Philipp Birken (Ctr. for the Math. Sc.) Lecture 3: Duality

More information

EE364a Review Session 5

EE364a Review Session 5 EE364a Review Session 5 EE364a Review announcements: homeworks 1 and 2 graded homework 4 solutions (check solution to additional problem 1) scpd phone-in office hours: tuesdays 6-7pm (650-723-1156) 1 Complementary

More information

Introduction to integer programming II

Introduction to integer programming II Introduction to integer programming II Martin Branda Charles University in Prague Faculty of Mathematics and Physics Department of Probability and Mathematical Statistics Computational Aspects of Optimization

More information

Convexification of Mixed-Integer Quadratically Constrained Quadratic Programs

Convexification of Mixed-Integer Quadratically Constrained Quadratic Programs Convexification of Mixed-Integer Quadratically Constrained Quadratic Programs Laura Galli 1 Adam N. Letchford 2 Lancaster, April 2011 1 DEIS, University of Bologna, Italy 2 Department of Management Science,

More information

EXERCISES SHORTEST PATHS: APPLICATIONS, OPTIMIZATION, VARIATIONS, AND SOLVING THE CONSTRAINED SHORTEST PATH PROBLEM. 1 Applications and Modelling

EXERCISES SHORTEST PATHS: APPLICATIONS, OPTIMIZATION, VARIATIONS, AND SOLVING THE CONSTRAINED SHORTEST PATH PROBLEM. 1 Applications and Modelling SHORTEST PATHS: APPLICATIONS, OPTIMIZATION, VARIATIONS, AND SOLVING THE CONSTRAINED SHORTEST PATH PROBLEM EXERCISES Prepared by Natashia Boland 1 and Irina Dumitrescu 2 1 Applications and Modelling 1.1

More information

15-780: LinearProgramming

15-780: LinearProgramming 15-780: LinearProgramming J. Zico Kolter February 1-3, 2016 1 Outline Introduction Some linear algebra review Linear programming Simplex algorithm Duality and dual simplex 2 Outline Introduction Some linear

More information

Convex Optimization & Lagrange Duality

Convex Optimization & Lagrange Duality Convex Optimization & Lagrange Duality Chee Wei Tan CS 8292 : Advanced Topics in Convex Optimization and its Applications Fall 2010 Outline Convex optimization Optimality condition Lagrange duality KKT

More information

Inverse Stochastic Linear Programming

Inverse Stochastic Linear Programming Inverse Stochastic Linear Programming Görkem Saka, Andrew J. Schaefer Department of Industrial Engineering University of Pittsburgh Pittsburgh, PA USA 15261 Lewis Ntaimo Department of Industrial and Systems

More information

5. Duality. Lagrangian

5. Duality. Lagrangian 5. Duality Convex Optimization Boyd & Vandenberghe Lagrange dual problem weak and strong duality geometric interpretation optimality conditions perturbation and sensitivity analysis examples generalized

More information

Convex Optimization and Support Vector Machine

Convex Optimization and Support Vector Machine Convex Optimization and Support Vector Machine Problem 0. Consider a two-class classification problem. The training data is L n = {(x 1, t 1 ),..., (x n, t n )}, where each t i { 1, 1} and x i R p. We

More information

Introduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs

Introduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs Introduction to Mathematical Programming IE406 Lecture 10 Dr. Ted Ralphs IE406 Lecture 10 1 Reading for This Lecture Bertsimas 4.1-4.3 IE406 Lecture 10 2 Duality Theory: Motivation Consider the following

More information

14. Duality. ˆ Upper and lower bounds. ˆ General duality. ˆ Constraint qualifications. ˆ Counterexample. ˆ Complementary slackness.

14. Duality. ˆ Upper and lower bounds. ˆ General duality. ˆ Constraint qualifications. ˆ Counterexample. ˆ Complementary slackness. CS/ECE/ISyE 524 Introduction to Optimization Spring 2016 17 14. Duality ˆ Upper and lower bounds ˆ General duality ˆ Constraint qualifications ˆ Counterexample ˆ Complementary slackness ˆ Examples ˆ Sensitivity

More information

TRINITY COLLEGE DUBLIN THE UNIVERSITY OF DUBLIN. School of Mathematics

TRINITY COLLEGE DUBLIN THE UNIVERSITY OF DUBLIN. School of Mathematics JS and SS Mathematics JS and SS TSM Mathematics TRINITY COLLEGE DUBLIN THE UNIVERSITY OF DUBLIN School of Mathematics MA3484 Methods of Mathematical Economics Trinity Term 2015 Saturday GOLDHALL 09.30

More information

Duality of LPs and Applications

Duality of LPs and Applications Lecture 6 Duality of LPs and Applications Last lecture we introduced duality of linear programs. We saw how to form duals, and proved both the weak and strong duality theorems. In this lecture we will

More information

ICS-E4030 Kernel Methods in Machine Learning

ICS-E4030 Kernel Methods in Machine Learning ICS-E4030 Kernel Methods in Machine Learning Lecture 3: Convex optimization and duality Juho Rousu 28. September, 2016 Juho Rousu 28. September, 2016 1 / 38 Convex optimization Convex optimisation This

More information

Karush-Kuhn-Tucker Conditions. Lecturer: Ryan Tibshirani Convex Optimization /36-725

Karush-Kuhn-Tucker Conditions. Lecturer: Ryan Tibshirani Convex Optimization /36-725 Karush-Kuhn-Tucker Conditions Lecturer: Ryan Tibshirani Convex Optimization 10-725/36-725 1 Given a minimization problem Last time: duality min x subject to f(x) h i (x) 0, i = 1,... m l j (x) = 0, j =

More information

Understanding the Simplex algorithm. Standard Optimization Problems.

Understanding the Simplex algorithm. Standard Optimization Problems. Understanding the Simplex algorithm. Ma 162 Spring 2011 Ma 162 Spring 2011 February 28, 2011 Standard Optimization Problems. A standard maximization problem can be conveniently described in matrix form

More information

BBM402-Lecture 20: LP Duality

BBM402-Lecture 20: LP Duality BBM402-Lecture 20: LP Duality Lecturer: Lale Özkahya Resources for the presentation: https://courses.engr.illinois.edu/cs473/fa2016/lectures.html An easy LP? which is compact form for max cx subject to

More information

LP. Kap. 17: Interior-point methods

LP. Kap. 17: Interior-point methods LP. Kap. 17: Interior-point methods the simplex algorithm moves along the boundary of the polyhedron P of feasible solutions an alternative is interior-point methods they find a path in the interior of

More information

Pseudo-polynomial algorithms for min-max and min-max regret problems

Pseudo-polynomial algorithms for min-max and min-max regret problems Pseudo-polynomial algorithms for min-max and min-max regret problems Hassene Aissi Cristina Bazgan Daniel Vanderpooten LAMSADE, Université Paris-Dauphine, France {aissi,bazgan,vdp}@lamsade.dauphine.fr

More information

EE/AA 578, Univ of Washington, Fall Duality

EE/AA 578, Univ of Washington, Fall Duality 7. Duality EE/AA 578, Univ of Washington, Fall 2016 Lagrange dual problem weak and strong duality geometric interpretation optimality conditions perturbation and sensitivity analysis examples generalized

More information

Primal-Dual Interior-Point Methods

Primal-Dual Interior-Point Methods Primal-Dual Interior-Point Methods Lecturer: Aarti Singh Co-instructor: Pradeep Ravikumar Convex Optimization 10-725/36-725 Outline Today: Primal-dual interior-point method Special case: linear programming

More information

3. Linear Programming and Polyhedral Combinatorics

3. Linear Programming and Polyhedral Combinatorics Massachusetts Institute of Technology 18.433: Combinatorial Optimization Michel X. Goemans February 28th, 2013 3. Linear Programming and Polyhedral Combinatorics Summary of what was seen in the introductory

More information

SOLVE LEAST ABSOLUTE VALUE REGRESSION PROBLEMS USING MODIFIED GOAL PROGRAMMING TECHNIQUES

SOLVE LEAST ABSOLUTE VALUE REGRESSION PROBLEMS USING MODIFIED GOAL PROGRAMMING TECHNIQUES Computers Ops Res. Vol. 25, No. 12, pp. 1137±1143, 1998 # 1998 Elsevier Science Ltd. All rights reserved Printed in Great Britain PII: S0305-0548(98)00016-1 0305-0548/98 $19.00 + 0.00 SOLVE LEAST ABSOLUTE

More information

Convex Optimization M2

Convex Optimization M2 Convex Optimization M2 Lecture 3 A. d Aspremont. Convex Optimization M2. 1/49 Duality A. d Aspremont. Convex Optimization M2. 2/49 DMs DM par email: dm.daspremont@gmail.com A. d Aspremont. Convex Optimization

More information

Nonlinear Optimization Subject to a System of Fuzzy Relational Equations with Max-min Composition

Nonlinear Optimization Subject to a System of Fuzzy Relational Equations with Max-min Composition The 7th International Symposium on Operations Research and Its Applications (ISORA 08) Lijiang, China, October 31 Novemver 3, 2008 Copyright 2008 ORSC & APORC, pp. 1 9 Nonlinear Optimization Subject to

More information

arxiv: v1 [math.oc] 14 Oct 2014

arxiv: v1 [math.oc] 14 Oct 2014 arxiv:110.3571v1 [math.oc] 1 Oct 01 An Improved Analysis of Semidefinite Approximation Bound for Nonconvex Nonhomogeneous Quadratic Optimization with Ellipsoid Constraints Yong Hsia a, Shu Wang a, Zi Xu

More information

Lecture Note 18: Duality

Lecture Note 18: Duality MATH 5330: Computational Methods of Linear Algebra 1 The Dual Problems Lecture Note 18: Duality Xianyi Zeng Department of Mathematical Sciences, UTEP The concept duality, just like accuracy and stability,

More information

l p -Norm Constrained Quadratic Programming: Conic Approximation Methods

l p -Norm Constrained Quadratic Programming: Conic Approximation Methods OUTLINE l p -Norm Constrained Quadratic Programming: Conic Approximation Methods Wenxun Xing Department of Mathematical Sciences Tsinghua University, Beijing Email: wxing@math.tsinghua.edu.cn OUTLINE OUTLINE

More information

Math 5593 Linear Programming Week 1

Math 5593 Linear Programming Week 1 University of Colorado Denver, Fall 2013, Prof. Engau 1 Problem-Solving in Operations Research 2 Brief History of Linear Programming 3 Review of Basic Linear Algebra Linear Programming - The Story About

More information

Resource Constrained Project Scheduling Linear and Integer Programming (1)

Resource Constrained Project Scheduling Linear and Integer Programming (1) DM204, 2010 SCHEDULING, TIMETABLING AND ROUTING Lecture 3 Resource Constrained Project Linear and Integer Programming (1) Marco Chiarandini Department of Mathematics & Computer Science University of Southern

More information

Convex Optimization Boyd & Vandenberghe. 5. Duality

Convex Optimization Boyd & Vandenberghe. 5. Duality 5. Duality Convex Optimization Boyd & Vandenberghe Lagrange dual problem weak and strong duality geometric interpretation optimality conditions perturbation and sensitivity analysis examples generalized

More information

I.3. LMI DUALITY. Didier HENRION EECI Graduate School on Control Supélec - Spring 2010

I.3. LMI DUALITY. Didier HENRION EECI Graduate School on Control Supélec - Spring 2010 I.3. LMI DUALITY Didier HENRION henrion@laas.fr EECI Graduate School on Control Supélec - Spring 2010 Primal and dual For primal problem p = inf x g 0 (x) s.t. g i (x) 0 define Lagrangian L(x, z) = g 0

More information

3. Linear Programming and Polyhedral Combinatorics

3. Linear Programming and Polyhedral Combinatorics Massachusetts Institute of Technology 18.453: Combinatorial Optimization Michel X. Goemans April 5, 2017 3. Linear Programming and Polyhedral Combinatorics Summary of what was seen in the introductory

More information

In the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight.

In the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight. In the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight. In the multi-dimensional knapsack problem, additional

More information

3. Duality: What is duality? Why does it matter? Sensitivity through duality.

3. Duality: What is duality? Why does it matter? Sensitivity through duality. 1 Overview of lecture (10/5/10) 1. Review Simplex Method 2. Sensitivity Analysis: How does solution change as parameters change? How much is the optimal solution effected by changing A, b, or c? How much

More information

Semidefinite Programming Basics and Applications

Semidefinite Programming Basics and Applications Semidefinite Programming Basics and Applications Ray Pörn, principal lecturer Åbo Akademi University Novia University of Applied Sciences Content What is semidefinite programming (SDP)? How to represent

More information

Linear Programming Duality P&S Chapter 3 Last Revised Nov 1, 2004

Linear Programming Duality P&S Chapter 3 Last Revised Nov 1, 2004 Linear Programming Duality P&S Chapter 3 Last Revised Nov 1, 2004 1 In this section we lean about duality, which is another way to approach linear programming. In particular, we will see: How to define

More information

Support Vector Machines

Support Vector Machines EE 17/7AT: Optimization Models in Engineering Section 11/1 - April 014 Support Vector Machines Lecturer: Arturo Fernandez Scribe: Arturo Fernandez 1 Support Vector Machines Revisited 1.1 Strictly) Separable

More information

Convex Optimization. Newton s method. ENSAE: Optimisation 1/44

Convex Optimization. Newton s method. ENSAE: Optimisation 1/44 Convex Optimization Newton s method ENSAE: Optimisation 1/44 Unconstrained minimization minimize f(x) f convex, twice continuously differentiable (hence dom f open) we assume optimal value p = inf x f(x)

More information

minimize x subject to (x 2)(x 4) u,

minimize x subject to (x 2)(x 4) u, Math 6366/6367: Optimization and Variational Methods Sample Preliminary Exam Questions 1. Suppose that f : [, L] R is a C 2 -function with f () on (, L) and that you have explicit formulae for

More information

12. Interior-point methods

12. Interior-point methods 12. Interior-point methods Convex Optimization Boyd & Vandenberghe inequality constrained minimization logarithmic barrier function and central path barrier method feasibility and phase I methods complexity

More information

Lecture: Duality.

Lecture: Duality. Lecture: Duality http://bicmr.pku.edu.cn/~wenzw/opt-2016-fall.html Acknowledgement: this slides is based on Prof. Lieven Vandenberghe s lecture notes Introduction 2/35 Lagrange dual problem weak and strong

More information

The Strong Duality Theorem 1

The Strong Duality Theorem 1 1/39 The Strong Duality Theorem 1 Adrian Vetta 1 This presentation is based upon the book Linear Programming by Vasek Chvatal 2/39 Part I Weak Duality 3/39 Primal and Dual Recall we have a primal linear

More information

Using quadratic convex reformulation to tighten the convex relaxation of a quadratic program with complementarity constraints

Using quadratic convex reformulation to tighten the convex relaxation of a quadratic program with complementarity constraints Noname manuscript No. (will be inserted by the editor) Using quadratic conve reformulation to tighten the conve relaation of a quadratic program with complementarity constraints Lijie Bai John E. Mitchell

More information

Symmetric and Asymmetric Duality

Symmetric and Asymmetric Duality journal of mathematical analysis and applications 220, 125 131 (1998) article no. AY975824 Symmetric and Asymmetric Duality Massimo Pappalardo Department of Mathematics, Via Buonarroti 2, 56127, Pisa,

More information

Worked Examples for Chapter 5

Worked Examples for Chapter 5 Worked Examples for Chapter 5 Example for Section 5.2 Construct the primal-dual table and the dual problem for the following linear programming model fitting our standard form. Maximize Z = 5 x 1 + 4 x

More information

subject to (x 2)(x 4) u,

subject to (x 2)(x 4) u, Exercises Basic definitions 5.1 A simple example. Consider the optimization problem with variable x R. minimize x 2 + 1 subject to (x 2)(x 4) 0, (a) Analysis of primal problem. Give the feasible set, the

More information

Maximum flow problem

Maximum flow problem Maximum flow problem 7000 Network flows Network Directed graph G = (V, E) Source node s V, sink node t V Edge capacities: cap : E R 0 Flow: f : E R 0 satisfying 1. Flow conservation constraints e:target(e)=v

More information

MVE165/MMG631 Linear and integer optimization with applications Lecture 8 Discrete optimization: theory and algorithms

MVE165/MMG631 Linear and integer optimization with applications Lecture 8 Discrete optimization: theory and algorithms MVE165/MMG631 Linear and integer optimization with applications Lecture 8 Discrete optimization: theory and algorithms Ann-Brith Strömberg 2017 04 07 Lecture 8 Linear and integer optimization with applications

More information

Integer Programming (IP)

Integer Programming (IP) Integer Programming (IP) An LP problem with an additional constraint that variables will only get an integral value, maybe from some range. BIP binary integer programming: variables should be assigned

More information

Support Vector Machines

Support Vector Machines Support Vector Machines Support vector machines (SVMs) are one of the central concepts in all of machine learning. They are simply a combination of two ideas: linear classification via maximum (or optimal

More information

Introduction to optimization

Introduction to optimization Introduction to optimization Geir Dahl CMA, Dept. of Mathematics and Dept. of Informatics University of Oslo 1 / 24 The plan 1. The basic concepts 2. Some useful tools (linear programming = linear optimization)

More information

Lecture 3 January 28

Lecture 3 January 28 EECS 28B / STAT 24B: Advanced Topics in Statistical LearningSpring 2009 Lecture 3 January 28 Lecturer: Pradeep Ravikumar Scribe: Timothy J. Wheeler Note: These lecture notes are still rough, and have only

More information

Convex Optimization M2

Convex Optimization M2 Convex Optimization M2 Lecture 8 A. d Aspremont. Convex Optimization M2. 1/57 Applications A. d Aspremont. Convex Optimization M2. 2/57 Outline Geometrical problems Approximation problems Combinatorial

More information

Constrained Optimization and Lagrangian Duality

Constrained Optimization and Lagrangian Duality CIS 520: Machine Learning Oct 02, 2017 Constrained Optimization and Lagrangian Duality Lecturer: Shivani Agarwal Disclaimer: These notes are designed to be a supplement to the lecture. They may or may

More information

Outline. Outline. Outline DMP204 SCHEDULING, TIMETABLING AND ROUTING. 1. Scheduling CPM/PERT Resource Constrained Project Scheduling Model

Outline. Outline. Outline DMP204 SCHEDULING, TIMETABLING AND ROUTING. 1. Scheduling CPM/PERT Resource Constrained Project Scheduling Model Outline DMP204 SCHEDULING, TIMETABLING AND ROUTING Lecture 3 and Mixed Integer Programg Marco Chiarandini 1. Resource Constrained Project Model 2. Mathematical Programg 2 Outline Outline 1. Resource Constrained

More information

A Solution to Three Objective Transportation Problems Using Fuzzy Compromise Programming Approach

A Solution to Three Objective Transportation Problems Using Fuzzy Compromise Programming Approach A Solution to Three Objective Transportation Problems Using Fuzzy Compromise Programming Approach *Doke D.M. 1 Ph.D. Student Science college Nanded Nanded, Maharashtra India Email:d.doke@yahoo.co.in Dr.V.A.Jadhav

More information

Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization

Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization Compiled by David Rosenberg Abstract Boyd and Vandenberghe s Convex Optimization book is very well-written and a pleasure to read. The

More information

Chapter 1 Linear Programming. Paragraph 5 Duality

Chapter 1 Linear Programming. Paragraph 5 Duality Chapter 1 Linear Programming Paragraph 5 Duality What we did so far We developed the 2-Phase Simplex Algorithm: Hop (reasonably) from basic solution (bs) to bs until you find a basic feasible solution

More information

Models and hybrid algorithms for inverse minimum spanning tree problem with stochastic edge weights

Models and hybrid algorithms for inverse minimum spanning tree problem with stochastic edge weights ISSN 1 746-7233, England, UK World Journal of Modelling and Simulation Vol. 2 (2006) No. 5, pp. 297-311 Models and hybrid algorithms for inverse minimum spanning tree problem with stochastic edge weights

More information

Quiz Discussion. IE417: Nonlinear Programming: Lecture 12. Motivation. Why do we care? Jeff Linderoth. 16th March 2006

Quiz Discussion. IE417: Nonlinear Programming: Lecture 12. Motivation. Why do we care? Jeff Linderoth. 16th March 2006 Quiz Discussion IE417: Nonlinear Programming: Lecture 12 Jeff Linderoth Department of Industrial and Systems Engineering Lehigh University 16th March 2006 Motivation Why do we care? We are interested in

More information

Solution of Large-scale LP Problems Using MIP Solvers: Repeated Assignment Problem

Solution of Large-scale LP Problems Using MIP Solvers: Repeated Assignment Problem The Eighth International Symposium on Operations Research and Its Applications (ISORA 09) Zhangjiajie, China, September 20 22, 2009 Copyright 2009 ORSC & APORC, pp. 190 197 Solution of Large-scale LP Problems

More information

Algorithms for Inverse Optimization Problems

Algorithms for Inverse Optimization Problems Algorithms for Inverse Optimization Problems Sara Ahmadian Combinatorics and Optimization, Univ. Waterloo, Waterloo, ON N2L 3G1, Canada sahmadian@uwaterloo.ca Umang Bhaskar 1 Tata Institute of Fundamental

More information

Part IB Optimisation

Part IB Optimisation Part IB Optimisation Theorems Based on lectures by F. A. Fischer Notes taken by Dexter Chua Easter 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after

More information

Convex Optimization and SVM

Convex Optimization and SVM Convex Optimization and SVM Problem 0. Cf lecture notes pages 12 to 18. Problem 1. (i) A slab is an intersection of two half spaces, hence convex. (ii) A wedge is an intersection of two half spaces, hence

More information

Separation, Inverse Optimization, and Decomposition. Some Observations. Ted Ralphs 1 Joint work with: Aykut Bulut 1

Separation, Inverse Optimization, and Decomposition. Some Observations. Ted Ralphs 1 Joint work with: Aykut Bulut 1 : Some Observations Ted Ralphs 1 Joint work with: Aykut Bulut 1 1 COR@L Lab, Department of Industrial and Systems Engineering, Lehigh University COLGEN 2016, Buzios, Brazil, 25 May 2016 What Is This Talk

More information

E5295/5B5749 Convex optimization with engineering applications. Lecture 5. Convex programming and semidefinite programming

E5295/5B5749 Convex optimization with engineering applications. Lecture 5. Convex programming and semidefinite programming E5295/5B5749 Convex optimization with engineering applications Lecture 5 Convex programming and semidefinite programming A. Forsgren, KTH 1 Lecture 5 Convex optimization 2006/2007 Convex quadratic program

More information

NONDIFFERENTIABLE SECOND-ORDER MINIMAX MIXED INTEGER SYMMETRIC DUALITY

NONDIFFERENTIABLE SECOND-ORDER MINIMAX MIXED INTEGER SYMMETRIC DUALITY J. Korean Math. Soc. 48 (011), No. 1, pp. 13 1 DOI 10.4134/JKMS.011.48.1.013 NONDIFFERENTIABLE SECOND-ORDER MINIMAX MIXED INTEGER SYMMETRIC DUALITY Tilak Raj Gulati and Shiv Kumar Gupta Abstract. In this

More information

THE inverse shortest path problem is one of the most

THE inverse shortest path problem is one of the most JOURNAL OF NETWORKS, VOL. 9, NO. 9, SETEMBER 204 2353 An Inverse Shortest ath roblem on an Uncertain Graph Jian Zhou, Fan Yang, Ke Wang School of Management, Shanghai University, Shanghai 200444, China

More information

Integer and Combinatorial Optimization: Introduction

Integer and Combinatorial Optimization: Introduction Integer and Combinatorial Optimization: Introduction John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY 12180 USA November 2018 Mitchell Introduction 1 / 18 Integer and Combinatorial Optimization

More information

ISM206 Lecture Optimization of Nonlinear Objective with Linear Constraints

ISM206 Lecture Optimization of Nonlinear Objective with Linear Constraints ISM206 Lecture Optimization of Nonlinear Objective with Linear Constraints Instructor: Prof. Kevin Ross Scribe: Nitish John October 18, 2011 1 The Basic Goal The main idea is to transform a given constrained

More information

Support Vector Machines

Support Vector Machines Support Vector Machines Ryan M. Rifkin Google, Inc. 2008 Plan Regularization derivation of SVMs Geometric derivation of SVMs Optimality, Duality and Large Scale SVMs The Regularization Setting (Again)

More information

LECTURE 25: REVIEW/EPILOGUE LECTURE OUTLINE

LECTURE 25: REVIEW/EPILOGUE LECTURE OUTLINE LECTURE 25: REVIEW/EPILOGUE LECTURE OUTLINE CONVEX ANALYSIS AND DUALITY Basic concepts of convex analysis Basic concepts of convex optimization Geometric duality framework - MC/MC Constrained optimization

More information

Lecture 1. 1 Conic programming. MA 796S: Convex Optimization and Interior Point Methods October 8, Consider the conic program. min.

Lecture 1. 1 Conic programming. MA 796S: Convex Optimization and Interior Point Methods October 8, Consider the conic program. min. MA 796S: Convex Optimization and Interior Point Methods October 8, 2007 Lecture 1 Lecturer: Kartik Sivaramakrishnan Scribe: Kartik Sivaramakrishnan 1 Conic programming Consider the conic program min s.t.

More information

Optimum Value of Poverty Measure Using Inverse Optimization Programming Problem

Optimum Value of Poverty Measure Using Inverse Optimization Programming Problem International Journal of Conteporary Matheatical Sciences Vol. 14, 2019, no. 1, 31-42 HIKARI Ltd, www.-hikari.co https://doi.org/10.12988/ijcs.2019.914 Optiu Value of Poverty Measure Using Inverse Optiization

More information

Lecture 16: October 22

Lecture 16: October 22 0-725/36-725: Conve Optimization Fall 208 Lecturer: Ryan Tibshirani Lecture 6: October 22 Scribes: Nic Dalmasso, Alan Mishler, Benja LeRoy Note: LaTeX template courtesy of UC Berkeley EECS dept. Disclaimer:

More information

Lecture 9 Tuesday, 4/20/10. Linear Programming

Lecture 9 Tuesday, 4/20/10. Linear Programming UMass Lowell Computer Science 91.503 Analysis of Algorithms Prof. Karen Daniels Spring, 2010 Lecture 9 Tuesday, 4/20/10 Linear Programming 1 Overview Motivation & Basics Standard & Slack Forms Formulating

More information

Introduction to linear programming using LEGO.

Introduction to linear programming using LEGO. Introduction to linear programming using LEGO. 1 The manufacturing problem. A manufacturer produces two pieces of furniture, tables and chairs. The production of the furniture requires the use of two different

More information

Combinatorial Optimization

Combinatorial Optimization Combinatorial Optimization 2017-2018 1 Maximum matching on bipartite graphs Given a graph G = (V, E), find a maximum cardinal matching. 1.1 Direct algorithms Theorem 1.1 (Petersen, 1891) A matching M is

More information

The Comparison of Stochastic and Deterministic DEA Models

The Comparison of Stochastic and Deterministic DEA Models The International Scientific Conference INPROFORUM 2015, November 5-6, 2015, České Budějovice, 140-145, ISBN 978-80-7394-536-7. The Comparison of Stochastic and Deterministic DEA Models Michal Houda, Jana

More information

March 13, Duality 3

March 13, Duality 3 15.53 March 13, 27 Duality 3 There are concepts much more difficult to grasp than duality in linear programming. -- Jim Orlin The concept [of nonduality], often described in English as "nondualism," is

More information