Inverse Optimization for Linear Fractional Programming
|
|
- Thomas McCarthy
- 5 years ago
- Views:
Transcription
1 444 International Journal of Physical and Mathematical Sciences Vol 4, No 1 (2013) ISSN: International Journal of Physical and Mathematical Sciences journal homepage: Inverse Optimization for Linear Fractional Programming Sanjay Jain 1 *, Nitin Arya 2 1 *Department of Mathematical Sciences, Government College, Ajmer Affiliated to M. D. S. University, Ajmer , INDIA 2 Department of Mathematics, Government Engineering College, Jhalawar Research Scholar, Bhagwant University, Ajmer, INDIA 1* drjainsanjay@gmail.com, 2 nitin.arya1234@gmail.com RECEIVED DATE ( ) Abstract: In this paper, we have proposed an inverse optimization model for linear fractional programming (LFP) problem. In our proposed model, the parameters of the objective function are adjusted as little as possible (under L 1 norm), so that the given feasible solution become optimal. We formulate the inverse linear fractional programming (ILFP) problem as a linear programming problem having large number of variables, which can be solved by many existing methods or optimization software such as: TORA, EXCEL SOLVER etc. The method has been illustrated by a numerical example also. Keywords: Inverse optimization, Linear Fractional Programming, Complementary slackness. 1. Introduction The purpose of this paper is to present a brief taxonomy of an important group of programming problems which occur in certain branches of applied mathematics. A rough heading for these problems is Mathematical Programming Problem. Here special emphasis is given on inverse fractional programming problem. Recently, there has been interest in inverse optimization problems in the mathematical programming community and a variety of inverse optimization problems have been studied by researchers namely, minimum cost flow problem, NP complete problems, minimum spanning tree problem, shortest path problem, linear programming problem, inverse quadratic programming problem etc. Inverse optimization is a relatively new area of research and study of inverse optimization is useful in many branches. In mathematical programming problem, the cost, weights or penalties are not known with precision, but from the past experience or practice, it is plausible to call a solution x 0 or objective value z 0. In inverse problem, we generally assume a solution and to make it an optimal one (if possible), the parameter values associated with the decision variables in objective function or constraints are adjusted as little as possible (under L 1, L 2 or L norm). In numerical analysis, errors for solving the system Ax b are measured in terms of inverse optimization. Some interesting scenario in which solving the inverse problem is faster than solving for the optimal solution: An example is matroid intersection for representable matroids. For some algorithms, the solutions converge to the optimal in an inverse manner: An example is cost scaling algorithms for minimum cost flows. Burton and Toint [1] have first been considered inverse shortest path problem arising in seismic tomography used in predicting the movement of earthquakes. Since then a lot of work has been done on inverse optimization and plenty of inverse problems and their applications have found. Zhang and Liu [2] have first been calculating some inverse linear programming problem and further investigated inverse linear programming problems in [3]. Huang and Liu [4] studied on the inverse problem of linear programming problem and its applications. Ahuja and Orlin [5] provide various references in the area of inverse optimization and compile several applications in network flow problems with unit weight and develop combinatorial proofs of correctness. Amin and Emrouznejad [6] have considered applications of inverse problem. Zhang and Zhang [7,8] worked on inverse quadratic programming problems. Wang [9] has given the cutting plane algorithm for inverse integer programming problem and Hladik [10] have first been considered inverse problem for generalized linear fractional programming. Jain and Arya [11] provide some references in the field of inverse linear fractional programming problem. The linear fractional programming problem seeks to optimize the objective function of non negative variables of quotient form with linear functions in numerator and denominator subject to a set of linear and homogeneous constraints. Bajanilov [12] compiled the literature of Linear Fractional Programming: Theory, Methods, Applications and Software in the form of book. Charnes Cooper [13],
2 445 International Journal of Physical and Mathematical Sciences Vol 4, No 1 (2013) ISSN: Kantiswarup [14], Naganathan and Sakthivel [15], Chadha [16], Jain and Mangal [17, 19], Chadha and Chadha [18], Jain, Mangal and Parihar [20] and many researchers gave different methods for solving linear fractional programming problem. In the following section, we describe in brief how inverse optimization is applied on LFP. In the proposed method, first we consider a feasible solution x 0 and objective value z 0 and using the dual problem and primal dual relation (complementary slackness conditions), we adjust the cost vectors c to c and d to d in such a way that the given solution become optimal for the modified problem. Some standard transformations and L 1 norm are used to reformulate the inverse problem as a linear programming problem. Thus obtained linear programming problem have a large number of variables, and is solvable by any existing methods or optimization software such as: TORA, EXCEL SOLVER etc. 2. Problem Formulation In this section, we study the inverse linear fractional programming problem. We will consider the inverse version of the following linear fractional programming problem, which we shall subsequently refer to as primal problem: Maximize for all and J Where I and J denote the index set of decision variables and constraints respectively. In inverse problem, we fix a feasible solution x 0 and objective value z* and for making it optimal, we perturb the cost vectors c to and d to in such a way that and are minimum, where is some selected L 1 norm defined as. The inverse linear fractional programming (ILFP) problem under L 1 norm can be stated as follows: Minimize, for all, for all Which is a linear programming problem having large number of variables. The notations used in this problem are defined in the next section. 3. The Method The standard linear fractional programming problem is given as follows: Maximize for all and J (1) where,, I and J denote the index set of decision variables and constraints respectively. Dual of the above linear fractional programming problem proposed in [18] is the following linear program: Minimize z for all i I
3 446 International Journal of Physical and Mathematical Sciences Vol 4, No 1 (2013) ISSN: for all i I (2) Where y i is the dual variable associated with ith constraint in (1) and v j is the dual variable associated with each variable x j. If u is the slack variable associated with each constrains in primal problem (1) then the complementary slackness condition for linear fractional programming states that: ( x*,u*) solve (1) and (y*,z*,v*) solve (2) iff v* x* 0 and u* y* 0 In other way it can be written as: If If then then If x 0 is any feasible solution of primal problem and B is the index set of binding constraints in (1) with respect to x 0 (that is ), let L and F denote the index set of variables defined as and, then using these notations the complementary slackness conditions can be restate as: y i 0 for all i v j 0 We want to make x 0 an optimal solution of equation (1) by perturbing the cost vectors c to and d to, so replacing the cost vectors c to and d to and using the complementary slackness conditions in equation (2) gives the following characteristics of the cost vectors: (3) Now we also want to make the value of objective function (z) z* for the feasible solution x 0, so substituting z z* in (3) along with the objective function of primal problem (1) gives the following characteristics of the new cost vectors The inverse problem is to perturb the cost vectors c to and d to so that the feasible solution x 0 become an optimum solution to the modified problem with the objective value z* and also and are minimum, where is some (4) selected L 1 norm defined as.the inverse problem under L 1 norm can be stated as follows: Minimize
4 447 International Journal of Physical and Mathematical Sciences Vol 4, No 1 (2013) ISSN: The above problem is not a linear programming problem but it can be converted to a linear programming problem using a standard transformation. We know that minimizing and are equivalent to minimizing and (5) respectively, subject to the conditions: ; and ; (6) Using these transformations in (5) the inverse linear fractional programming problem can be restate as follows: Minimize, for all (7) Clearly it is a linear programming problem which is solvable by any existing method but due to complexity of the problem it can be solve by optimization software like TORA, EXCEL SOLVER etc. 4. Numerical Example Let the linear fraction programming problem be and is the optimal solution with the objective function value. Let is a feasible solution of above LFP problem and we want to make x 0 an optimal with the objective function value that both the constraints are binding with respect to feasible solution x 0 and also. It can be seen therefore by the complementary slackness conditions and. The inverse linear fractional programming problem is as follows: ; j 1, 2
5 448 International Journal of Physical and Mathematical Sciences Vol 4, No 1 (2013) ISSN: and for i 1,2, for j 1,2 Substituting the values a 11 1, a 12 1, a 21 3, a 22 1, b 1 4, b 2 6, c 1 2, c 2 3, c 0 1, d 1 1, d 2 1, d 0 4, and z* 1,625 in above equations and simplifying gives: Minimize ) and Optimal solution of the inverse problem using optimization software TORA
6 449 International Journal of Physical and Mathematical Sciences Vol 4, No 1 (2013) ISSN: We get y , q , q 2 0, Therefore, the modified cost using (7) is. All other cost coefficients will remain same. Using the modified costs the given LFP problem becomes We observe that the solution of the modified problem is x 1 1, x 2 3 and z and 5. Particular Case: If we substitute for all and in original problem, it reduces to linear programming problem and our proposed method reduces for inverse linear programming problem which is studied earlier by [5]. 6. Conclusion Inverse optimization is an important area in both academic research and practical applications. Using the inverse optimization this paper suggested an inversed based methodology for the solution of linear fractional programming problem. An illustration observation used to demonstrate the advantage of the new approach. REFERENCES [1] Burton, D. and Toint, Ph. L. (1992). On an instance of shortest paths problem, Mathematical Programming, 53,
7 450 International Journal of Physical and Mathematical Sciences Vol 4, No 1 (2013) ISSN: [2] Zhang, J., & Liu, Z. (1996). Calculating some inverse linear programming problems. Journal of Computational and Applied Mathematics, 72, [3] Zhang, J., & Liu, Z. (1999). A further study on inverse linear programming problems. Journal of Computational and Applied Mathematics, 106, [4] Huang, S., & Liu, Z. (1999). On the inverse problem of linear programming and its application to minimum weight perfect k matching. European Journal of Operational Research, 112, [5] Ahuja, R. K. & Orlin, J. B. (2001). Inverse Optimization. Operation Research, 49, [6] Amin, G. R., & Emrouznejad, A. (2007). Inverse Forecasting: A New approach for predictive modeling. Computers & Industrial Engineering. doi: /j.cie [7] Zhang, J. and Zhang, Li. (2009). Solving a class of inverse QP problems by a smoothing Newton method. Journal of Computational Mathematics, 27(6), [8] Zhang, J. and Zhang, Li. (2010). An Augmented Lagrangian Method for a Class of Inverse Quadratic Programming Problems. Applied Math. & Opt., 61(1), [9] Wang, Li. (2010). Cutting plane algorithm for the inverse mixed integer programming problem. Operation Research Letters, 37, [10] Hladik, M. (2010).Generalized linear fractional programming under interval uncertainty. Eur. J. Oper. Res., 205(1), [11] Jain, S. and Arya, N. (2012). Inverse linear fractional Programming: A new approach. Journal of Computer and Mathematical Sciences, 3(5), [12] Bajanilov, Erik B. (2003). Linear Fractional Programming: Theory, Methods, Applications and Software. Kluwer Academic Press. [13] Charnes, A. and Cooper, W. W. (1962). Programming with linear fractional functionals, Naval Research Log. Quart, 9, [14] Swarup, K. (1965) Linear Fractional Functionals Programming, Operations Research, 13, [15] Naganathan, E. R. and Sakthivel, S. (1998). A ratio multiplex algorithm to solve linear fractional programming problems. Opsearch, 35, [16] Chadha, S. S. (1999) A Linear Fractional Program with homogeneous Constraint, Opsearch, 36, [17] Jain, S. and Mangal, A. (2004). Modified Fourier elimination technique for fractional programming problem. Acharya Nagaarjuna International Journal of Mathematics and Information Technology, 1, [18] Chadha, S. S. and Chadha, V. (2007). Linear Fractional Programming and Duality. Operation Research, 49: [19] Jain, S. and Mangal, A. (2008). Extended Gauss elimination technique for integer solution of linear fractional programming. Journal of Indian Mathematical Society, 75, [20] Jain, S. and Mangal, A. and Parihar, P. (2011). Solution of fuzzy linear fractional programming problem. Opsearch, 48,
Inverse Optimization for Quadratic Programming Problems
Inverse Optimization for Quadratic Programming Problems SANJAY JAIN 1* NITIN ARYA 2 1 Department of Mathematical Sciences, Government College, Ajmer Affiliated to M. D. S. University, Ajmer - 305 001,
More informationCS711008Z Algorithm Design and Analysis
CS711008Z Algorithm Design and Analysis Lecture 8 Linear programming: interior point method Dongbo Bu Institute of Computing Technology Chinese Academy of Sciences, Beijing, China 1 / 31 Outline Brief
More informationarxiv: v1 [math.oc] 1 Apr 2017
Inverse Fractional Knapsack Problem with Profits and Costs Modification arxiv:1704.00145v1 [math.oc] 1 Apr 2017 Kien Trung Nguyen Huynh Duc Quoc We address in this paper the problem of modifying both profits
More informationINVERSE SPANNING TREE PROBLEMS: FORMULATIONS AND ALGORITHMS
INVERSE SPANNING TREE PROBLEMS: FORMULATIONS AND ALGORITHMS P. T. Sokkalingam Department of Mathematics Indian Institute of Technology, Kanpur-208 016, INDIA Ravindra K. Ahuja Dept. of Industrial & Management
More informationSome Results in Duality
Int. J. Contemp. Math. Sciences, Vol. 4, 2009, no. 30, 1493-1501 Some Results in Duality Vanita Ben Dhagat and Savita Tiwari Jai Narain college of Technology Bairasia Road, Bhopal M.P., India vanita1_dhagat@yahoo.co.in
More information4y Springer NONLINEAR INTEGER PROGRAMMING
NONLINEAR INTEGER PROGRAMMING DUAN LI Department of Systems Engineering and Engineering Management The Chinese University of Hong Kong Shatin, N. T. Hong Kong XIAOLING SUN Department of Mathematics Shanghai
More informationCS-E4830 Kernel Methods in Machine Learning
CS-E4830 Kernel Methods in Machine Learning Lecture 3: Convex optimization and duality Juho Rousu 27. September, 2017 Juho Rousu 27. September, 2017 1 / 45 Convex optimization Convex optimisation This
More informationA New Method for Optimization of Inefficient Cost Units In The Presence of Undesirable Outputs
Available online at http://ijim.srbiau.ac.ir/ Int. J. Industrial Mathematics (ISSN 2008-5621) Vol. 10, No. 4, 2018 Article ID IJIM-01173, 8 pages Research Article A New Method for Optimization of Inefficient
More informationEFFICIENT ALGORITHMS FOR THE REVERSE SHORTEST PATH PROBLEM ON TREES UNDER THE HAMMING DISTANCE
Yugoslav Journal of Operations Research 27 (2017), Number 1, 46 60 DOI: 10.2298/YJOR150624009T EFFICIENT ALGORITHMS FOR THE REVERSE SHORTEST PATH PROBLEM ON TREES UNDER THE HAMMING DISTANCE Javad TAYYEBI*
More information- Well-characterized problems, min-max relations, approximate certificates. - LP problems in the standard form, primal and dual linear programs
LP-Duality ( Approximation Algorithms by V. Vazirani, Chapter 12) - Well-characterized problems, min-max relations, approximate certificates - LP problems in the standard form, primal and dual linear programs
More informationA Slacks-base Measure of Super-efficiency for Dea with Negative Data
Australian Journal of Basic and Applied Sciences, 4(12): 6197-6210, 2010 ISSN 1991-8178 A Slacks-base Measure of Super-efficiency for Dea with Negative Data 1 F. Hosseinzadeh Lotfi, 2 A.A. Noora, 3 G.R.
More informationSupport Vector Machines: Maximum Margin Classifiers
Support Vector Machines: Maximum Margin Classifiers Machine Learning and Pattern Recognition: September 16, 2008 Piotr Mirowski Based on slides by Sumit Chopra and Fu-Jie Huang 1 Outline What is behind
More informationA Chance-Constrained Programming Model for Inverse Spanning Tree Problem with Uncertain Edge Weights
A Chance-Constrained Programming Model for Inverse Spanning Tree Problem with Uncertain Edge Weights 1 Xiang Zhang, 2 Qina Wang, 3 Jian Zhou* 1, First Author School of Management, Shanghai University,
More informationDuality and Projections
Duality and Projections What s the use? thst@man.dtu.dk DTU-Management Technical University of Denmark 1 Outline Projections revisited... Farka s lemma Proposition 2.22 and 2.23 Duality theory (2.6) Complementary
More informationLecture 5. Theorems of Alternatives and Self-Dual Embedding
IE 8534 1 Lecture 5. Theorems of Alternatives and Self-Dual Embedding IE 8534 2 A system of linear equations may not have a solution. It is well known that either Ax = c has a solution, or A T y = 0, c
More informationLecture #21. c T x Ax b. maximize subject to
COMPSCI 330: Design and Analysis of Algorithms 11/11/2014 Lecture #21 Lecturer: Debmalya Panigrahi Scribe: Samuel Haney 1 Overview In this lecture, we discuss linear programming. We first show that the
More informationRelation of Pure Minimum Cost Flow Model to Linear Programming
Appendix A Page 1 Relation of Pure Minimum Cost Flow Model to Linear Programming The Network Model The network pure minimum cost flow model has m nodes. The external flows given by the vector b with m
More informationLecture 18: Optimization Programming
Fall, 2016 Outline Unconstrained Optimization 1 Unconstrained Optimization 2 Equality-constrained Optimization Inequality-constrained Optimization Mixture-constrained Optimization 3 Quadratic Programming
More informationLinear and Combinatorial Optimization
Linear and Combinatorial Optimization The dual of an LP-problem. Connections between primal and dual. Duality theorems and complementary slack. Philipp Birken (Ctr. for the Math. Sc.) Lecture 3: Duality
More informationEE364a Review Session 5
EE364a Review Session 5 EE364a Review announcements: homeworks 1 and 2 graded homework 4 solutions (check solution to additional problem 1) scpd phone-in office hours: tuesdays 6-7pm (650-723-1156) 1 Complementary
More informationIntroduction to integer programming II
Introduction to integer programming II Martin Branda Charles University in Prague Faculty of Mathematics and Physics Department of Probability and Mathematical Statistics Computational Aspects of Optimization
More informationConvexification of Mixed-Integer Quadratically Constrained Quadratic Programs
Convexification of Mixed-Integer Quadratically Constrained Quadratic Programs Laura Galli 1 Adam N. Letchford 2 Lancaster, April 2011 1 DEIS, University of Bologna, Italy 2 Department of Management Science,
More informationEXERCISES SHORTEST PATHS: APPLICATIONS, OPTIMIZATION, VARIATIONS, AND SOLVING THE CONSTRAINED SHORTEST PATH PROBLEM. 1 Applications and Modelling
SHORTEST PATHS: APPLICATIONS, OPTIMIZATION, VARIATIONS, AND SOLVING THE CONSTRAINED SHORTEST PATH PROBLEM EXERCISES Prepared by Natashia Boland 1 and Irina Dumitrescu 2 1 Applications and Modelling 1.1
More information15-780: LinearProgramming
15-780: LinearProgramming J. Zico Kolter February 1-3, 2016 1 Outline Introduction Some linear algebra review Linear programming Simplex algorithm Duality and dual simplex 2 Outline Introduction Some linear
More informationConvex Optimization & Lagrange Duality
Convex Optimization & Lagrange Duality Chee Wei Tan CS 8292 : Advanced Topics in Convex Optimization and its Applications Fall 2010 Outline Convex optimization Optimality condition Lagrange duality KKT
More informationInverse Stochastic Linear Programming
Inverse Stochastic Linear Programming Görkem Saka, Andrew J. Schaefer Department of Industrial Engineering University of Pittsburgh Pittsburgh, PA USA 15261 Lewis Ntaimo Department of Industrial and Systems
More information5. Duality. Lagrangian
5. Duality Convex Optimization Boyd & Vandenberghe Lagrange dual problem weak and strong duality geometric interpretation optimality conditions perturbation and sensitivity analysis examples generalized
More informationConvex Optimization and Support Vector Machine
Convex Optimization and Support Vector Machine Problem 0. Consider a two-class classification problem. The training data is L n = {(x 1, t 1 ),..., (x n, t n )}, where each t i { 1, 1} and x i R p. We
More informationIntroduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs
Introduction to Mathematical Programming IE406 Lecture 10 Dr. Ted Ralphs IE406 Lecture 10 1 Reading for This Lecture Bertsimas 4.1-4.3 IE406 Lecture 10 2 Duality Theory: Motivation Consider the following
More information14. Duality. ˆ Upper and lower bounds. ˆ General duality. ˆ Constraint qualifications. ˆ Counterexample. ˆ Complementary slackness.
CS/ECE/ISyE 524 Introduction to Optimization Spring 2016 17 14. Duality ˆ Upper and lower bounds ˆ General duality ˆ Constraint qualifications ˆ Counterexample ˆ Complementary slackness ˆ Examples ˆ Sensitivity
More informationTRINITY COLLEGE DUBLIN THE UNIVERSITY OF DUBLIN. School of Mathematics
JS and SS Mathematics JS and SS TSM Mathematics TRINITY COLLEGE DUBLIN THE UNIVERSITY OF DUBLIN School of Mathematics MA3484 Methods of Mathematical Economics Trinity Term 2015 Saturday GOLDHALL 09.30
More informationDuality of LPs and Applications
Lecture 6 Duality of LPs and Applications Last lecture we introduced duality of linear programs. We saw how to form duals, and proved both the weak and strong duality theorems. In this lecture we will
More informationICS-E4030 Kernel Methods in Machine Learning
ICS-E4030 Kernel Methods in Machine Learning Lecture 3: Convex optimization and duality Juho Rousu 28. September, 2016 Juho Rousu 28. September, 2016 1 / 38 Convex optimization Convex optimisation This
More informationKarush-Kuhn-Tucker Conditions. Lecturer: Ryan Tibshirani Convex Optimization /36-725
Karush-Kuhn-Tucker Conditions Lecturer: Ryan Tibshirani Convex Optimization 10-725/36-725 1 Given a minimization problem Last time: duality min x subject to f(x) h i (x) 0, i = 1,... m l j (x) = 0, j =
More informationUnderstanding the Simplex algorithm. Standard Optimization Problems.
Understanding the Simplex algorithm. Ma 162 Spring 2011 Ma 162 Spring 2011 February 28, 2011 Standard Optimization Problems. A standard maximization problem can be conveniently described in matrix form
More informationBBM402-Lecture 20: LP Duality
BBM402-Lecture 20: LP Duality Lecturer: Lale Özkahya Resources for the presentation: https://courses.engr.illinois.edu/cs473/fa2016/lectures.html An easy LP? which is compact form for max cx subject to
More informationLP. Kap. 17: Interior-point methods
LP. Kap. 17: Interior-point methods the simplex algorithm moves along the boundary of the polyhedron P of feasible solutions an alternative is interior-point methods they find a path in the interior of
More informationPseudo-polynomial algorithms for min-max and min-max regret problems
Pseudo-polynomial algorithms for min-max and min-max regret problems Hassene Aissi Cristina Bazgan Daniel Vanderpooten LAMSADE, Université Paris-Dauphine, France {aissi,bazgan,vdp}@lamsade.dauphine.fr
More informationEE/AA 578, Univ of Washington, Fall Duality
7. Duality EE/AA 578, Univ of Washington, Fall 2016 Lagrange dual problem weak and strong duality geometric interpretation optimality conditions perturbation and sensitivity analysis examples generalized
More informationPrimal-Dual Interior-Point Methods
Primal-Dual Interior-Point Methods Lecturer: Aarti Singh Co-instructor: Pradeep Ravikumar Convex Optimization 10-725/36-725 Outline Today: Primal-dual interior-point method Special case: linear programming
More information3. Linear Programming and Polyhedral Combinatorics
Massachusetts Institute of Technology 18.433: Combinatorial Optimization Michel X. Goemans February 28th, 2013 3. Linear Programming and Polyhedral Combinatorics Summary of what was seen in the introductory
More informationSOLVE LEAST ABSOLUTE VALUE REGRESSION PROBLEMS USING MODIFIED GOAL PROGRAMMING TECHNIQUES
Computers Ops Res. Vol. 25, No. 12, pp. 1137±1143, 1998 # 1998 Elsevier Science Ltd. All rights reserved Printed in Great Britain PII: S0305-0548(98)00016-1 0305-0548/98 $19.00 + 0.00 SOLVE LEAST ABSOLUTE
More informationConvex Optimization M2
Convex Optimization M2 Lecture 3 A. d Aspremont. Convex Optimization M2. 1/49 Duality A. d Aspremont. Convex Optimization M2. 2/49 DMs DM par email: dm.daspremont@gmail.com A. d Aspremont. Convex Optimization
More informationNonlinear Optimization Subject to a System of Fuzzy Relational Equations with Max-min Composition
The 7th International Symposium on Operations Research and Its Applications (ISORA 08) Lijiang, China, October 31 Novemver 3, 2008 Copyright 2008 ORSC & APORC, pp. 1 9 Nonlinear Optimization Subject to
More informationarxiv: v1 [math.oc] 14 Oct 2014
arxiv:110.3571v1 [math.oc] 1 Oct 01 An Improved Analysis of Semidefinite Approximation Bound for Nonconvex Nonhomogeneous Quadratic Optimization with Ellipsoid Constraints Yong Hsia a, Shu Wang a, Zi Xu
More informationLecture Note 18: Duality
MATH 5330: Computational Methods of Linear Algebra 1 The Dual Problems Lecture Note 18: Duality Xianyi Zeng Department of Mathematical Sciences, UTEP The concept duality, just like accuracy and stability,
More informationl p -Norm Constrained Quadratic Programming: Conic Approximation Methods
OUTLINE l p -Norm Constrained Quadratic Programming: Conic Approximation Methods Wenxun Xing Department of Mathematical Sciences Tsinghua University, Beijing Email: wxing@math.tsinghua.edu.cn OUTLINE OUTLINE
More informationMath 5593 Linear Programming Week 1
University of Colorado Denver, Fall 2013, Prof. Engau 1 Problem-Solving in Operations Research 2 Brief History of Linear Programming 3 Review of Basic Linear Algebra Linear Programming - The Story About
More informationResource Constrained Project Scheduling Linear and Integer Programming (1)
DM204, 2010 SCHEDULING, TIMETABLING AND ROUTING Lecture 3 Resource Constrained Project Linear and Integer Programming (1) Marco Chiarandini Department of Mathematics & Computer Science University of Southern
More informationConvex Optimization Boyd & Vandenberghe. 5. Duality
5. Duality Convex Optimization Boyd & Vandenberghe Lagrange dual problem weak and strong duality geometric interpretation optimality conditions perturbation and sensitivity analysis examples generalized
More informationI.3. LMI DUALITY. Didier HENRION EECI Graduate School on Control Supélec - Spring 2010
I.3. LMI DUALITY Didier HENRION henrion@laas.fr EECI Graduate School on Control Supélec - Spring 2010 Primal and dual For primal problem p = inf x g 0 (x) s.t. g i (x) 0 define Lagrangian L(x, z) = g 0
More information3. Linear Programming and Polyhedral Combinatorics
Massachusetts Institute of Technology 18.453: Combinatorial Optimization Michel X. Goemans April 5, 2017 3. Linear Programming and Polyhedral Combinatorics Summary of what was seen in the introductory
More informationIn the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight.
In the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight. In the multi-dimensional knapsack problem, additional
More information3. Duality: What is duality? Why does it matter? Sensitivity through duality.
1 Overview of lecture (10/5/10) 1. Review Simplex Method 2. Sensitivity Analysis: How does solution change as parameters change? How much is the optimal solution effected by changing A, b, or c? How much
More informationSemidefinite Programming Basics and Applications
Semidefinite Programming Basics and Applications Ray Pörn, principal lecturer Åbo Akademi University Novia University of Applied Sciences Content What is semidefinite programming (SDP)? How to represent
More informationLinear Programming Duality P&S Chapter 3 Last Revised Nov 1, 2004
Linear Programming Duality P&S Chapter 3 Last Revised Nov 1, 2004 1 In this section we lean about duality, which is another way to approach linear programming. In particular, we will see: How to define
More informationSupport Vector Machines
EE 17/7AT: Optimization Models in Engineering Section 11/1 - April 014 Support Vector Machines Lecturer: Arturo Fernandez Scribe: Arturo Fernandez 1 Support Vector Machines Revisited 1.1 Strictly) Separable
More informationConvex Optimization. Newton s method. ENSAE: Optimisation 1/44
Convex Optimization Newton s method ENSAE: Optimisation 1/44 Unconstrained minimization minimize f(x) f convex, twice continuously differentiable (hence dom f open) we assume optimal value p = inf x f(x)
More informationminimize x subject to (x 2)(x 4) u,
Math 6366/6367: Optimization and Variational Methods Sample Preliminary Exam Questions 1. Suppose that f : [, L] R is a C 2 -function with f () on (, L) and that you have explicit formulae for
More information12. Interior-point methods
12. Interior-point methods Convex Optimization Boyd & Vandenberghe inequality constrained minimization logarithmic barrier function and central path barrier method feasibility and phase I methods complexity
More informationLecture: Duality.
Lecture: Duality http://bicmr.pku.edu.cn/~wenzw/opt-2016-fall.html Acknowledgement: this slides is based on Prof. Lieven Vandenberghe s lecture notes Introduction 2/35 Lagrange dual problem weak and strong
More informationThe Strong Duality Theorem 1
1/39 The Strong Duality Theorem 1 Adrian Vetta 1 This presentation is based upon the book Linear Programming by Vasek Chvatal 2/39 Part I Weak Duality 3/39 Primal and Dual Recall we have a primal linear
More informationUsing quadratic convex reformulation to tighten the convex relaxation of a quadratic program with complementarity constraints
Noname manuscript No. (will be inserted by the editor) Using quadratic conve reformulation to tighten the conve relaation of a quadratic program with complementarity constraints Lijie Bai John E. Mitchell
More informationSymmetric and Asymmetric Duality
journal of mathematical analysis and applications 220, 125 131 (1998) article no. AY975824 Symmetric and Asymmetric Duality Massimo Pappalardo Department of Mathematics, Via Buonarroti 2, 56127, Pisa,
More informationWorked Examples for Chapter 5
Worked Examples for Chapter 5 Example for Section 5.2 Construct the primal-dual table and the dual problem for the following linear programming model fitting our standard form. Maximize Z = 5 x 1 + 4 x
More informationsubject to (x 2)(x 4) u,
Exercises Basic definitions 5.1 A simple example. Consider the optimization problem with variable x R. minimize x 2 + 1 subject to (x 2)(x 4) 0, (a) Analysis of primal problem. Give the feasible set, the
More informationMaximum flow problem
Maximum flow problem 7000 Network flows Network Directed graph G = (V, E) Source node s V, sink node t V Edge capacities: cap : E R 0 Flow: f : E R 0 satisfying 1. Flow conservation constraints e:target(e)=v
More informationMVE165/MMG631 Linear and integer optimization with applications Lecture 8 Discrete optimization: theory and algorithms
MVE165/MMG631 Linear and integer optimization with applications Lecture 8 Discrete optimization: theory and algorithms Ann-Brith Strömberg 2017 04 07 Lecture 8 Linear and integer optimization with applications
More informationInteger Programming (IP)
Integer Programming (IP) An LP problem with an additional constraint that variables will only get an integral value, maybe from some range. BIP binary integer programming: variables should be assigned
More informationSupport Vector Machines
Support Vector Machines Support vector machines (SVMs) are one of the central concepts in all of machine learning. They are simply a combination of two ideas: linear classification via maximum (or optimal
More informationIntroduction to optimization
Introduction to optimization Geir Dahl CMA, Dept. of Mathematics and Dept. of Informatics University of Oslo 1 / 24 The plan 1. The basic concepts 2. Some useful tools (linear programming = linear optimization)
More informationLecture 3 January 28
EECS 28B / STAT 24B: Advanced Topics in Statistical LearningSpring 2009 Lecture 3 January 28 Lecturer: Pradeep Ravikumar Scribe: Timothy J. Wheeler Note: These lecture notes are still rough, and have only
More informationConvex Optimization M2
Convex Optimization M2 Lecture 8 A. d Aspremont. Convex Optimization M2. 1/57 Applications A. d Aspremont. Convex Optimization M2. 2/57 Outline Geometrical problems Approximation problems Combinatorial
More informationConstrained Optimization and Lagrangian Duality
CIS 520: Machine Learning Oct 02, 2017 Constrained Optimization and Lagrangian Duality Lecturer: Shivani Agarwal Disclaimer: These notes are designed to be a supplement to the lecture. They may or may
More informationOutline. Outline. Outline DMP204 SCHEDULING, TIMETABLING AND ROUTING. 1. Scheduling CPM/PERT Resource Constrained Project Scheduling Model
Outline DMP204 SCHEDULING, TIMETABLING AND ROUTING Lecture 3 and Mixed Integer Programg Marco Chiarandini 1. Resource Constrained Project Model 2. Mathematical Programg 2 Outline Outline 1. Resource Constrained
More informationA Solution to Three Objective Transportation Problems Using Fuzzy Compromise Programming Approach
A Solution to Three Objective Transportation Problems Using Fuzzy Compromise Programming Approach *Doke D.M. 1 Ph.D. Student Science college Nanded Nanded, Maharashtra India Email:d.doke@yahoo.co.in Dr.V.A.Jadhav
More informationExtreme Abridgment of Boyd and Vandenberghe s Convex Optimization
Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization Compiled by David Rosenberg Abstract Boyd and Vandenberghe s Convex Optimization book is very well-written and a pleasure to read. The
More informationChapter 1 Linear Programming. Paragraph 5 Duality
Chapter 1 Linear Programming Paragraph 5 Duality What we did so far We developed the 2-Phase Simplex Algorithm: Hop (reasonably) from basic solution (bs) to bs until you find a basic feasible solution
More informationModels and hybrid algorithms for inverse minimum spanning tree problem with stochastic edge weights
ISSN 1 746-7233, England, UK World Journal of Modelling and Simulation Vol. 2 (2006) No. 5, pp. 297-311 Models and hybrid algorithms for inverse minimum spanning tree problem with stochastic edge weights
More informationQuiz Discussion. IE417: Nonlinear Programming: Lecture 12. Motivation. Why do we care? Jeff Linderoth. 16th March 2006
Quiz Discussion IE417: Nonlinear Programming: Lecture 12 Jeff Linderoth Department of Industrial and Systems Engineering Lehigh University 16th March 2006 Motivation Why do we care? We are interested in
More informationSolution of Large-scale LP Problems Using MIP Solvers: Repeated Assignment Problem
The Eighth International Symposium on Operations Research and Its Applications (ISORA 09) Zhangjiajie, China, September 20 22, 2009 Copyright 2009 ORSC & APORC, pp. 190 197 Solution of Large-scale LP Problems
More informationAlgorithms for Inverse Optimization Problems
Algorithms for Inverse Optimization Problems Sara Ahmadian Combinatorics and Optimization, Univ. Waterloo, Waterloo, ON N2L 3G1, Canada sahmadian@uwaterloo.ca Umang Bhaskar 1 Tata Institute of Fundamental
More informationPart IB Optimisation
Part IB Optimisation Theorems Based on lectures by F. A. Fischer Notes taken by Dexter Chua Easter 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after
More informationConvex Optimization and SVM
Convex Optimization and SVM Problem 0. Cf lecture notes pages 12 to 18. Problem 1. (i) A slab is an intersection of two half spaces, hence convex. (ii) A wedge is an intersection of two half spaces, hence
More informationSeparation, Inverse Optimization, and Decomposition. Some Observations. Ted Ralphs 1 Joint work with: Aykut Bulut 1
: Some Observations Ted Ralphs 1 Joint work with: Aykut Bulut 1 1 COR@L Lab, Department of Industrial and Systems Engineering, Lehigh University COLGEN 2016, Buzios, Brazil, 25 May 2016 What Is This Talk
More informationE5295/5B5749 Convex optimization with engineering applications. Lecture 5. Convex programming and semidefinite programming
E5295/5B5749 Convex optimization with engineering applications Lecture 5 Convex programming and semidefinite programming A. Forsgren, KTH 1 Lecture 5 Convex optimization 2006/2007 Convex quadratic program
More informationNONDIFFERENTIABLE SECOND-ORDER MINIMAX MIXED INTEGER SYMMETRIC DUALITY
J. Korean Math. Soc. 48 (011), No. 1, pp. 13 1 DOI 10.4134/JKMS.011.48.1.013 NONDIFFERENTIABLE SECOND-ORDER MINIMAX MIXED INTEGER SYMMETRIC DUALITY Tilak Raj Gulati and Shiv Kumar Gupta Abstract. In this
More informationTHE inverse shortest path problem is one of the most
JOURNAL OF NETWORKS, VOL. 9, NO. 9, SETEMBER 204 2353 An Inverse Shortest ath roblem on an Uncertain Graph Jian Zhou, Fan Yang, Ke Wang School of Management, Shanghai University, Shanghai 200444, China
More informationInteger and Combinatorial Optimization: Introduction
Integer and Combinatorial Optimization: Introduction John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY 12180 USA November 2018 Mitchell Introduction 1 / 18 Integer and Combinatorial Optimization
More informationISM206 Lecture Optimization of Nonlinear Objective with Linear Constraints
ISM206 Lecture Optimization of Nonlinear Objective with Linear Constraints Instructor: Prof. Kevin Ross Scribe: Nitish John October 18, 2011 1 The Basic Goal The main idea is to transform a given constrained
More informationSupport Vector Machines
Support Vector Machines Ryan M. Rifkin Google, Inc. 2008 Plan Regularization derivation of SVMs Geometric derivation of SVMs Optimality, Duality and Large Scale SVMs The Regularization Setting (Again)
More informationLECTURE 25: REVIEW/EPILOGUE LECTURE OUTLINE
LECTURE 25: REVIEW/EPILOGUE LECTURE OUTLINE CONVEX ANALYSIS AND DUALITY Basic concepts of convex analysis Basic concepts of convex optimization Geometric duality framework - MC/MC Constrained optimization
More informationLecture 1. 1 Conic programming. MA 796S: Convex Optimization and Interior Point Methods October 8, Consider the conic program. min.
MA 796S: Convex Optimization and Interior Point Methods October 8, 2007 Lecture 1 Lecturer: Kartik Sivaramakrishnan Scribe: Kartik Sivaramakrishnan 1 Conic programming Consider the conic program min s.t.
More informationOptimum Value of Poverty Measure Using Inverse Optimization Programming Problem
International Journal of Conteporary Matheatical Sciences Vol. 14, 2019, no. 1, 31-42 HIKARI Ltd, www.-hikari.co https://doi.org/10.12988/ijcs.2019.914 Optiu Value of Poverty Measure Using Inverse Optiization
More informationLecture 16: October 22
0-725/36-725: Conve Optimization Fall 208 Lecturer: Ryan Tibshirani Lecture 6: October 22 Scribes: Nic Dalmasso, Alan Mishler, Benja LeRoy Note: LaTeX template courtesy of UC Berkeley EECS dept. Disclaimer:
More informationLecture 9 Tuesday, 4/20/10. Linear Programming
UMass Lowell Computer Science 91.503 Analysis of Algorithms Prof. Karen Daniels Spring, 2010 Lecture 9 Tuesday, 4/20/10 Linear Programming 1 Overview Motivation & Basics Standard & Slack Forms Formulating
More informationIntroduction to linear programming using LEGO.
Introduction to linear programming using LEGO. 1 The manufacturing problem. A manufacturer produces two pieces of furniture, tables and chairs. The production of the furniture requires the use of two different
More informationCombinatorial Optimization
Combinatorial Optimization 2017-2018 1 Maximum matching on bipartite graphs Given a graph G = (V, E), find a maximum cardinal matching. 1.1 Direct algorithms Theorem 1.1 (Petersen, 1891) A matching M is
More informationThe Comparison of Stochastic and Deterministic DEA Models
The International Scientific Conference INPROFORUM 2015, November 5-6, 2015, České Budějovice, 140-145, ISBN 978-80-7394-536-7. The Comparison of Stochastic and Deterministic DEA Models Michal Houda, Jana
More informationMarch 13, Duality 3
15.53 March 13, 27 Duality 3 There are concepts much more difficult to grasp than duality in linear programming. -- Jim Orlin The concept [of nonduality], often described in English as "nondualism," is
More information