Polynomial Barrier Method for Solving Linear Programming Problems

Similar documents
What is LP? LP is an optimization technique that allocates limited resources among competing activities in the best possible manner.

Applied Mathematics Letters

System in Weibull Distribution

Xiangwen Li. March 8th and March 13th, 2001

Least Squares Fitting of Data

Recap: the SVM problem

CHAPTER 6 CONSTRAINED OPTIMIZATION 1: K-T CONDITIONS

Department of Economics, Niigata Sangyo University, Niigata, Japan

Several generation methods of multinomial distributed random number Tian Lei 1, a,linxihe 1,b,Zhigang Zhang 1,c

Solving Fuzzy Linear Programming Problem With Fuzzy Relational Equation Constraint

OPTIMISATION. Introduction Single Variable Unconstrained Optimisation Multivariable Unconstrained Optimisation Linear Programming

Slobodan Lakić. Communicated by R. Van Keer

1. Statement of the problem

The Karush-Kuhn-Tucker. Nuno Vasconcelos ECE Department, UCSD

CHAPTER 7 CONSTRAINED OPTIMIZATION 1: THE KARUSH-KUHN-TUCKER CONDITIONS

Denote the function derivatives f(x) in given points. x a b. Using relationships (1.2), polynomials (1.1) are written in the form

MMA and GCMMA two methods for nonlinear optimization

Local Perturbation Analysis of Linear Programming with Functional relation Among Parameters

Machine Learning. What is a good Decision Boundary? Support Vector Machines

Least Squares Fitting of Data

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede. ) with a symmetric Pcovariance matrix of the y( x ) measurements V

XII.3 The EM (Expectation-Maximization) Algorithm

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution.

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Chapter 12 Lyes KADEM [Thermodynamics II] 2007

On the number of regions in an m-dimensional space cut by n hyperplanes

Excess Error, Approximation Error, and Estimation Error

Minimization of l 2 -Norm of the KSOR Operator

Our focus will be on linear systems. A system is linear if it obeys the principle of superposition and homogenity, i.e.

On Pfaff s solution of the Pfaff problem

The Parity of the Number of Irreducible Factors for Some Pentanomials

Integral Transforms and Dual Integral Equations to Solve Heat Equation with Mixed Conditions

COMP th April, 2007 Clement Pang

A new Approach for Solving Linear Ordinary Differential Equations

Machine Learning. Support Vector Machines. Eric Xing. Lecture 4, August 12, Reading: Eric CMU,

Preference and Demand Examples

Optimization. Nuno Vasconcelos ECE Department, UCSD

COS 511: Theoretical Machine Learning

Convexity preserving interpolation by splines of arbitrary degree

ON THE NUMBER OF PRIMITIVE PYTHAGOREAN QUINTUPLES

Lecture 12: Discrete Laplacian

Description of the Force Method Procedure. Indeterminate Analysis Force Method 1. Force Method con t. Force Method con t

Obtaining U and G based on A above arrow line: )

BAYESIAN CURVE FITTING USING PIECEWISE POLYNOMIALS. Dariusz Biskup

Some modelling aspects for the Matlab implementation of MMA

Research Article Convergence Analysis of Alternating Direction Method of Multipliers for a Class of Separable Convex Programming

Modified parallel multisplitting iterative methods for non-hermitian positive definite systems

Mathematical Economics MEMF e ME. Filomena Garcia. Topic 2 Calculus

AN ANALYSIS OF A FRACTAL KINETICS CURVE OF SAVAGEAU

A Radon-Nikodym Theorem for Completely Positive Maps

Solutions for Homework #9

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

COS 521: Advanced Algorithms Game Theory and Linear Programming

An Optimal Bound for Sum of Square Roots of Special Type of Integers

Implicit scaling of linear least squares problems

Physics 3A: Linear Momentum. Physics 3A: Linear Momentum. Physics 3A: Linear Momentum. Physics 3A: Linear Momentum

CHAPTER 4d. ROOTS OF EQUATIONS

COMPLEX NUMBERS AND QUADRATIC EQUATIONS

36.1 Why is it important to be able to find roots to systems of equations? Up to this point, we have discussed how to find the solution to

Rectilinear motion. Lecture 2: Kinematics of Particles. External motion is known, find force. External forces are known, find motion

Numerical Solution of Nonlinear Singular Ordinary Differential Equations Arising in Biology Via Operational Matrix of Shifted Legendre Polynomials

A Hybrid Variational Iteration Method for Blasius Equation

A Simple Research of Divisor Graphs

Machine Learning. Support Vector Machines. Eric Xing , Fall Lecture 9, October 6, 2015

Endogenous timing in a mixed oligopoly consisting of a single public firm and foreign competitors. Abstract

4 Column generation (CG) 4.1 Basics of column generation. 4.2 Applying CG to the Cutting-Stock Problem. Basic Idea of column generation

Elastic Collisions. Definition: two point masses on which no external forces act collide without losing any energy.

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

Three Algorithms for Flexible Flow-shop Scheduling

Designing Fuzzy Time Series Model Using Generalized Wang s Method and Its application to Forecasting Interest Rate of Bank Indonesia Certificate

A Satisfaction Degree of Optimal Value for. Grey Linear Programming*

On a direct solver for linear least squares problems

Lecture 2 Solution of Nonlinear Equations ( Root Finding Problems )

International Journal of Mathematical Archive-9(3), 2018, Available online through ISSN

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

APPENDIX A Some Linear Algebra

By M. O'Neill,* I. G. Sinclairf and Francis J. Smith

ϕ -MEANS OF SOME BANACH SUBSPACES ON A BANACH ALGEBRA

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

Chapter One Mixture of Ideal Gases

Quantum Mechanics for Scientists and Engineers

Solution of Linear System of Equations and Matrix Inversion Gauss Seidel Iteration Method

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system

: Numerical Analysis Topic 2: Solution of Nonlinear Equations Lectures 5-11:

LECTURE :FACTOR ANALYSIS

Summary with Examples for Root finding Methods -Bisection -Newton Raphson -Secant

Fermi-Dirac statistics

Perfect Competition and the Nash Bargaining Solution

University of Washington Department of Chemistry Chemistry 452/456 Summer Quarter 2013

Approximate Technique for Solving Class of Fractional Variational Problems

total If no external forces act, the total linear momentum of the system is conserved. This occurs in collisions and explosions.

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

Linear Approximation with Regularization and Moving Least Squares

y new = M x old Feature Selection: Linear Transformations Constraint Optimization (insertion)

1 GSW Iterative Techniques for y = Ax

1 Review From Last Time

On the Eigenspectrum of the Gram Matrix and the Generalisation Error of Kernel PCA (Shawe-Taylor, et al. 2005) Ameet Talwalkar 02/13/07

Lecture 14: Bandits with Budget Constraints

On Syndrome Decoding of Punctured Reed-Solomon and Gabidulin Codes 1

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

Transcription:

Internatonal Journal o Engneerng & echnology IJE-IJENS Vol: No: 45 Polynoal Barrer Method or Solvng Lnear Prograng Probles Parwad Moengn, Meber, IAENG Abstract In ths wor, we study a class o polynoal ordereven barrer unctons or solvng lnear prograng probles wth the essental property that each eber s concave polynoal order-even when vewed as a uncton o the ultpler Under certan assupton on the paraeters o the barrer uncton, we gve a rule or choosng the paraeters o the barrer uncton We also gve an algorth or solvng ths proble Inde er lnear prograng, barrer ethod, polynoal order-even I INRODUCION he basc dea n barrer ethod s to elnate soe or all o the constrants and add to the obectve uncton a barrer ter whch prescrbes a hgh cost to neasble ponts (Wrght, ; Zboo, etc, 999) Assocated wth ths ethod s a paraeter, whch deternes the severty o the barrer and as a consequence the etent to whch the resultng unconstraned proble approates the orgnal proble (Kas, etc, 999; Parwad, etc, ) Parwad () proposed a penalty ethod or solvng lnear prograng probles In ths paper, we restrct attenton to the polynoal order-even barrer uncton Other barrer unctons wll appear elsewhere hs paper s concerned wth the study o the polynoal barrer uncton ethods or solvng lnear prograng It presents soe bacground o the ethods or the proble he paper also descrbes the theores and algorths or the ethods At the end o the paper we gve soe conclusons and coents to the ethods II SAEMEN OF HE PROBLEM hroughout ths paper we consder the proble aze subect to A = b, () n where A R n, c, R, and b R Wthout loss o generalty we assue that A has ull ran We assue that proble () has at least one easble soluton In order to solve ths proble, we can use Kararar s algorth and spel ethod (Durazz, ) Parwad ( and ) also has ntroduced a penalty ethod or solvng pral-dual lnear prograng probles But n ths paper we propose a polynoal barrer ethod as another alternatve ethod to solve lnear prograng proble () hs wor was granted and supported by the Faculty o Industral Engneerng, rsat Unversty, Jaarta Parwad Moengn s wth the Departent o Industral Engneerng, Faculty o Industral echnology, rsat Unversty, Jaarta 44, Indonesa (eal: parwad@hotalco, parwad@trsatacd) 9-7575 IJE-IJENS February IJENS III POLYNOMIAL BARRIER MEHOD For any scalar, we dene the polynoal barrer uncton B (, ) or proble (); B (, ) : R n R by B (, ) = c - ( A b ), () where s an even nuber Here, A and b denote the th row o atrces A and b, respectvely he postve even nuber s chosen to ensure that the uncton () s concave Hence, B (, ) has a global au We reer to as the barrer paraeter hs s the ordnary Lagrangan uncton n whch n the altered proble, the constrants replaced by ( A b ) A b ( =,,) are he barrer ters are ored ro a su o polynoal order o constraned volatons and the barrer paraeter deternes the aount o the barrer he otvaton behnd the ntroducton o the polynoal order- ter s that they ay lead to a representaton o an optal soluton o proble () n ters o a local unconstraned au Sply statng the denton () does not gve an adequate presson o the draatc eects o the posed barrer In order to understand the uncton stated by () we gve an eaple wth soe values or Soe graphs o B (, ) are gven n Fg 3 or the trval proble aze ( ) subect to, or whch the polynoal barrer uncton s gven by B (, ) = ( ) Fg, and 3 depct the one-densonal varaton o the barrer uncton o =, 4 and 6, or three values o barrer paraeter, that s =, = and = 6, respectvely he y-ordnates o these Fg represent B (, ) or =, = 4, = 6, respectvely Clearly, the soluton * = o ths eaple s copared wth the ponts whch aze B (, ), t s clear that * s a lt pont o the unconstraned azers o B (, ) as he ntutve otvaton or the barrer ethod s that we see unconstraned azers o B (, ) or value o ncreasng to nnty hus the ethod o solvng a sequence o azaton proble can be consdered

Internatonal Journal o Engneerng & echnology IJE-IJENS Vol: No: 46 Fg 3 he polynoal barrer uncton or = 6 () () (6) Fg he quadratc barrer uncton or = () () (6) Fg he polynoal barrer uncton or = 4 he polynoal barrer ethod or proble () conssts o solvng a sequence o probles o the or aze B(, ) subect to, (3) where s a barrer paraeter sequence satsyng or all, he ethod depends or ts success on sequentally ncreasng the barrer paraeter to nnty In ths paper, we concentrate on the eect o the barrer paraeter he ratonale or the barrer ethod s based on the act that when, then the ter ( A b ), when added to the obectve uncton, tends to nnty A b and equals zero A b or all n hus, we dene the uncton : R (, ] by c ( ) A b A b or all, orall he optal value o the orgnal proble () can be wrtten as * = sup c = sup ( ) Ab, = supl P(, ) (4) On the other hand, the barrer ethod deternes, va the sequence o nzatons (3), l supp(, ) (5) hus, n order or the barrer ethod to be successul, the orgnal proble should be such that the nterchange o l and sup n (4) and (5) s vald Beore we gve a guarantee or the valdty o the nterchange, we nvestgate soe propertes o the uncton dened n () Frst, we derve the concavty behavor o the polynoal barrer uncton dened by () s stated n the ollowng stated theore heore (Concavty) he polynoal barrer uncton B (, ) s concave n ts doan or every Proo It s straghtorward to prove concavty o B (, ) usng the concavty o theore s proven c and - ( A b ) hen the () () (6) he local and global behavor o the polynoal barrer uncton dened by () s stated n net the theore It s a consequence o heore 9-7575 IJE-IJENS February IJENS

Internatonal Journal o Engneerng & echnology IJE-IJENS Vol: No: 47 heore (Local and global behavor) Consder the uncton B (, ) whch s dened n () hen (a) B (, ) has a nte unconstraned azer n ts doan or every and the set M o unconstraned azers o B (, ) n ts doan s copact or every (b) Any unconstraned local azer o B (, ) n ts doan s also a global unconstraned azer o B (, ) Proo It ollows ro heore that the sooth uncton B (, ) acheves ts au n ts doan We then conclude that B (, ) has at least one nte unconstraned azer By heore B (, ) s concave, so any local azer s also a global azer hus, the set M o unconstraned azers o B (, ) s bounded and closed, because the au value o B (, ) s unque, and t ollows that M s copact heore has been vered As a consequence o heore we derve the onotoncty behavors o the obectve uncton proble (), the barrer ters n B (, ) and the au value o the polynoal barrer uncton B (, ) o do ths, or any we denote and (, ) B as a azer and au value o proble (3), respectvely heore 3 (Monotoncty) Let { } be an ncreasng sequence o postve barrer paraeters such that and hen (a) c s non-ncreasng (b) (c) A b ) B(, ) s non-ncreasng as ( s non-ncreasng Proo Let and denote the global azers o proble (3) or the barrer paraeters and, respectvely By denton o and as azers and, we have c ( A b c - ( A b ), (6a) c - ( A b c - + ( A b ), (6b) c - + ( A b c - + ( A b ) (6c) We ultply the rst nequalty (6a) wth the rato /, and add the nequalty to the nequalty (6c) we obtan Snce c part (a) s establshed, t ollows that c c c and o prove part (b) o the theore, we add the nequalty (6a) to the nequalty (6c) to get ( A b ) ( A b ), thus ( A as requred or part (b) b ) ( A Usng nequaltes (6a) and (6b), we obtan c ( A b + ( A b ) b ) Hence, part (c) o the theore s establshed c - We now gve the an theore concernng polynoal barrer ethod or lnear prograng proble () heore 4 (Convergence o polynoal barrer uncton) Let { } be an ncreasng sequence o postve barrer paraeters such that Denote (a) and and (, ) as B as n heore 3 hen A b as c as (b) * (c) B(, ) * Proo By denton o as c (, ) and (, ) B, we have B B(, ) or all (7) 9-7575 IJE-IJENS February IJENS

Internatonal Journal o Engneerng & echnology IJE-IJENS Vol: No: 48 Let * denotes the optal value o the proble () We have * = c sup = sup B(, ) Ab, B(, ) = c - Let be a lt pont o { } A b ( A b * By tang the lt neror n the above relaton and by usng the contnuty o c and A b, we obtan Snce c - l n ( A b * (8) ( A b ) and that we ust have and ( A b ), t ollows A b or all =,,, 9) otherwse the lt neror n the let-hand sde o (8) wll equal to + hs proves part (a) o the theore n Snce { R } s a closed set we also obtan that Hence, s easble, and * c () Usng (8)-(), we obtan Hence, and * - l n ( A b c - l n ( A b * l sn ( A b ) = * = c, whch proves that s a global au or proble () hs proves part (b) o the theore o prove part (c), we apply the results o parts (a) and (b), and then tang o the denton B(, ) Soe notes about ths theore wll be taen Frst, t assues that the proble (3) has a global au hs ay not be true the obectve uncton o the proble () s replaced by a nonlnear uncton However, ths stuaton ay be handled by choosng approprate value o We also note that the constrant o the proble (3) s portant to ensure that the lt pont o the sequence { } satses the condton Hence, by tang the supreu o the rght-hand sde o (7) over and A b, we obtan IV ALGORIHM he plcatons o these theores are rearably strong he polynoal barrer uncton has a nte unconstraned azer or every value o the barrer paraeter, and every lt pont o a azng sequence or the barrer uncton s a constraned azer o a proble () hus the algorth o solvng a sequence o azaton probles s suggested Based on heores 4, we orulate an algorth or solvng proble () Algorth Gven A = b,, the nuber o teraton N and n Choose R such that A = b and I the optalty condtons are satsed or proble () at, then stop 3 Copute (, ) azer B a B(, ) 4 Copute (, ) 5 I azer B a B(, ) and or = and the, the or B(, ) B(, ) or A b or = N; then stop Else + and go to step 4 V INERIORPOIN ALGORIHM hs secton revews the nterorpont algorth called Kararar s algorth or ndng a soluton o lnear prograng proble he step o ths algorth can be suarzed as ollows or any teraton (Parwad, ) Step Gven the current ntal tral soluton (,,, n ), set D Step Calculate Step 3 Calculate c p Pc~ ~ A AD 3 and ~ n c Dc ~ ~~ ~ P I A ( AA ) A and Step 4 Identy the negatve coponent o c p havng the largest absolute value, and set equal to ths absolute value hen calculate 9-7575 IJE-IJENS February IJENS

Internatonal Journal o Engneerng & echnology IJE-IJENS Vol: No: 49 c p ~, where s a selected constant between and Step 5 Calculate D as the tral soluton or the net teraton (step ) (I ths tral soluton s vrtually unchanged ro the precedng one, then the algorth has vrtually converged to an optal soluton, so stop) ~ VI NUMERICAL EXAMPLES hs secton we gve ve eaples to test the Algorth and we copare the results wth Kararar s algorth Consder the ollowng probles (Parwad, ), or =,, 3 Eaple 5 5 5 4 Maze subect to 3 7, Eaple 3 6,, or =, Maze subect to, 4 3,, or =, Eaple 5 7 3 Maze 3 subect to 3 6, Eaple 4 3 4 4 4 Maze subect to 3 6, Eaple 5,, or =, 8 3 3 Maze subect to 4, 3,, or =, able I reports the results o coputatonal or Algorth ( = ), Algorth ( = 4) and Kararar s Algorth he rst colun o able I contans the eaple nuber and the net two coluns o each algorth n ths table contan the total teratons and the tes (n seconds) o each algorth Proble No 3 4 5 ABEL I ALGORIHM ( = ), ALGORIHM ( = 4) AND KARMARKAR S ALGORIHM ES SAISICS Algorth ( = ) Algorth ( = 4) Kararar s Algorth otal Iteratons 8 5 e (Secs) 36 4 88 89 otal Iteratons 4 8 9 e (Secs) 99 779 8546 967 5357 otal Iteratons 6 9 9 8 e (Secs) 36 37 37 8 38 able I also shows that n ters o copleton te or the th nuercal eaples, the Algorth ( = ) s better than Algorth ( = 4), but both are stll less than the Kararar s algorth In ters o the nuber o teratons requred to coplete the ve nuercal eaples shows that Algorth ( = ) loos better than Kararar s algorth and Algorth ( = 4) VII CONCLUSION As entoned above, the paper has descrbed the barrer unctons wth barrer ters n polynoal order- or solvng proble () he algorths or these ethods are also gven n ths paper he Algorth s used to solve the proble () We also note the portant thng o these ethods whch do not need an nteror pont assupton REFERENCES [] Durazz, C () On the Newton nteror-pont ethod or nonlnear prograng probles Journal o Optzaton heory and Applcatons 4() pp 739 [] Kas, P, Klaszy, E, & Malyusz, L (999) Conve progra based on the Young nequalty and ts relaton to lnear prograng Central European Journal or Operatons Research 7(3) pp 934 [3] Parwad, M, Mohd, IB, & Ibrah, NA () Solvng Bounded LP Probles usng Moded Logarthc-eponental Functons In Purwanto (Ed), Proceedngs o the Natonal Conerence on Matheatcs and Its Applcatons n UM Malang (pp 35-4) Malang: Departent o Matheatcs UM Malang [4] Parwad, M () Polynoal penalty ethod or solvng lnear prograng probles IAENG Internatonal Journal o Appled Matheatcs 4(3), pp 67-7 9-7575 IJE-IJENS February IJENS

Internatonal Journal o Engneerng & echnology IJE-IJENS Vol: No: 5 [5] Parwad, M () Soe algorths or solvng pral-dual lnear prograng usng barrer ethods Internatonal Journal o Matheatcal Archve (), pp 8-4 [6] Parwad, M () Eponental ethods or conve prograng under lnear equaton constrants Internatonal Journal o Matheatcal Archve (), pp 8-9 [7] Wrght, SJ () On the convergence o the Newton/logbarrer ethod Matheatcal Prograng, 9(), 7 [8] Zboo, RA, Yadav, SP, & Mohan, C (999) Penalty ethod or an optal control proble wth equalty and nequalty constrants Indan Journal o Pure and Appled Matheatcs 3(), pp 4 9-7575 IJE-IJENS February IJENS