arxiv: v1 [math.oc] 1 Jun 2015
|
|
- Herbert Colin Watson
- 5 years ago
- Views:
Transcription
1 NEW PERFORMANCE GUARANEES FOR HE GREEDY MAXIMIZAION OF SUBMODULAR SE FUNCIONS JUSSI LAIILA AND AE MOILANEN arxiv: v1 [math.oc] 1 Jun 2015 Abstract. We present new tight performance guarantees for the greedy maximization of nondecreasing submodular set functions. Our main result first provides a performance guarantee in terms of the overlap of the optimal and greedy solutions. As a consequence we improve performance guarantees of Nemhauser, Wolsey and Fisher 1978) and Conforti and Cornuéjols 1984) for maximization over subsets, which are at least half the size of the problem domain. As a further application, we obtain a new tight performance guarantee in terms of the cardinality of the problem domain. Approximation and Cardinality and Convex optimization and Greedy algorithm and Maximization and Steepest ascent 1. Introduction Let X be a finite set, X = {x 1,...,x n }, and let be an integer such that 0 < n. We consider the cardinality-constrained maximization problem 1) max{fs): S =,S X}, wheref: 2 X R + is a submodular set function. Recall thatf is submodular if 2) fs)+fr) fs R)+fS R) for all S,R X; see, e.g., [16]. We further assume that f is nondecreasing; fs) fr) for all S R, and, without loss of generality, that f ) = 0. We consider the following well-known greedy algorithm for solving problem 1): Algorithm A. : Step 0: Set S 0 =. Go to Step 1. : Step t 1 t ): Select any x t S t 1 such that fs t 1 {x t }) = max{fs t 1 {x}): x X \S t i }. Set S t = S t 1 {x t }. Go to step t+1. : Step +1: Set S gr = S. Stop. Date: June 13, Mathematics Subject Classification. 90C59, 90C30, 68W25. Key words and phrases. approximation, cardinality, convex optimization, greedy algorithm, maximization, steepest ascent. J.L. and A.M were supported by the ERC-StG grant A.M. was supported by the Academy of Finland Centre of Excellence programme , grant , and the Finnish Natural Heritage Services Metsähallitus). 1
2 2 JUSSI LAIILA AND AE MOILANEN Algorithm A has been extensively studied in the literature. By the Rado- Edmonds theorem [9] or [4]), it finds an optimal solution when f is an additive set function, i.e., when 2) holds with an equality for all S,R X. Nemhauser, Wolsey and Fisher [16] see also [3], [15]) gave the following performance guarantee for Algorithm A for nonadditive functions f: 3) fs opt ) ) =: G NWF ), where S opt is an optimal solution to problem 1). Conforti and Cornuéjols [4] improved 3) to fs opt ) α ) ) 4) =: G CC,α), α for α 0, 1], where α [0, 1] is the total curvature { } fx) fx \{x}) α = max 1 : x X,f{x}) f ). f{x}) f ) It is known that α 0,1] if and only if f is nonadditive [4]. Clearly, G NW ) = G CC,1) and since G CC,α) 1 as α 0 +, 4) can be viewed as a generalization of the Rado-Edmonds theorem. he above performance guarantees further satisfy the estimates } G CC,α) max {G NWF ), 1 e α 1 e 1, α for all α and. he guarantees 3) and 4) are tight for suitable choices of parameters and α. For example, for all α 0,1] and 1 there is a problem of the type 1) and the corresponding greedy solution S gr such that = G CC,α)fS opt ) [4]. Submodular optimization has played a central role in operations research and combinatorial optimization [8]. By now it has applications in various fields, including computer science [12], economics [18] and, more recently, ecology [14], [7], [1]). Problem 1) and the above performance guarantees have been extended to various other settings and problem structures, related to, for example, matroid [6], [4]) and knapsack [17], [13]) constraints, continuous algorithms [20], [2]), nonmonotone functions [5], nonsubmodular functions [19] and supermodular minimization [10], [11]). o authors knowledge, previously presented performance guarantees either do not depend on or n, or, like 3) and 4), they are decreasing in. However, when = n, it is clear that S opt = S gr, so the greedy algorithm returns the optimal solution. his suggests that any performance guarantee should in fact be improving when approaches and is close enough to n. We show that this is indeed the case. More generally, we show that increasing degree of overlap m = S opt S gr between the sets S opt and S gr improves the performance guarantees. While in applications the overlap m may not be known, we can give this quantity a useful lower bound. In fact, when > n/2, we have m 2 n > 0. Our results thus have particular relevance for optimization problems where the maximum is sought over subsets of cardinality larger than n/2.
3 PERFORMANCE GUARANEES SUBMODULAR MAXIMIZAION 3 Let G,α,m) = 1 α 1 1 αm ) 1 α ) ) m and G,α,n) = G,α,max{0,2 n}). Our main result is the following. heorem 1. Let α 0,1], let 1 n and let S opt and S gr be an optimal, repectively a greedy, solution to problem 1) and let m = S opt S gr. hen 5) G,α,m) G,α,n). fs opt ) Moreover, these bounds are tight in the following sense: for every α 0,1] and numbers n and such that 1 n, there is a problem of the type 1) and its greedy solution S gr such that max{0,2 n} = S opt S gr and fs opt ) = G,α,n). We postpone the proof of heorem 1 to Section 2. Remark 2. heorem 1 strictly improves 4) and provides further examples of cases where the performance guarantee equals one, i.e., generalizations of the Rado-Edmonds theorem. Indeed, for all and n such that > n/2, we have G,α,n) > G CC,α). For = n, we get Gn,α,n) = 1. Note that, by 4), lim α 0 + G,α,n) = 1. Moreover, in the case m =, we again get G,α,) = 1. Using heorem 1, one can derive other new performance guarantees for the greedy algorithm. As an example of independent interest, we present the following performance guarantee in terms of n only. Corollary 3. Let α 0,1], 1 n, and let S opt and S gr be an optimal, repectively a greedy, solution to problem 1). hen ) n fs opt ) α 2 α n α ) ) n/2 6), α n where x denotes the largest integer not greater than x. he left-hand estimate is tight in the following sense: for every α 0,1] and n 2, there is a problem of the type 1) and its greedy solution S gr such that fs opt ) = 1 α 1 ) n 1 α 2 n. 2 Proof. If n is an odd integer, it is easy to check that the minimum of G,α,n) over all integers with 0 n is Gn 1)/2,α,n). Moreover, when treated as a continuous function of, G,α,n) attains its minimum at = n/2. ogether with heorem 1 this yields 6). ightness of the lefthand inequality in 6) follows from heorem 1 with the choice = n 2.
4 4 JUSSI LAIILA AND AE MOILANEN 2. Proof of heorem 1 In this section we present a proof of heorem 1. We first prove 5). Note that the right-hand inequality in 5) follows directly from m = S opt S gr max{0,2 n} and the fact that G,α,m) is increasing in m. We next prove the left-hand inequality in 5). We may assume that 0 < m <. Indeed, if m =, then S gr = S opt and the claim is trivial. If m = 0, the claim follows from 4). Let S 0 = and S t = {y 1,...,y t } X be the successive sets chosen by the greedy algorithm for t = 1,...,, so that S 0 S 1 S. Let a t = fs t) fs t 1 ), fs opt ) for t = 1,...,. Because f is nondecreasing, each a t is nonnegative and fs opt ) = a i. Let J = S gr S opt. Let 1 j 1 j m denote the indices for which J = {y j1,...y jm }. Denote j 0 = 0 and j m+1 =. By Lemma 5.1 of [4], we obtain the inequalities 1 α a i + a i + S t 1 S opt )a t, {i: y i S t 1 \S opt} for t = 1,...,. Consequently, {i: y i S t 1 S opt} fs opt ) BJ ), where J = {j 1,...,j m } and, foru {1,...,n}, BU) denotes the minimum of the linear program 7) minimize s.t. b i α b i + i V t 1 \U b t 0, i U V t 1 b i + U V t 1 )b t 1, for t = 1,...,, where V t = {1,...,t}. We next apply the proof of [4, Lemma 5.2], which implies the following two facts: i) If / U, then BU) B{ U V 1,...,}), ii) B{ l,...,}) B{ l+1,...,}), for all 1 l 1. In particular, if j m <, then BJ ) B{ m,...,}) B{ m+ 1,...,}). Moreover, if j m =, then BJ ) = BJ \ {}), so that using i), BJ ) B{ m+1,...,}). Consequently, fs opt ) b i,
5 PERFORMANCE GUARANEES SUBMODULAR MAXIMIZAION 5 where b = b 1,...,b ) is an optimal solution to the problem 7) with U = { m+1,...,}. By the weak duality theorem, we get that fs opt ) c i, where c = c 1,...,c ) is an optimal solution to the dual problem 8) maximize c i s.t. c t +α i=t+1 c i 1, 2 m+1 t)c t + c i 0, i=t+1 1 t m c i 1, m+1 t i = 1,...,. Define the vector c = c 1,...,c ) by { 1 ) c t = 1 αm 1 α m t, ) 1 t m,, m+1 t. m 2 m+1 t)2 m t) An induction argument shows that c is a feasible solution of problem 8) satisfying the first constraints with an equality), so that Moreover, it is easy to compute that and m c i = 1 α fs opt ) c i. 1 αm i= m+1 ) 1 1 α ) ) m c i = m, which, after summation, yield the desired performance guarantee fs opt ) G,α,m). We next show the tightness of G,α,n) by modifying the proof of [4, heorem 5.4]. Let 1 < n be any positive numbers. Pick any number 1 r n/2, let X = {a 1,...,a r,b 1,...,b n r } and let f: 2 X R + be the set function f{a i1,...,a is,b j1,...,b ju }) = u+ 1 αu ) s 1 α ) ik 1, k=1
6 6 JUSSI LAIILA AND AE MOILANEN defined for all subsets {a i1,...,a is,b j1,...,b ju } X. hen f ) = 0. For any S = {a i1,...,a is,b j1,...,b ju } X, where s < r and u n r, and a i X \S, we have fs {a i }) fs) = 1 αu ) 1 α ) i 1 0. For any S = {a i1,...,a is,b j1,...,b ju } X, where s r and u < n r, and b j X \S, we have fs {b j }) fs) = 1 α s k=1 1 α ) ik 1 0. By recalling that a set function g: 2 X R + is submodular if and only if gs {x}) gs) gr {x}) gr), for all S R X and x X \R e.g., [16]), these inequalities show that f is submodular and nondecreasing. Moreover, { } fx) fx \{x}) max 1 : x X,f{x}) 0 f{x}) = 1 fx) fx \{a i}) = α, f{a i }) for any 1 i r, so f has total curvature α. Consider next the case where > n/2. Set r = n, so that r < n/2 < and n r =. It is easy to verify that S opt = {b 1,...,b } is an optimal solution to problem 1) with fs opt ) =. Since f{a 1 }) = f{b j }) = 1, for any 1 j, the greedy algorithm can choose the element a 1 at the first iteration. Assume next that the greedy algorithm has chosen S t 1 = {a 1,...,a t 1 } for some t n. Using the fact l k=1 it is easy to see that 1 α ) k 1 = 1 1 α ) ) l α fs t 1 {a t }) = fs t 1 {b j }) = t 1 α ) i 1, so the greedy algorithm can choose a t at the tth iteration. We therefore can have S gr = {a 1,...a n,b 1,...,b 2 n }. his solution has the value = 1 1 αm ) 1 α ) ) n. α he claim follows because m = S opt S gr = 2 n, whence we obtain n = m. he proof of case n/2 is easier, so we omit its proof.
7 PERFORMANCE GUARANEES SUBMODULAR MAXIMIZAION 7 References [1] M. Bordewich, C. Semple: Budgeted nature reserve selection with diversity feature loss and arbitrary split systems. Journal of Mathematical Biology 64, ) [2] G. Calinescu, C. Chekuri, M. Pál and J. Vondrák: Maximizing a submodular set function subject to a matroid constraint. SIAM Journal on Computing 40, ) [3] G. Cornuéjols, M.L. Fisher, G.L. Nemhauser: Location of bank accounts to optimize float: an analytic study of exact and approximate algorithms. Management Science 23, ) [4] M. Conforti, G. Cornuéjols: Submodular set functions, matroids and the greedy algorithm: tight worst-case bounds and some generalizations of the Rado-Edmonds theorem. Discrete Applied Mathematics 7, ) [5] U. Feige, V.S. Mirrokni, J. Vondrák: Maximizing non-monotone submodular functions. SIAM Journal of Computing 40, ) [6] M.L. Fisher, G.L. Nemhauser, L.A. Wolsey: An analysis of approximations for maximizing submodular set functions II. Mathematical Programming Study 8, ) [7] D. Golovin, A. Krause, B. Gardner, S.J. Converse, S. Morey. Dynamic resource allocation in conservation planning. In: Proceeding of the wenty-fifth AAAI Conference on Artificial Intelligence, pp ) [8] P.R. Goundan, A.S. Schulz: Revisiting the greedy approach to submodular set function maximization. Working Paper, Massachusetts Institute of echnology ) [9] J. Edmonds: Matroids and the greedy algorithm. Mathematical Programming 1, ) [10] V. Il ev: An approximation guarantee of the greedy descent algorithm for minimizing a supermodular set function. Discrete Applied Mathematics 114, ) [11] V. Il ev, N. Linker: Performance guarantees of a greedy algorithm for minimizing a supermodular set function on comatroid. European Journal of Operational Research 171, ) [12] A. Krause, D. Golovin. Submodular function maximization. In: L. Bordeaux, Y. Hamadi, P. Kohli eds.) ractability: Practical Approaches to Hard Problems, pp Cambridge University Press, Cambridge 2014) [13] A. Kulik, H. Shachnai,. amir: Approximations for monotone and non-monotone submodular maximization with knapsack constraints. Mathematics of Operations Research 38, ) [14] A. Moilanen: Landscape Zonation, benefit functions and target-based planning: unifying reserve selection strategies. Biological Conservation 134, ) [15] G.L. Nemhauser, L.A. Wolsey: Best algorithms for approximating the maximum of a submodular set function. Mathematics of Operations Research 3, ) [16] G.L. Nemhauser, L.A. Wolsey, M.L. Fisher: An analysis of approximations for maximizing submodular set functions I. Mathematical Programming 14, ) [17] M. Sviridenko: A note on maximizing a submodular set function subject to a knapsack constraint. Operations Research Letters 32, ) [18] D.M. opkis. Supermodularity and Complementarity. Princeton University Press, Princeton 1998) [19] Z. Wang, B. Moran, X. Wang, Q. Pan: Approximation for maximizing monotone non-decreasing set functions with a greedy method. Journal of Combinatorial Optimization, in press. doi: /s [20] J. Vondrák: Submodularity and curvature: the optimal algorithm. RIMS Kôkyûroku Bessatsu B23, ) Department of Biosciences, P.O. Box 65, FI University of Helsinki, Finland address: jussi.laitila@helsinki.fi address: atte.moilanen@helsinki.fi
Submodularity and curvature: the optimal algorithm
RIMS Kôkyûroku Bessatsu Bx (200x), 000 000 Submodularity and curvature: the optimal algorithm By Jan Vondrák Abstract Let (X, I) be a matroid and let f : 2 X R + be a monotone submodular function. The
More informationRevisiting the Greedy Approach to Submodular Set Function Maximization
Submitted to manuscript Revisiting the Greedy Approach to Submodular Set Function Maximization Pranava R. Goundan Analytics Operations Engineering, pranava@alum.mit.edu Andreas S. Schulz MIT Sloan School
More informationConstrained Maximization of Non-Monotone Submodular Functions
Constrained Maximization of Non-Monotone Submodular Functions Anupam Gupta Aaron Roth September 15, 2009 Abstract The problem of constrained submodular maximization has long been studied, with near-optimal
More informationMATHEMATICAL ENGINEERING TECHNICAL REPORTS. On the Pipage Rounding Algorithm for Submodular Function Maximization A View from Discrete Convex Analysis
MATHEMATICAL ENGINEERING TECHNICAL REPORTS On the Pipage Rounding Algorithm for Submodular Function Maximization A View from Discrete Convex Analysis Akiyoshi SHIOURA (Communicated by Kazuo MUROTA) METR
More information9. Submodular function optimization
Submodular function maximization 9-9. Submodular function optimization Submodular function maximization Greedy algorithm for monotone case Influence maximization Greedy algorithm for non-monotone case
More information1 Submodular functions
CS 369P: Polyhedral techniques in combinatorial optimization Instructor: Jan Vondrák Lecture date: November 16, 2010 1 Submodular functions We have already encountered submodular functions. Let s recall
More informationMulti-level Facility Location as the Maximization of a Submodular Set Function
Multi-level Facility Location as the Maximization of a Submodular Set Function Camilo Ortiz-Astorquiza a, Ivan Contreras a, Gilbert Laporte b a Concordia University and Interuniversity Research Centre
More informationMaximization of Submodular Set Functions
Northeastern University Department of Electrical and Computer Engineering Maximization of Submodular Set Functions Biomedical Signal Processing, Imaging, Reasoning, and Learning BSPIRAL) Group Author:
More informationMonotone Submodular Maximization over a Matroid
Monotone Submodular Maximization over a Matroid Yuval Filmus January 31, 2013 Abstract In this talk, we survey some recent results on monotone submodular maximization over a matroid. The survey does not
More informationarxiv: v2 [cs.ds] 28 Aug 2014
Constrained Monotone Function Maximization and the Supermodular Degree Moran Feldman Rani Izsak arxiv:1407.6328v2 [cs.ds] 28 Aug 2014 August 29, 2014 Abstract The problem of maximizing a constrained monotone
More information1 Maximizing a Submodular Function
6.883 Learning with Combinatorial Structure Notes for Lecture 16 Author: Arpit Agarwal 1 Maximizing a Submodular Function In the last lecture we looked at maximization of a monotone submodular function,
More informationMaximizing Submodular Set Functions Subject to Multiple Linear Constraints
Maximizing Submodular Set Functions Subject to Multiple Linear Constraints Ariel Kulik Hadas Shachnai Tami Tamir Abstract The concept of submodularity plays a vital role in combinatorial optimization.
More informationOptimization of Submodular Functions Tutorial - lecture I
Optimization of Submodular Functions Tutorial - lecture I Jan Vondrák 1 1 IBM Almaden Research Center San Jose, CA Jan Vondrák (IBM Almaden) Submodular Optimization Tutorial 1 / 1 Lecture I: outline 1
More informationMaximum Coverage over a Matroid Constraint
Maximum Coverage over a Matroid Constraint Yuval Filmus Justin Ward University of Toronto STACS 2012, Paris Max Coverage: History Location of bank accounts: Cornuejols, Fisher & Nemhauser 1977, Management
More informationSymmetry and hardness of submodular maximization problems
Symmetry and hardness of submodular maximization problems Jan Vondrák 1 1 Department of Mathematics Princeton University Jan Vondrák (Princeton University) Symmetry and hardness 1 / 25 Submodularity Definition
More informationSubmodular Functions and Their Applications
Submodular Functions and Their Applications Jan Vondrák IBM Almaden Research Center San Jose, CA SIAM Discrete Math conference, Minneapolis, MN June 204 Jan Vondrák (IBM Almaden) Submodular Functions and
More informationMaximizing a Submodular Function with Viability Constraints
Maximizing a Submodular Function with Viability Constraints Wolfgang Dvořák, Monika Henzinger, and David P. Williamson 2 Universität Wien, Fakultät für Informatik, Währingerstraße 29, A-090 Vienna, Austria
More informationPareto Optimization for Subset Selection with Dynamic Cost Constraints
Pareto Optimization for Subset Selection with Dynamic Cost Constraints Vahid Roostapour 1, Aneta Neumann 1, Frank Neumann 1, Tobias Friedrich 2 1 Optimisation and Logistics, School of Computer Science,
More informationA (k + 3)/2-approximation algorithm for monotone submodular k-set packing and general k-exchange systems
A (k + 3)/-approximation algorithm for monotone submodular k-set packing and general k-exchange systems Justin Ward Department of Computer Science, University of Toronto Toronto, Canada jward@cs.toronto.edu
More informationMaximizing Non-monotone Submodular Set Functions Subject to Different Constraints: Combined Algorithms
Maximizing Non-monotone Submodular Set Functions Subject to Different Constraints: Combined Algorithms Salman Fadaei MohammadAmin Fazli MohammadAli Safari August 31, 2011 We study the problem of maximizing
More informationApproximation Algorithms for Maximum. Coverage and Max Cut with Given Sizes of. Parts? A. A. Ageev and M. I. Sviridenko
Approximation Algorithms for Maximum Coverage and Max Cut with Given Sizes of Parts? A. A. Ageev and M. I. Sviridenko Sobolev Institute of Mathematics pr. Koptyuga 4, 630090, Novosibirsk, Russia fageev,svirg@math.nsc.ru
More informationStreaming Algorithms for Submodular Function Maximization
Streaming Algorithms for Submodular Function Maximization Chandra Chekuri Shalmoli Gupta Kent Quanrud University of Illinois at Urbana-Champaign October 6, 2015 Submodular functions f : 2 N R if S T N,
More informationarxiv: v2 [cs.lg] 10 Aug 2017
Slack and Margin Rescaling as Convex Extensions of Supermodular Functions Matthew B. Blaschko arxiv:1606.05918v2 [cs.lg] 10 Aug 2017 Center for Processing Speech & Images Departement Elektrotechniek, KU
More informationSubmodular Functions: Extensions, Distributions, and Algorithms A Survey
Submodular Functions: Extensions, Distributions, and Algorithms A Survey Shaddin Dughmi PhD Qualifying Exam Report, Department of Computer Science, Stanford University Exam Committee: Serge Plotkin, Tim
More informationApproximating Submodular Functions. Nick Harvey University of British Columbia
Approximating Submodular Functions Nick Harvey University of British Columbia Approximating Submodular Functions Part 1 Nick Harvey University of British Columbia Department of Computer Science July 11th,
More informationOptimizing Ratio of Monotone Set Functions
Optimizing Ratio of Monotone Set Functions Chao Qian, Jing-Cheng Shi 2, Yang Yu 2, Ke Tang, Zhi-Hua Zhou 2 UBRI, School of Computer Science and Technology, University of Science and Technology of China,
More informationA Note on the Budgeted Maximization of Submodular Functions
A Note on the udgeted Maximization of Submodular Functions Andreas Krause June 2005 CMU-CALD-05-103 Carlos Guestrin School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213 Abstract Many
More informationStructured Robust Submodular Maximization: Offline and Online Algorithms
Structured Robust Submodular Maximization: Offline and Online Algorithms Nima Anari Nika Haghtalab Joseph (Seffi) Naor Sebastian Pokutta Mohit Singh Alfredo Torrico Abstract Constrained submodular function
More informationSubmodular and Linear Maximization with Knapsack Constraints. Ariel Kulik
Submodular and Linear Maximization with Knapsack Constraints Ariel Kulik Submodular and Linear Maximization with Knapsack Constraints Research Thesis Submitted in partial fulfillment of the requirements
More informationOn Lagrangian Relaxation and Subset Selection Problems
On agrangian Relaxation and Subset Selection Problems (Extended Abstract) Ariel Kulik Hadas Shachnai Abstract We prove a general result demonstrating the power of agrangian relaxation in solving constrained
More informationRandomized Pipage Rounding for Matroid Polytopes and Applications
Randomized Pipage Rounding for Matroid Polytopes and Applications Chandra Chekuri Jan Vondrák September 23, 2009 Abstract We present concentration bounds for linear functions of random variables arising
More informationCSE541 Class 22. Jeremy Buhler. November 22, Today: how to generalize some well-known approximation results
CSE541 Class 22 Jeremy Buhler November 22, 2016 Today: how to generalize some well-known approximation results 1 Intuition: Behavior of Functions Consider a real-valued function gz) on integers or reals).
More informationThe Power of Local Search: Maximum Coverage over a Matroid
The Power of Local Search: Maximum Coverage over a Matroid Yuval Filmus 1,2 and Justin Ward 1 1 Department of Computer Science, University of Toronto {yuvalf,jward}@cs.toronto.edu 2 Supported by NSERC
More informationSubmodular Functions Properties Algorithms Machine Learning
Submodular Functions Properties Algorithms Machine Learning Rémi Gilleron Inria Lille - Nord Europe & LIFL & Univ Lille Jan. 12 revised Aug. 14 Rémi Gilleron (Mostrare) Submodular Functions Jan. 12 revised
More informationFiltered Search for Submodular Maximization with Controllable Approximation Bounds
Filtered Search for Submodular Maximization with Controllable Approximation Bounds Wenlin Chen, Yixin Chen, Kilian Q. Weinberger Washington University in St. Louis One Brookings Drive, St. Louis, MO 63130
More informationSubmodular Secretary Problem and Extensions
Submodular Secretary Problem and Extensions MohammadHossein Bateni MohammadTaghi Hajiaghayi Morteza Zadimoghaddam Abstract Online auction is the essence of many modern markets, particularly networked markets,
More informationc 2014 Society for Industrial and Applied Mathematics
SIAM J. COMPUT. Vol. 43, No. 2, pp. 514 542 c 2014 Society for Industrial and Applied Mathematics MONOTONE SUBMODULAR MAXIMIZATION OVER A MATROID VIA NON-OBLIVIOUS LOCAL SEARCH YUVAL FILMUS AND JUSTIN
More informationDisjoint Bases in a Polymatroid
Disjoint Bases in a Polymatroid Gruia Călinescu Chandra Chekuri Jan Vondrák May 26, 2008 Abstract Let f : 2 N Z + be a polymatroid (an integer-valued non-decreasing submodular set function with f( ) =
More informationGreed is Still Good: Maximizing Monotone Submodular+Supermodular (BP) Functions
Greed is Still Good: Maximizing Monotone Submodular+Supermodular (BP) Functions Wenruo Bai Jeffrey A. Bilmes 2 Abstract We analyze the performance of the greedy algorithm, and also a discrete semi-gradient
More informationSubmodular function optimization: A brief tutorial (Part I)
Submodular function optimization: A brief tutorial (Part I) Donglei Du (ddu@unb.ca) Faculty of Business Administration, University of New Brunswick, NB Canada Fredericton E3B 9Y2 Workshop on Combinatorial
More informationOptimal Approximation for the Submodular Welfare Problem in the Value Oracle Model
Optimal Approximation for the Submodular Welfare Problem in the Value Oracle Model Jan Vondrák Department of Mathematics Princeton University Princeton, NJ 08544, USA jvondrak@gmail.com ABSTRACT In the
More informationRobust and MaxMin Optimization under Matroid and Knapsack Uncertainty Sets
Robust and MaxMin Optimization under Matroid and Knapsack Uncertainty Sets ANUPAM GUPTA, Carnegie Mellon University VISWANATH NAGARAJAN, University of Michigan R. RAVI, Carnegie Mellon University Consider
More informationThe Power of Local Search: Maximum Coverage over a Matroid
The Power of Local Search: Maximum Coverage over a Matroid Yuval Filmus,2 and Justin Ward Department of Computer Science, University of Toronto {yuvalf,jward}@cs.toronto.edu 2 Supported by NSERC Abstract
More informationDependent Randomized Rounding for Matroid Polytopes and Applications
Dependent Randomized Rounding for Matroid Polytopes and Applications Chandra Chekuri Jan Vondrák Rico Zenklusen November 4, 2009 Abstract Motivated by several applications, we consider the problem of randomly
More informationarxiv: v1 [cs.ds] 15 Jul 2018
Online Submodular Maximization: Beating 1/2 Made Simple Niv Buchbinder Moran Feldman Mohit Garg July 17, 2018 arxiv:1807.05529v1 [cs.ds] 15 Jul 2018 Abstract The Submodular Welfare Maximization problem
More informationSubmodular Functions, Optimization, and Applications to Machine Learning
Submodular Functions, Optimization, and Applications to Machine Learning Spring Quarter, Lecture 12 http://www.ee.washington.edu/people/faculty/bilmes/classes/ee596b_spring_2016/ Prof. Jeff Bilmes University
More informationCS599: Convex and Combinatorial Optimization Fall 2013 Lecture 24: Introduction to Submodular Functions. Instructor: Shaddin Dughmi
CS599: Convex and Combinatorial Optimization Fall 2013 Lecture 24: Introduction to Submodular Functions Instructor: Shaddin Dughmi Announcements Introduction We saw how matroids form a class of feasible
More informationAn Introduction to Submodular Functions and Optimization. Maurice Queyranne University of British Columbia, and IMA Visitor (Fall 2002)
An Introduction to Submodular Functions and Optimization Maurice Queyranne University of British Columbia, and IMA Visitor (Fall 2002) IMA, November 4, 2002 1. Submodular set functions Generalization to
More informationOn Subset Selection with General Cost Constraints
On Subset Selection with General Cost Constraints Chao Qian, Jing-Cheng Shi 2, Yang Yu 2, Ke Tang UBRI, School of Computer Science and Technology, University of Science and Technology of China, Hefei 23002,
More informationarxiv: v1 [cs.ds] 14 Dec 2017
SIAM J. COMPUT. Vol. xx, No. x, pp. x x c xxxx Society for Industrial and Applied Mathematics ONLINE SUBMODULAR WELFARE MAXIMIZATION: GREEDY BEATS 1 2 IN RANDOM ORDER NITISH KORULA, VAHAB MIRROKNI, AND
More informationEECS 495: Combinatorial Optimization Lecture Manolis, Nima Mechanism Design with Rounding
EECS 495: Combinatorial Optimization Lecture Manolis, Nima Mechanism Design with Rounding Motivation Make a social choice that (approximately) maximizes the social welfare subject to the economic constraints
More information1 Continuous extensions of submodular functions
CS 369P: Polyhedral techniques in combinatorial optimization Instructor: Jan Vondrák Lecture date: November 18, 010 1 Continuous extensions of submodular functions Submodular functions are functions assigning
More informationDeciding Emptiness of the Gomory-Chvátal Closure is NP-Complete, Even for a Rational Polyhedron Containing No Integer Point
Deciding Emptiness of the Gomory-Chvátal Closure is NP-Complete, Even for a Rational Polyhedron Containing No Integer Point Gérard Cornuéjols 1 and Yanjun Li 2 1 Tepper School of Business, Carnegie Mellon
More informationPolyhedral Results for A Class of Cardinality Constrained Submodular Minimization Problems
Polyhedral Results for A Class of Cardinality Constrained Submodular Minimization Problems Shabbir Ahmed and Jiajin Yu Georgia Institute of Technology A Motivating Problem [n]: Set of candidate investment
More informationApproximation Algorithms for Online Weighted Rank Function Maximization under Matroid Constraints
Approximation Algorithms for Online Weighted Rank Function Maximization under Matroid Constraints Niv Buchbinder 1, Joseph (Seffi) Naor 2, R. Ravi 3, and Mohit Singh 4 1 Computer Science Dept., Open University
More informationNetwork Design and Game Theory Spring 2008 Lecture 2
Network Design and Game Theory Spring 2008 Lecture 2 Instructor: Mohammad T. Hajiaghayi Scribe: Imdadullah Khan February 04, 2008 MAXIMUM COVERAGE In this lecture we review Maximum Coverage and Unique
More informationSubmodular Functions, Optimization, and Applications to Machine Learning
Submodular Functions, Optimization, and Applications to Machine Learning Spring Quarter, Lecture 13 http://www.ee.washington.edu/people/faculty/bilmes/classes/ee563_spring_2018/ Prof. Jeff Bilmes University
More informationA necessary and sufficient condition for the existence of a spanning tree with specified vertices having large degrees
A necessary and sufficient condition for the existence of a spanning tree with specified vertices having large degrees Yoshimi Egawa Department of Mathematical Information Science, Tokyo University of
More informationThe Simplex Method for Some Special Problems
The Simplex Method for Some Special Problems S. Zhang Department of Econometrics University of Groningen P.O. Box 800 9700 AV Groningen The Netherlands September 4, 1991 Abstract In this paper we discuss
More informationSubmodular Maximization by Simulated Annealing
Submodular Maximization by Simulated Annealing Shayan Oveis Gharan Jan Vondrák Abstract We consider the problem of maximizing a nonnegative (possibly non-monotone) submodular set function with or without
More informationA DIGRAPH FOURIER TRANSFORM WITH SPREAD FREQUENCY COMPONENTS
A DIGRAPH FOURIER TRANSFORM WITH SPREAD FREQUENCY COMPONENTS Rasoul Shafipour, Ali Khodabakhsh, Gonzalo Mateos, and Evdokia Nikolova Dept. of Electrical and Computer Engineering, University of Rochester,
More informationn-step mingling inequalities: new facets for the mixed-integer knapsack set
Math. Program., Ser. A (2012) 132:79 98 DOI 10.1007/s10107-010-0382-6 FULL LENGTH PAPER n-step mingling inequalities: new facets for the mixed-integer knapsack set Alper Atamtürk Kiavash Kianfar Received:
More informationMore Approximation Algorithms
CS 473: Algorithms, Spring 2018 More Approximation Algorithms Lecture 25 April 26, 2018 Most slides are courtesy Prof. Chekuri Ruta (UIUC) CS473 1 Spring 2018 1 / 28 Formal definition of approximation
More informationEfficiency, Fairness and Competitiveness in Nash Bargaining Games
Efficiency, Fairness and Competitiveness in Nash Bargaining Games Deeparnab Chakrabarty, Gagan Goel 2, Vijay V. Vazirani 2, Lei Wang 2 and Changyuan Yu 3 Department of Combinatorics and Optimization, University
More information6.254 : Game Theory with Engineering Applications Lecture 7: Supermodular Games
6.254 : Game Theory with Engineering Applications Lecture 7: Asu Ozdaglar MIT February 25, 2010 1 Introduction Outline Uniqueness of a Pure Nash Equilibrium for Continuous Games Reading: Rosen J.B., Existence
More informationDual Consistent Systems of Linear Inequalities and Cardinality Constrained Polytopes. Satoru FUJISHIGE and Jens MASSBERG.
RIMS-1734 Dual Consistent Systems of Linear Inequalities and Cardinality Constrained Polytopes By Satoru FUJISHIGE and Jens MASSBERG December 2011 RESEARCH INSTITUTE FOR MATHEMATICAL SCIENCES KYOTO UNIVERSITY,
More informationLearning symmetric non-monotone submodular functions
Learning symmetric non-monotone submodular functions Maria-Florina Balcan Georgia Institute of Technology ninamf@cc.gatech.edu Nicholas J. A. Harvey University of British Columbia nickhar@cs.ubc.ca Satoru
More informationReduction of Ultrametric Minimum Cost Spanning Tree Games to Cost Allocation Games on Rooted Trees. Kazutoshi ANDO and Shinji KATO.
RIMS-1674 Reduction of Ultrametric Minimum Cost Spanning Tree Games to Cost Allocation Games on Rooted Trees By Kazutoshi ANDO and Shinji KATO June 2009 RESEARCH INSTITUTE FOR MATHEMATICAL SCIENCES KYOTO
More informationFRACTIONAL PACKING OF T-JOINS. 1. Introduction
FRACTIONAL PACKING OF T-JOINS FRANCISCO BARAHONA Abstract Given a graph with nonnegative capacities on its edges, it is well known that the capacity of a minimum T -cut is equal to the value of a maximum
More informationStochastic Submodular Cover with Limited Adaptivity
Stochastic Submodular Cover with Limited Adaptivity Arpit Agarwal Sepehr Assadi Sanjeev Khanna Abstract In the submodular cover problem, we are given a non-negative monotone submodular function f over
More informationApproximation Algorithms for Stochastic Boolean Function Evaluation and Stochastic Submodular Set Cover
Approximation Algorithms for Stochastic Boolean Function Evaluation and Stochastic Submodular Set Cover Amol Deshpande University of Maryland amol@cs.umd.edu Lisa Hellerstein Polytechnic Institute of NYU
More informationNON-MONOTONICITY HEIGHT OF PM FUNCTIONS ON INTERVAL. 1. Introduction
Acta Math. Univ. Comenianae Vol. LXXXVI, 2 (2017), pp. 287 297 287 NON-MONOTONICITY HEIGHT OF PM FUNCTIONS ON INTERVAL PINGPING ZHANG Abstract. Using the piecewise monotone property, we give a full description
More information1 Overview. 2 Multilinear Extension. AM 221: Advanced Optimization Spring 2016
AM 22: Advanced Optimization Spring 26 Prof. Yaron Singer Lecture 24 April 25th Overview The goal of today s lecture is to see how the multilinear extension of a submodular function that we introduced
More informationSubmodular Functions, Optimization, and Applications to Machine Learning
Submodular Functions, Optimization, and Applications to Machine Learning Spring Quarter, Lecture 14 http://www.ee.washington.edu/people/faculty/bilmes/classes/ee596b_spring_2016/ Prof. Jeff Bilmes University
More informationNETS 412: Algorithmic Game Theory March 28 and 30, Lecture Approximation in Mechanism Design. X(v) = arg max v i (a)
NETS 412: Algorithmic Game Theory March 28 and 30, 2017 Lecture 16+17 Lecturer: Aaron Roth Scribe: Aaron Roth Approximation in Mechanism Design In the last lecture, we asked how far we can go beyond the
More informationinforms DOI /moor.xxxx.xxxx
MATHEMATICS OF OPERATIONS RESEARCH Vol. 00, No. 0, Xxxxxx 20xx, pp. xxx xxx ISSN 0364-765X EISSN 1526-5471 xx 0000 0xxx informs DOI 10.1287/moor.xxxx.xxxx c 20xx INFORMS Polynomial-Time Approximation Schemes
More informationA Faster Strongly Polynomial Time Algorithm for Submodular Function Minimization
A Faster Strongly Polynomial Time Algorithm for Submodular Function Minimization James B. Orlin Sloan School of Management, MIT Cambridge, MA 02139 jorlin@mit.edu Abstract. We consider the problem of minimizing
More informationDual fitting approximation for Set Cover, and Primal Dual approximation for Set Cover
duality 1 Dual fitting approximation for Set Cover, and Primal Dual approximation for Set Cover Guy Kortsarz duality 2 The set cover problem with uniform costs Input: A universe U and a collection of subsets
More informationRealization of set functions as cut functions of graphs and hypergraphs
Discrete Mathematics 226 (2001) 199 210 www.elsevier.com/locate/disc Realization of set functions as cut functions of graphs and hypergraphs Satoru Fujishige a;, Sachin B. Patkar b a Division of Systems
More informationAll-or-Nothing Generalized Assignment with Application to Scheduling Advertising Campaigns
All-or-Nothing Generalized Assignment with Application to Scheduling Advertising Campaigns Ron Adany 1, Moran Feldman 2, Elad Haramaty 2, Rohit Khandekar 3, Baruch Schieber 4, Roy Schwartz 2, Hadas Shachnai
More informationOn Unconstrained Quasi-Submodular Function Optimization
Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence On Unconstrained Quasi-Submodular Function Optimization Jincheng Mei, Kang Zhao and Bao-Liang Lu* Center for Brain-Like Computing
More informationDownloaded 01/02/18 to Redistribution subject to SIAM license or copyright; see
SIAM J. COMPUT. Vol. 40, No. 6, pp. 1740 1766 c 2011 Society for Industrial and Applied Mathematics MAXIMIZING A MONOTONE SUBMODULAR FUNCTION SUBJECT TO A MATROID CONSTRAINT GRUIA CALINESCU, CHANDRA CHEKURI,
More informationBetter bounds for k-partitions of graphs
Better bounds for -partitions of graphs Baogang Xu School of Mathematics, Nanjing Normal University 1 Wenyuan Road, Yadong New District, Nanjing, 1006, China Email: baogxu@njnu.edu.cn Xingxing Yu School
More informationStochastic Submodular Cover with Limited Adaptivity
Stochastic Submodular Cover with Limited Adaptivity Arpit Agarwal Sepehr Assadi Sanjeev Khanna University of Pennsylvania {aarpit,sassadi,sanjeev}@cis.upenn.edu arxiv:1810.13351v1 [cs.ds] 31 Oct 2018 Abstract
More informationA Unified Continuous Greedy Algorithm for Submodular Maximization
A Unified Continuous Greedy Algorithm for Sumodular Maximization Moran Feldman Technion Joseph (Seffi) Naor Technion Roy Schwartz Technion Astract The study of cominatorial prolems with a sumodular ojective
More informationAn Alternative Proof of Primitivity of Indecomposable Nonnegative Matrices with a Positive Trace
An Alternative Proof of Primitivity of Indecomposable Nonnegative Matrices with a Positive Trace Takao Fujimoto Abstract. This research memorandum is aimed at presenting an alternative proof to a well
More informationCalculus and Maximization I
Division of the Humanities and Social Sciences Calculus and Maximization I KC Border Fall 2000 1 Maxima and Minima A function f : X R attains a global maximum or absolute maximum over X at x X if f(x )
More information1 Matroid intersection
CS 369P: Polyhedral techniques in combinatorial optimization Instructor: Jan Vondrák Lecture date: October 21st, 2010 Scribe: Bernd Bandemer 1 Matroid intersection Given two matroids M 1 = (E, I 1 ) and
More informationThe master equality polyhedron with multiple rows
The master equality polyhedron with multiple rows Sanjeeb Dash Ricardo Fukasawa IBM Research February 17, 2009 Oktay Günlük Abstract The master equality polyhedron (MEP) is a canonical set that generalizes
More informationDiscrete Newton s Algorithm for Parametric Submodular Function Minimization
Discrete Newton s Algorithm for Parametric Submodular Function Minimization Michel X. Goemans, Swati Gupta, and Patrick Jaillet Massachusetts Institute of Technology, USA, goemans@math.mit.edu, swatig@mit.edu,
More informationGuaranteeing Solution Quality for SAS Optimization Problems by being Greedy
Guaranteeing Solution Quality for SAS Optimization Problems by being Greedy Ulrike Stege University of Victoria ustege@uvic.ca Preliminary results of this in: S. Balasubramanian, R.J. Desmarais, H.A. Müller,
More informationMinimization of Symmetric Submodular Functions under Hereditary Constraints
Minimization of Symmetric Submodular Functions under Hereditary Constraints J.A. Soto (joint work with M. Goemans) DIM, Univ. de Chile April 4th, 2012 1 of 21 Outline Background Minimal Minimizers and
More informationThe master equality polyhedron with multiple rows
The master equality polyhedron with multiple rows Sanjeeb Dash IBM Research sanjeebd@us.ibm.com Ricardo Fukasawa University of Waterloo rfukasaw@math.uwaterloo.ca September 16, 2010 Oktay Günlük IBM Research
More informationarxiv: v1 [cs.lg] 3 Jul 2014
Online Submodular Maximization under a Matroid Constraint with Application to Learning Assignments arxiv:1407.1082v1 [cs.lg] 3 Jul 2014 Daniel Golovin California Institute of Technology Andreas Krause
More informationPM functions, their characteristic intervals and iterative roots
ANNALES POLONICI MATHEMATICI LXV.2(1997) PM functions, their characteristic intervals and iterative roots by Weinian Zhang (Chengdu) Abstract. The concept of characteristic interval for piecewise monotone
More informationApplications of Submodular Functions in Speech and NLP
Applications of Submodular Functions in Speech and NLP Jeff Bilmes Department of Electrical Engineering University of Washington, Seattle http://ssli.ee.washington.edu/~bilmes June 27, 2011 J. Bilmes Applications
More informationThe Power of Randomization: Distributed Submodular Maximization on Massive Datasets
The Power of Randomization: Distributed Submodular Maximization on Massive Datasets Rafael Barbosa Department of Computer Science and DIMAP, University of Warwick Alina Ene Department of Computer Science
More informationSubmodular Maximization with Cardinality Constraints
Submodular Maximization with Cardinality Constraints Niv Buchbinder Moran Feldman Joseph (Seffi) Naor Roy Schwartz Abstract We consider the problem of maximizing a (non-monotone) submodular function subject
More informationDistributed Submodular Maximization
Journal of Machine Learning Research 17 (2016) 1-44 Submitted 10/14; Published 12/16 Distributed Submodular Maximization Baharan Mirzasoleiman Department of Computer Science ETH Zurich Universitaetstrasse
More information