Maximum Coverage over a Matroid Constraint

Size: px
Start display at page:

Download "Maximum Coverage over a Matroid Constraint"

Transcription

1 Maximum Coverage over a Matroid Constraint Yuval Filmus Justin Ward University of Toronto STACS 2012, Paris

2 Max Coverage: History Location of bank accounts: Cornuejols, Fisher & Nemhauser 1977, Management Science Official definition: Hochbaum & Pathria 1998, Naval Research Quarterly Lower bound: Feige 1998 Extended to Submodular Max. over a Matroid: Calinescu, Chekuri, Pál & Vondrák 2008 (with help from Ageev & Sviridenko 2004) We consider Maximum Coverage over a Matroid.

3 Maximum Coverage... Input: Universe U with weights w 0 Sets S i U Number n Goal: Find n sets S i that maximize w(s i1 S in )

4 Maximum Coverage... Input: Universe U with weights w 0 Sets S i U Number n Goal: Find n sets S i that maximize w(s i1 S in ) Greedy algorithm gives 1 1/e approximation. Feige ( 98): optimal unless P=NP.

5 ... over a Matroid Input: Goal: Universe U with weights w 0 Sets S i U Matroid m over set of all S i Find collection of sets S m that maximizes w( S)

6 What is a matroid? Invented by Whitney (1935). Definition: Matroid A collection of independent sets s.t. 1 A independent, B A B independent. 2 A, B independent, A > B there exists some x A \ B s.t. B x is independent.

7 What is a matroid? Invented by Whitney (1935). Definition: Matroid A collection of independent sets s.t. 1 A independent, B A B independent. 2 A, B independent, A > B there exists some x A \ B s.t. B x is independent. Partition Matroid F 1,..., F n disjoint sets. Independent set: 1 set from each F i.

8 Max Coverage over a Partition Matroid Input: Goal: Universe U with weights w 0 n families F i 2 U Find collection of sets S i F i that maximizes w(s 1 S n )

9 Some algorithms Greedy 1 Pick set S 1 of maximal weight. 2 Pick set S 2 of maximal additional weight. 3 And so on.

10 Some algorithms Greedy 1 Pick set S 1 of maximal weight. 2 Pick set S 2 of maximal additional weight. 3 And so on. Local Search 1 Start at some solution S 1,..., S n. 2 Replace some S i with some S that improves i total weight. 3 Repeat Step 2 while possible.

11 Failure of greedy Bad instance for Greedy A 1 = {x, ɛ} B = {x} A 2 = {y} F 1 F 2 w(x) = w(y) w(ɛ) Greedy chooses {A 1, B}, optimal is {A 2, B}. Resulting approximation ratio is only 1/2.

12 Failure of greedy Bad instance for Greedy A 1 = {x, ɛ} B = {x} A 2 = {y} F 1 F 2 w(x) = w(y) w(ɛ) Greedy chooses {A 1, B}, optimal is {A 2, B}. Resulting approximation ratio is only 1/2. Local search finds optimal solution.

13 Maybe local search? Bad instance for Local Search A 1 = {x, ɛ x } B 1 = {x} A 2 = {y} B 2 = {ɛ y } F 1 F 2 w(x) = w(y) w(ɛ x ) = w(ɛ y ) {A 1, B 2 } is local maximum. Optimum is {A 2, B 1 }.

14 Maybe local search? Bad instance for Local Search A 1 = {x, ɛ x } B 1 = {x} A 2 = {y} B 2 = {ɛ y } F 1 F 2 w(x) = w(y) w(ɛ x ) = w(ɛ y ) {A 1, B 2 } is local maximum. Optimum is {A 2, B 1 }. k-local search (on SBO matroids) has approx ratio k 1 2n k 1.

15 Local search fantasy A 1 = {x, ɛ x } B 1 = {x} A 2 = {y} B 2 = {ɛ y } Fantasy algorithm

16 Local search fantasy A 1 = {x, ɛ x } B 1 = {x} A 2 = {y} B 2 = {ɛ y } x 1 ɛ x 1 Greedy stage

17 Local search fantasy A 1 = {x, ɛ x } B 1 = {x} A 2 = {y} B 2 = {ɛ y } x 1 ɛ x 1 ɛ y 1 Greedy stage

18 Local search fantasy A 1 = {x, ɛ x } B 1 = {x} A 2 = {y} B 2 = {ɛ y } x 2 ɛ x 1 Local search stage We lose ɛ y but gain second appearance of x.

19 Local search fantasy A 1 = {x, ɛ x } B 1 = {x} A 2 = {y} B 2 = {ɛ y } x 1 y 1 Local search stage

20 Local search fantasy A 1 = {x, ɛ x } B 1 = {x} A 2 = {y} B 2 = {ɛ y } x 1 y 1 Done found optimal solution

21 Non-oblivious local search Idea Give more weight to duplicate elements. Use local search with auxiliary objective function (Alimonti 94; Khanna, Motwani, Sudan & U. Vazirani 98): f(s) = α #u (S)w(u). u U Change is considered beneficial if it improves f(s). Oblivious local search: α 0 = 0, α i = 1 for i 1.

22 Choosing the weights Consider what happens at termination. Setup: S 1,..., S n : local maximum. O 1,..., O n : optimal solution. Local optimality implies nf(s 1,..., S n ) n f(s 1,..., S i 1, O i, S i+1,..., S n ) i=1

23 Choosing the weights Parametrize situation using w l,c,g = total weight of elements which belong to l + c sets S i g + c sets O i c of the indices in common Each element of the universe occurs in some w l,c,g.

24 Choosing the weights Local optimality implies nf(s 1,..., S n ) n f(s 1,..., S i 1, O i, S i+1,..., S n ) i=1 In terms of w l,c,g, this is [l(α l+c α l+c 1 ) + g(α l+c α l+c+1 )] w l,c,g 0 l,c,g

25 Choosing the weights Local optimality translates to [(l + g)α l+c lα l+c 1 gα l+c+1 ] w l,c,g 0 l,c,g Also, w(o 1,..., O n ) = w(s 1,..., S n ) = g+c 1 l+c 1 w l,c,g w l,c,g

26 Choosing the weights Approximation ratio θ is given by s.t. max min w(s 1,..., S n ) α i w l,c,g w(o 1,..., O n ) = 1 nf(s 1,..., S n ) w l,c,g 0 n f(s 1,..., S i 1, O i, S i+1,..., S n ) i=1

27 Choosing the weights Approximation ratio θ is given by s.t. max min α i w l,c,g g+c 1 l+c 1 w l,c,g = 1 w l,c,g [(l + g)α l+c lα l+c 1 gα l+c+1 ] w l,c,g 0 l,c,g w l,c,g 0

28 Choosing the weights Dualize the inner LP: max θ α i,θ s.t. l(α l α l 1 ) 1 gα 1 θ (l + g)α l+c lα l+c 1 gα l+c+1 1 θ (c 1 or l,g 1)

29 Optimal weights Solution to LP is θ = 1 1/e and α 0 = 0, α 1 = θ, α l+1 = (l + 1)α l lα l 1 (1 θ). Sequence monotone concave, α l = 1 e log l + O(1).

30 Optimal weights Solution to LP is θ = 1 1/e and α 0 = 0, α 1 = θ, α l+1 = (l + 1)α l lα l 1 (1 θ). Sequence monotone concave, α l = 1 e For rank n, can replace e with log l + O(1). e [n] = n 1 k=0 1 k! + 1 (n 1) (n 1)! e + 1 (n + 2)!.

31 Optimal weights (normalized)

32 Recap Our Algorithm 1 Start with some solution S 1,..., S n. 2 Repeat while possible: Replace some S i with some S improving i f(s 1,..., S n ) = α #u (S 1,...,S n )w(u). u S 1 S n Main Theorem At the end of the algorithm, ( w(s 1,..., S n ) 1 1 ) w(o 1,..., O n ). e

33 Further work Our framework generalizes. Montone submodular maximization over a matroid Optimal combinatorial algorithm. Continuous algorithm by Calinescu, Chekuri, Pál and Vondrák (STOC 2008).

34 Further work Our framework generalizes. Montone submodular maximization over a matroid Optimal combinatorial algorithm.... with curvature constraint Optimal combinatorial algorithm. NP-hardness result (extending Feige 1998). Vondrák 2010: extended continuous algorithm, gave lower bound in oracle model.

35 Further work Our framework generalizes. Montone submodular maximization over a matroid Optimal combinatorial algorithm.... with curvature constraint Optimal combinatorial algorithm. NP-hardness result. Submodular maximization over bases of matroid 1 2/e combinatorial algorithm. Best prior result: 1/4 (Vondrák, FOCS 2009).

36 Thank you Questions?

The Power of Local Search: Maximum Coverage over a Matroid

The Power of Local Search: Maximum Coverage over a Matroid The Power of Local Search: Maximum Coverage over a Matroid Yuval Filmus 1,2 and Justin Ward 1 1 Department of Computer Science, University of Toronto {yuvalf,jward}@cs.toronto.edu 2 Supported by NSERC

More information

The Power of Local Search: Maximum Coverage over a Matroid

The Power of Local Search: Maximum Coverage over a Matroid The Power of Local Search: Maximum Coverage over a Matroid Yuval Filmus,2 and Justin Ward Department of Computer Science, University of Toronto {yuvalf,jward}@cs.toronto.edu 2 Supported by NSERC Abstract

More information

Monotone Submodular Maximization over a Matroid

Monotone Submodular Maximization over a Matroid Monotone Submodular Maximization over a Matroid Yuval Filmus January 31, 2013 Abstract In this talk, we survey some recent results on monotone submodular maximization over a matroid. The survey does not

More information

A (k + 3)/2-approximation algorithm for monotone submodular k-set packing and general k-exchange systems

A (k + 3)/2-approximation algorithm for monotone submodular k-set packing and general k-exchange systems A (k + 3)/-approximation algorithm for monotone submodular k-set packing and general k-exchange systems Justin Ward Department of Computer Science, University of Toronto Toronto, Canada jward@cs.toronto.edu

More information

c 2014 Society for Industrial and Applied Mathematics

c 2014 Society for Industrial and Applied Mathematics SIAM J. COMPUT. Vol. 43, No. 2, pp. 514 542 c 2014 Society for Industrial and Applied Mathematics MONOTONE SUBMODULAR MAXIMIZATION OVER A MATROID VIA NON-OBLIVIOUS LOCAL SEARCH YUVAL FILMUS AND JUSTIN

More information

Symmetry and hardness of submodular maximization problems

Symmetry and hardness of submodular maximization problems Symmetry and hardness of submodular maximization problems Jan Vondrák 1 1 Department of Mathematics Princeton University Jan Vondrák (Princeton University) Symmetry and hardness 1 / 25 Submodularity Definition

More information

1 Overview. 2 Multilinear Extension. AM 221: Advanced Optimization Spring 2016

1 Overview. 2 Multilinear Extension. AM 221: Advanced Optimization Spring 2016 AM 22: Advanced Optimization Spring 26 Prof. Yaron Singer Lecture 24 April 25th Overview The goal of today s lecture is to see how the multilinear extension of a submodular function that we introduced

More information

1 Submodular functions

1 Submodular functions CS 369P: Polyhedral techniques in combinatorial optimization Instructor: Jan Vondrák Lecture date: November 16, 2010 1 Submodular functions We have already encountered submodular functions. Let s recall

More information

Constrained Maximization of Non-Monotone Submodular Functions

Constrained Maximization of Non-Monotone Submodular Functions Constrained Maximization of Non-Monotone Submodular Functions Anupam Gupta Aaron Roth September 15, 2009 Abstract The problem of constrained submodular maximization has long been studied, with near-optimal

More information

Oblivious and Non-Oblivious Local Search for Combinatorial Optimization. Justin Ward

Oblivious and Non-Oblivious Local Search for Combinatorial Optimization. Justin Ward Oblivious and Non-Oblivious Local Search for Combinatorial Optimization by Justin Ward A thesis submitted in conformity with the requirements for the degree of Doctor of Philosophy Graduate Department

More information

Approximating Submodular Functions. Nick Harvey University of British Columbia

Approximating Submodular Functions. Nick Harvey University of British Columbia Approximating Submodular Functions Nick Harvey University of British Columbia Approximating Submodular Functions Part 1 Nick Harvey University of British Columbia Department of Computer Science July 11th,

More information

Optimization of Submodular Functions Tutorial - lecture I

Optimization of Submodular Functions Tutorial - lecture I Optimization of Submodular Functions Tutorial - lecture I Jan Vondrák 1 1 IBM Almaden Research Center San Jose, CA Jan Vondrák (IBM Almaden) Submodular Optimization Tutorial 1 / 1 Lecture I: outline 1

More information

Submodularity and curvature: the optimal algorithm

Submodularity and curvature: the optimal algorithm RIMS Kôkyûroku Bessatsu Bx (200x), 000 000 Submodularity and curvature: the optimal algorithm By Jan Vondrák Abstract Let (X, I) be a matroid and let f : 2 X R + be a monotone submodular function. The

More information

Revisiting the Greedy Approach to Submodular Set Function Maximization

Revisiting the Greedy Approach to Submodular Set Function Maximization Submitted to manuscript Revisiting the Greedy Approach to Submodular Set Function Maximization Pranava R. Goundan Analytics Operations Engineering, pranava@alum.mit.edu Andreas S. Schulz MIT Sloan School

More information

Submodular Functions and Their Applications

Submodular Functions and Their Applications Submodular Functions and Their Applications Jan Vondrák IBM Almaden Research Center San Jose, CA SIAM Discrete Math conference, Minneapolis, MN June 204 Jan Vondrák (IBM Almaden) Submodular Functions and

More information

Maximizing Submodular Set Functions Subject to Multiple Linear Constraints

Maximizing Submodular Set Functions Subject to Multiple Linear Constraints Maximizing Submodular Set Functions Subject to Multiple Linear Constraints Ariel Kulik Hadas Shachnai Tami Tamir Abstract The concept of submodularity plays a vital role in combinatorial optimization.

More information

From query complexity to computational complexity (for optimization of submodular functions)

From query complexity to computational complexity (for optimization of submodular functions) From query complexity to computational complexity (for optimization of submodular functions) Shahar Dobzinski 1 Jan Vondrák 2 1 Cornell University Ithaca, NY 2 IBM Almaden Research Center San Jose, CA

More information

1 Maximizing a Submodular Function

1 Maximizing a Submodular Function 6.883 Learning with Combinatorial Structure Notes for Lecture 16 Author: Arpit Agarwal 1 Maximizing a Submodular Function In the last lecture we looked at maximization of a monotone submodular function,

More information

Streaming Algorithms for Submodular Function Maximization

Streaming Algorithms for Submodular Function Maximization Streaming Algorithms for Submodular Function Maximization Chandra Chekuri Shalmoli Gupta Kent Quanrud University of Illinois at Urbana-Champaign October 6, 2015 Submodular functions f : 2 N R if S T N,

More information

arxiv: v1 [math.oc] 1 Jun 2015

arxiv: v1 [math.oc] 1 Jun 2015 NEW PERFORMANCE GUARANEES FOR HE GREEDY MAXIMIZAION OF SUBMODULAR SE FUNCIONS JUSSI LAIILA AND AE MOILANEN arxiv:1506.00423v1 [math.oc] 1 Jun 2015 Abstract. We present new tight performance guarantees

More information

Randomized Pipage Rounding for Matroid Polytopes and Applications

Randomized Pipage Rounding for Matroid Polytopes and Applications Randomized Pipage Rounding for Matroid Polytopes and Applications Chandra Chekuri Jan Vondrák September 23, 2009 Abstract We present concentration bounds for linear functions of random variables arising

More information

More Approximation Algorithms

More Approximation Algorithms CS 473: Algorithms, Spring 2018 More Approximation Algorithms Lecture 25 April 26, 2018 Most slides are courtesy Prof. Chekuri Ruta (UIUC) CS473 1 Spring 2018 1 / 28 Formal definition of approximation

More information

Optimal Approximation for the Submodular Welfare Problem in the Value Oracle Model

Optimal Approximation for the Submodular Welfare Problem in the Value Oracle Model Optimal Approximation for the Submodular Welfare Problem in the Value Oracle Model Jan Vondrák Department of Mathematics Princeton University Princeton, NJ 08544, USA jvondrak@gmail.com ABSTRACT In the

More information

Welfare Maximization with Friends-of-Friends Network Externalities

Welfare Maximization with Friends-of-Friends Network Externalities Welfare Maximization with Friends-of-Friends Network Externalities Extended version of a talk at STACS 2015, Munich Wolfgang Dvořák 1 joint work with: Sayan Bhattacharya 2, Monika Henzinger 1, Martin Starnberger

More information

Disjoint Bases in a Polymatroid

Disjoint Bases in a Polymatroid Disjoint Bases in a Polymatroid Gruia Călinescu Chandra Chekuri Jan Vondrák May 26, 2008 Abstract Let f : 2 N Z + be a polymatroid (an integer-valued non-decreasing submodular set function with f( ) =

More information

Downloaded 01/02/18 to Redistribution subject to SIAM license or copyright; see

Downloaded 01/02/18 to Redistribution subject to SIAM license or copyright; see SIAM J. COMPUT. Vol. 40, No. 6, pp. 1740 1766 c 2011 Society for Industrial and Applied Mathematics MAXIMIZING A MONOTONE SUBMODULAR FUNCTION SUBJECT TO A MATROID CONSTRAINT GRUIA CALINESCU, CHANDRA CHEKURI,

More information

arxiv: v1 [cs.ds] 15 Jul 2018

arxiv: v1 [cs.ds] 15 Jul 2018 Online Submodular Maximization: Beating 1/2 Made Simple Niv Buchbinder Moran Feldman Mohit Garg July 17, 2018 arxiv:1807.05529v1 [cs.ds] 15 Jul 2018 Abstract The Submodular Welfare Maximization problem

More information

CSE541 Class 22. Jeremy Buhler. November 22, Today: how to generalize some well-known approximation results

CSE541 Class 22. Jeremy Buhler. November 22, Today: how to generalize some well-known approximation results CSE541 Class 22 Jeremy Buhler November 22, 2016 Today: how to generalize some well-known approximation results 1 Intuition: Behavior of Functions Consider a real-valued function gz) on integers or reals).

More information

Approximation Algorithms for Online Weighted Rank Function Maximization under Matroid Constraints

Approximation Algorithms for Online Weighted Rank Function Maximization under Matroid Constraints Approximation Algorithms for Online Weighted Rank Function Maximization under Matroid Constraints Niv Buchbinder 1, Joseph (Seffi) Naor 2, R. Ravi 3, and Mohit Singh 4 1 Computer Science Dept., Open University

More information

arxiv: v2 [cs.ds] 28 Aug 2014

arxiv: v2 [cs.ds] 28 Aug 2014 Constrained Monotone Function Maximization and the Supermodular Degree Moran Feldman Rani Izsak arxiv:1407.6328v2 [cs.ds] 28 Aug 2014 August 29, 2014 Abstract The problem of maximizing a constrained monotone

More information

Knapsack Cover Subject to a Matroid Constraint

Knapsack Cover Subject to a Matroid Constraint Knapsack Cover Subject to a Matroid Constraint Venkatesan T. Chakaravarthy 1, Anamitra Roy Choudhury 2, Sivaramakrishnan R. Natarajan 3, and Sambuddha Roy 4 1 IBM Research, New Delhi, India, vechakra@in.ibm.com

More information

MATHEMATICAL ENGINEERING TECHNICAL REPORTS. On the Pipage Rounding Algorithm for Submodular Function Maximization A View from Discrete Convex Analysis

MATHEMATICAL ENGINEERING TECHNICAL REPORTS. On the Pipage Rounding Algorithm for Submodular Function Maximization A View from Discrete Convex Analysis MATHEMATICAL ENGINEERING TECHNICAL REPORTS On the Pipage Rounding Algorithm for Submodular Function Maximization A View from Discrete Convex Analysis Akiyoshi SHIOURA (Communicated by Kazuo MUROTA) METR

More information

Approximation Algorithms for Maximum. Coverage and Max Cut with Given Sizes of. Parts? A. A. Ageev and M. I. Sviridenko

Approximation Algorithms for Maximum. Coverage and Max Cut with Given Sizes of. Parts? A. A. Ageev and M. I. Sviridenko Approximation Algorithms for Maximum Coverage and Max Cut with Given Sizes of Parts? A. A. Ageev and M. I. Sviridenko Sobolev Institute of Mathematics pr. Koptyuga 4, 630090, Novosibirsk, Russia fageev,svirg@math.nsc.ru

More information

9. Submodular function optimization

9. Submodular function optimization Submodular function maximization 9-9. Submodular function optimization Submodular function maximization Greedy algorithm for monotone case Influence maximization Greedy algorithm for non-monotone case

More information

Submodular Functions: Extensions, Distributions, and Algorithms A Survey

Submodular Functions: Extensions, Distributions, and Algorithms A Survey Submodular Functions: Extensions, Distributions, and Algorithms A Survey Shaddin Dughmi PhD Qualifying Exam Report, Department of Computer Science, Stanford University Exam Committee: Serge Plotkin, Tim

More information

Submodular and Linear Maximization with Knapsack Constraints. Ariel Kulik

Submodular and Linear Maximization with Knapsack Constraints. Ariel Kulik Submodular and Linear Maximization with Knapsack Constraints Ariel Kulik Submodular and Linear Maximization with Knapsack Constraints Research Thesis Submitted in partial fulfillment of the requirements

More information

Submodular Functions, Optimization, and Applications to Machine Learning

Submodular Functions, Optimization, and Applications to Machine Learning Submodular Functions, Optimization, and Applications to Machine Learning Spring Quarter, Lecture 12 http://www.ee.washington.edu/people/faculty/bilmes/classes/ee596b_spring_2016/ Prof. Jeff Bilmes University

More information

Maximizing Non-monotone Submodular Set Functions Subject to Different Constraints: Combined Algorithms

Maximizing Non-monotone Submodular Set Functions Subject to Different Constraints: Combined Algorithms Maximizing Non-monotone Submodular Set Functions Subject to Different Constraints: Combined Algorithms Salman Fadaei MohammadAmin Fazli MohammadAli Safari August 31, 2011 We study the problem of maximizing

More information

Multi-level Facility Location as the Maximization of a Submodular Set Function

Multi-level Facility Location as the Maximization of a Submodular Set Function Multi-level Facility Location as the Maximization of a Submodular Set Function Camilo Ortiz-Astorquiza a, Ivan Contreras a, Gilbert Laporte b a Concordia University and Interuniversity Research Centre

More information

Research Statement. Yuval Filmus. November 6, 2014

Research Statement. Yuval Filmus. November 6, 2014 Research Statement Yuval Filmus November 6, 2014 1 Summary My research is split between two areas, combinatorics and theoretical computer science. My interest in combinatorics lies in two related fields:

More information

Dependent Randomized Rounding for Matroid Polytopes and Applications

Dependent Randomized Rounding for Matroid Polytopes and Applications Dependent Randomized Rounding for Matroid Polytopes and Applications Chandra Chekuri Jan Vondrák Rico Zenklusen November 4, 2009 Abstract Motivated by several applications, we consider the problem of randomly

More information

EECS 495: Combinatorial Optimization Lecture Manolis, Nima Mechanism Design with Rounding

EECS 495: Combinatorial Optimization Lecture Manolis, Nima Mechanism Design with Rounding EECS 495: Combinatorial Optimization Lecture Manolis, Nima Mechanism Design with Rounding Motivation Make a social choice that (approximately) maximizes the social welfare subject to the economic constraints

More information

Structured Robust Submodular Maximization: Offline and Online Algorithms

Structured Robust Submodular Maximization: Offline and Online Algorithms Structured Robust Submodular Maximization: Offline and Online Algorithms Nima Anari Nika Haghtalab Joseph (Seffi) Naor Sebastian Pokutta Mohit Singh Alfredo Torrico Abstract Constrained submodular function

More information

Network Design and Game Theory Spring 2008 Lecture 2

Network Design and Game Theory Spring 2008 Lecture 2 Network Design and Game Theory Spring 2008 Lecture 2 Instructor: Mohammad T. Hajiaghayi Scribe: Imdadullah Khan February 04, 2008 MAXIMUM COVERAGE In this lecture we review Maximum Coverage and Unique

More information

Submodular function optimization: A brief tutorial (Part I)

Submodular function optimization: A brief tutorial (Part I) Submodular function optimization: A brief tutorial (Part I) Donglei Du (ddu@unb.ca) Faculty of Business Administration, University of New Brunswick, NB Canada Fredericton E3B 9Y2 Workshop on Combinatorial

More information

The Steiner k-cut Problem

The Steiner k-cut Problem The Steiner k-cut Problem Chandra Chekuri Sudipto Guha Joseph (Seffi) Naor September 23, 2005 Abstract We consider the Steiner k-cut problem which generalizes both the k-cut problem and the multiway cut

More information

Submodular Optimization in the MapReduce Model

Submodular Optimization in the MapReduce Model Submodular Optimization in the MapReduce Model Paul Liu and Jan Vondrak Stanford University, USA {paulliu, jvondrak}@stanford.edu Abstract Submodular optimization has received significant attention in

More information

Notes for Lecture 2. Statement of the PCP Theorem and Constraint Satisfaction

Notes for Lecture 2. Statement of the PCP Theorem and Constraint Satisfaction U.C. Berkeley Handout N2 CS294: PCP and Hardness of Approximation January 23, 2006 Professor Luca Trevisan Scribe: Luca Trevisan Notes for Lecture 2 These notes are based on my survey paper [5]. L.T. Statement

More information

Communication Complexity of Combinatorial Auctions with Submodular Valuations

Communication Complexity of Combinatorial Auctions with Submodular Valuations Communication Complexity of Combinatorial Auctions with Submodular Valuations Shahar Dobzinski Weizmann Institute of Science Rehovot, Israel dobzin@gmail.com Jan Vondrák IBM Almaden Research Center San

More information

Query and Computational Complexity of Combinatorial Auctions

Query and Computational Complexity of Combinatorial Auctions Query and Computational Complexity of Combinatorial Auctions Jan Vondrák IBM Almaden Research Center San Jose, CA Algorithmic Frontiers, EPFL, June 2012 Jan Vondrák (IBM Almaden) Combinatorial auctions

More information

Approximation Basics

Approximation Basics Approximation Basics, Concepts, and Examples Xiaofeng Gao Department of Computer Science and Engineering Shanghai Jiao Tong University, P.R.China Fall 2012 Special thanks is given to Dr. Guoqiang Li for

More information

The Polymatroid Steiner Problems

The Polymatroid Steiner Problems The Polymatroid Steiner Problems G. Calinescu 1 and A. Zelikovsky 2 1 Department of Computer Science, Illinois Institute of Technology, Chicago, IL 60616. E-mail: calinesc@iit.edu. 2 Department of Computer

More information

Applications of Submodular Functions in Speech and NLP

Applications of Submodular Functions in Speech and NLP Applications of Submodular Functions in Speech and NLP Jeff Bilmes Department of Electrical Engineering University of Washington, Seattle http://ssli.ee.washington.edu/~bilmes June 27, 2011 J. Bilmes Applications

More information

Maximizing a Submodular Function with Viability Constraints

Maximizing a Submodular Function with Viability Constraints Maximizing a Submodular Function with Viability Constraints Wolfgang Dvořák, Monika Henzinger, and David P. Williamson 2 Universität Wien, Fakultät für Informatik, Währingerstraße 29, A-090 Vienna, Austria

More information

APPROXIMATION ALGORITHMS RESOLUTION OF SELECTED PROBLEMS 1

APPROXIMATION ALGORITHMS RESOLUTION OF SELECTED PROBLEMS 1 UNIVERSIDAD DE LA REPUBLICA ORIENTAL DEL URUGUAY IMERL, FACULTAD DE INGENIERIA LABORATORIO DE PROBABILIDAD Y ESTADISTICA APPROXIMATION ALGORITHMS RESOLUTION OF SELECTED PROBLEMS 1 STUDENT: PABLO ROMERO

More information

Submodular Functions Properties Algorithms Machine Learning

Submodular Functions Properties Algorithms Machine Learning Submodular Functions Properties Algorithms Machine Learning Rémi Gilleron Inria Lille - Nord Europe & LIFL & Univ Lille Jan. 12 revised Aug. 14 Rémi Gilleron (Mostrare) Submodular Functions Jan. 12 revised

More information

CS599: Convex and Combinatorial Optimization Fall 2013 Lecture 24: Introduction to Submodular Functions. Instructor: Shaddin Dughmi

CS599: Convex and Combinatorial Optimization Fall 2013 Lecture 24: Introduction to Submodular Functions. Instructor: Shaddin Dughmi CS599: Convex and Combinatorial Optimization Fall 2013 Lecture 24: Introduction to Submodular Functions Instructor: Shaddin Dughmi Announcements Introduction We saw how matroids form a class of feasible

More information

Basic Research in Computer Science BRICS RS Ageev & Sviridenko: An Approximation Algorithm for Hypergraph Max k-cut

Basic Research in Computer Science BRICS RS Ageev & Sviridenko: An Approximation Algorithm for Hypergraph Max k-cut BRICS Basic Research in Computer Science BRICS RS-99-49 Ageev & Sviridenko: An Approximation Algorithm for Hypergraph Max k-cut An Approximation Algorithm for Hypergraph Max k-cut with Given Sizes of Parts

More information

On Maximizing Welfare when Utility Functions are Subadditive

On Maximizing Welfare when Utility Functions are Subadditive On Maximizing Welfare when Utility Functions are Subadditive Uriel Feige October 8, 2007 Abstract We consider the problem of maximizing welfare when allocating m items to n players with subadditive utility

More information

An Approximation Algorithm for MAX-2-SAT with Cardinality Constraint

An Approximation Algorithm for MAX-2-SAT with Cardinality Constraint An Approximation Algorithm for MAX-2-SAT with Cardinality Constraint Thomas Hofmeister Informatik 2, Universität Dortmund, 44221 Dortmund, Germany th01@ls2.cs.uni-dortmund.de Abstract. We present a randomized

More information

On the efficient approximability of constraint satisfaction problems

On the efficient approximability of constraint satisfaction problems On the efficient approximability of constraint satisfaction problems July 13, 2007 My world Max-CSP Efficient computation. P Polynomial time BPP Probabilistic Polynomial time (still efficient) NP Non-deterministic

More information

Distributed Submodular Maximization

Distributed Submodular Maximization Journal of Machine Learning Research 17 (2016) 1-44 Submitted 10/14; Published 12/16 Distributed Submodular Maximization Baharan Mirzasoleiman Department of Computer Science ETH Zurich Universitaetstrasse

More information

Submodular Functions, Optimization, and Applications to Machine Learning

Submodular Functions, Optimization, and Applications to Machine Learning Submodular Functions, Optimization, and Applications to Machine Learning Spring Quarter, Lecture 14 http://www.ee.washington.edu/people/faculty/bilmes/classes/ee596b_spring_2016/ Prof. Jeff Bilmes University

More information

Multiple facility location on a network with linear reliability order of edges

Multiple facility location on a network with linear reliability order of edges J Comb Optim (2017) 34:931 955 DOI 10.1007/s10878-017-0121-5 Multiple facility location on a network with linear reliability order of edges Refael Hassin 1 R. Ravi 2 F. Sibel Salman 3 Published online:

More information

Submodular Functions, Optimization, and Applications to Machine Learning

Submodular Functions, Optimization, and Applications to Machine Learning Submodular Functions, Optimization, and Applications to Machine Learning Spring Quarter, Lecture 13 http://www.ee.washington.edu/people/faculty/bilmes/classes/ee563_spring_2018/ Prof. Jeff Bilmes University

More information

Thresholded Covering Algorithms for Robust and Max-min Optimization

Thresholded Covering Algorithms for Robust and Max-min Optimization Thresholded Covering Algorithms for Robust and Max-min Optimization Anupam Gupta 1,, Viswanath Nagarajan 2, and R. Ravi 3, 1 Computer Science Department, Carnegie Mellon University, Pittsburgh, PA 15213,

More information

On Lagrangian Relaxation and Subset Selection Problems

On Lagrangian Relaxation and Subset Selection Problems On agrangian Relaxation and Subset Selection Problems (Extended Abstract) Ariel Kulik Hadas Shachnai Abstract We prove a general result demonstrating the power of agrangian relaxation in solving constrained

More information

All-or-Nothing Generalized Assignment with Application to Scheduling Advertising Campaigns

All-or-Nothing Generalized Assignment with Application to Scheduling Advertising Campaigns All-or-Nothing Generalized Assignment with Application to Scheduling Advertising Campaigns Ron Adany 1, Moran Feldman 2, Elad Haramaty 2, Rohit Khandekar 3, Baruch Schieber 4, Roy Schwartz 2, Hadas Shachnai

More information

Robust and MaxMin Optimization under Matroid and Knapsack Uncertainty Sets

Robust and MaxMin Optimization under Matroid and Knapsack Uncertainty Sets Robust and MaxMin Optimization under Matroid and Knapsack Uncertainty Sets ANUPAM GUPTA, Carnegie Mellon University VISWANATH NAGARAJAN, University of Michigan R. RAVI, Carnegie Mellon University Consider

More information

1 Matroid intersection

1 Matroid intersection CS 369P: Polyhedral techniques in combinatorial optimization Instructor: Jan Vondrák Lecture date: October 21st, 2010 Scribe: Bernd Bandemer 1 Matroid intersection Given two matroids M 1 = (E, I 1 ) and

More information

Submodular Secretary Problem and Extensions

Submodular Secretary Problem and Extensions Submodular Secretary Problem and Extensions MohammadHossein Bateni MohammadTaghi Hajiaghayi Morteza Zadimoghaddam Abstract Online auction is the essence of many modern markets, particularly networked markets,

More information

Matroids and submodular optimization

Matroids and submodular optimization Matroids and submodular optimization Attila Bernáth Research fellow, Institute of Informatics, Warsaw University 23 May 2012 Attila Bernáth () Matroids and submodular optimization 23 May 2012 1 / 10 About

More information

A Unified Continuous Greedy Algorithm for Submodular Maximization

A Unified Continuous Greedy Algorithm for Submodular Maximization A Unified Continuous Greedy Algorithm for Sumodular Maximization Moran Feldman Technion Joseph (Seffi) Naor Technion Roy Schwartz Technion Astract The study of cominatorial prolems with a sumodular ojective

More information

1 Continuous extensions of submodular functions

1 Continuous extensions of submodular functions CS 369P: Polyhedral techniques in combinatorial optimization Instructor: Jan Vondrák Lecture date: November 18, 010 1 Continuous extensions of submodular functions Submodular functions are functions assigning

More information

Approximability of Adaptive Seeding under Knapsack Constraints

Approximability of Adaptive Seeding under Knapsack Constraints Approximability of Adaptive Seeding under Knapsack Constraints Aviad Rubinstein UC Berkeley aviad@cs.berkeley.edu Lior Seeman Cornell Univeristy lseeman@cs.cornell.edu May 6, 2015 Yaron Singer Harvard

More information

Probability Models of Information Exchange on Networks Lecture 6

Probability Models of Information Exchange on Networks Lecture 6 Probability Models of Information Exchange on Networks Lecture 6 UC Berkeley Many Other Models There are many models of information exchange on networks. Q: Which model to chose? My answer good features

More information

informs DOI /moor.xxxx.xxxx

informs DOI /moor.xxxx.xxxx MATHEMATICS OF OPERATIONS RESEARCH Vol. 00, No. 0, Xxxxxx 20xx, pp. xxx xxx ISSN 0364-765X EISSN 1526-5471 xx 0000 0xxx informs DOI 10.1287/moor.xxxx.xxxx c 20xx INFORMS Polynomial-Time Approximation Schemes

More information

New Models and Algorithms for Throughput Maximization in Broadcast Scheduling

New Models and Algorithms for Throughput Maximization in Broadcast Scheduling New Models and Algorithms for Throughput Maximization in Broadcast Scheduling [Extended Abstract] Chandra Chekuri 1, Avigdor Gal 2, Sungjin Im 1, Samir Khuller 3, Jian Li 3, Richard McCutchen 3, Benjamin

More information

arxiv: v1 [cs.ds] 15 Jul 2016

arxiv: v1 [cs.ds] 15 Jul 2016 Local Search for Max-Sum Diversification Alfonso Cevallos Friedrich Eisenbrand Rico Zenlusen arxiv:1607.04557v1 [cs.ds] 15 Jul 2016 July 18, 2016 Abstract We provide simple and fast polynomial time approximation

More information

A Faster Strongly Polynomial Time Algorithm for Submodular Function Minimization

A Faster Strongly Polynomial Time Algorithm for Submodular Function Minimization A Faster Strongly Polynomial Time Algorithm for Submodular Function Minimization James B. Orlin Sloan School of Management, MIT Cambridge, MA 02139 jorlin@mit.edu Abstract. We consider the problem of minimizing

More information

Streaming Algorithms for Maximizing Monotone Submodular Functions under a Knapsack Constraint

Streaming Algorithms for Maximizing Monotone Submodular Functions under a Knapsack Constraint Streaming Algorithms for Maximizing Monotone Submodular Functions under a Knapsack Constraint Chien-Chung Huang 1, Naonori Kakimura 2, and Yuichi Yoshida 3 1 CNRS, École Normale Supérieure, Paris, France

More information

Hardness of Submodular Cost Allocation: Lattice Matching and a Simplex Coloring Conjecture

Hardness of Submodular Cost Allocation: Lattice Matching and a Simplex Coloring Conjecture Hardness of Submodular Cost Allocation: Lattice Matching and a Simplex Coloring Conjecture Alina Ene,2 and Jan Vondrák 3 Center for Computational Intractability, Princeton University 2 Department of Computer

More information

Variants of MAX WEIGHTED SAT and MIN WEIGHTED SAT have been considered in the literature, dened by making restrictions on the size of the clauses in t

Variants of MAX WEIGHTED SAT and MIN WEIGHTED SAT have been considered in the literature, dened by making restrictions on the size of the clauses in t On the Complexity of Approximating Weighted Satisability Problems (Extended Abstract) Paola Alimonti yzx Giorgio Ausiello y Loredana Giovaniello z Marco Protasi z Abstract The maximum weighted satisability

More information

An approximation algorithm for the minimum latency set cover problem

An approximation algorithm for the minimum latency set cover problem An approximation algorithm for the minimum latency set cover problem Refael Hassin 1 and Asaf Levin 2 1 Department of Statistics and Operations Research, Tel-Aviv University, Tel-Aviv, Israel. hassin@post.tau.ac.il

More information

Minimization of Symmetric Submodular Functions under Hereditary Constraints

Minimization of Symmetric Submodular Functions under Hereditary Constraints Minimization of Symmetric Submodular Functions under Hereditary Constraints J.A. Soto (joint work with M. Goemans) DIM, Univ. de Chile April 4th, 2012 1 of 21 Outline Background Minimal Minimizers and

More information

Budgeted Allocations in the Full-Information Setting

Budgeted Allocations in the Full-Information Setting Budgeted Allocations in the Full-Information Setting Aravind Srinivasan 1 Dept. of Computer Science and Institute for Advanced Computer Studies, University of Maryland, College Park, MD 20742. Abstract.

More information

Covering Games: Approximation through Non-Cooperation

Covering Games: Approximation through Non-Cooperation Covering Games: Approximation through Non-Cooperation Martin Gairing Department of Computer Science, University of Liverpool, U.K. m.gairing@liverpool.ac.uk Abstract. We propose approximation algorithms

More information

The minimum G c cut problem

The minimum G c cut problem The minimum G c cut problem Abstract In this paper we define and study the G c -cut problem. Given a complete undirected graph G = (V ; E) with V = n, edge weighted by w(v i, v j ) 0 and an undirected

More information

A DIGRAPH FOURIER TRANSFORM WITH SPREAD FREQUENCY COMPONENTS

A DIGRAPH FOURIER TRANSFORM WITH SPREAD FREQUENCY COMPONENTS A DIGRAPH FOURIER TRANSFORM WITH SPREAD FREQUENCY COMPONENTS Rasoul Shafipour, Ali Khodabakhsh, Gonzalo Mateos, and Evdokia Nikolova Dept. of Electrical and Computer Engineering, University of Rochester,

More information

Approximating maximum satisfiable subsystems of linear equations of bounded width

Approximating maximum satisfiable subsystems of linear equations of bounded width Approximating maximum satisfiable subsystems of linear equations of bounded width Zeev Nutov The Open University of Israel Daniel Reichman The Open University of Israel Abstract We consider the problem

More information

Submodular Maximization by Simulated Annealing

Submodular Maximization by Simulated Annealing Submodular Maximization by Simulated Annealing Shayan Oveis Gharan Jan Vondrák Abstract We consider the problem of maximizing a nonnegative (possibly non-monotone) submodular set function with or without

More information

A Truthful Mechanism for the Generalized Assignment Problem

A Truthful Mechanism for the Generalized Assignment Problem A Truthful Mechanism for the Generalized Assignment Problem Salman Fadaei, Martin Bichler Department of Informatics, TU München, Munich, Germany Email: {salman.fadaei, bichler}@in.tum.de Abstract We propose

More information

Approximating Submodular Functions Everywhere

Approximating Submodular Functions Everywhere Approximating Submodular Functions Everywhere Michel X. Goemans Nicholas J. A. Harvey Satoru Iwata Vahab Mirrokni Abstract Submodular functions are a key concept in combinatorial optimization. Algorithms

More information

Optimal approximation for submodular and supermodular optimization with bounded curvature

Optimal approximation for submodular and supermodular optimization with bounded curvature Optimal approximation for submodular and supermodular optimization with bounded urvature Maxim Sviridenko Jan Vondrák Justin Ward Otober 9, 204 Abstrat We design new approximation algorithms for the problems

More information

An Introduction to Submodular Functions and Optimization. Maurice Queyranne University of British Columbia, and IMA Visitor (Fall 2002)

An Introduction to Submodular Functions and Optimization. Maurice Queyranne University of British Columbia, and IMA Visitor (Fall 2002) An Introduction to Submodular Functions and Optimization Maurice Queyranne University of British Columbia, and IMA Visitor (Fall 2002) IMA, November 4, 2002 1. Submodular set functions Generalization to

More information

New algorithms for Disjoint Paths and Routing Problems

New algorithms for Disjoint Paths and Routing Problems New algorithms for Disjoint Paths and Routing Problems Chandra Chekuri Dept. of Computer Science Univ. of Illinois (UIUC) Menger s Theorem Theorem: The maximum number of s-t edgedisjoint paths in a graph

More information

A Multi-Exchange Local Search Algorithm for the Capacitated Facility Location Problem

A Multi-Exchange Local Search Algorithm for the Capacitated Facility Location Problem A Multi-Exchange Local Search Algorithm for the Capacitated Facility Location Problem Jiawei Zhang Bo Chen Yinyu Ye October 19, 2003 Abstract We present a multi-exchange local search algorithm for approximating

More information

10.3 Matroids and approximation

10.3 Matroids and approximation 10.3 Matroids and approximation 137 10.3 Matroids and approximation Given a family F of subsets of some finite set X, called the ground-set, and a weight function assigning each element x X a non-negative

More information

ALGORITHMS FOR BUDGETED AUCTIONS AND MULTI-AGENT COVERING PROBLEMS

ALGORITHMS FOR BUDGETED AUCTIONS AND MULTI-AGENT COVERING PROBLEMS ALGORITHMS FOR BUDGETED AUCTIONS AND MULTI-AGENT COVERING PROBLEMS A Thesis Presented to The Academic Faculty by Gagan Goel In Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy

More information

Lecture 20: Course summary and open problems. 1 Tools, theorems and related subjects

Lecture 20: Course summary and open problems. 1 Tools, theorems and related subjects CSE 533: The PCP Theorem and Hardness of Approximation (Autumn 2005) Lecture 20: Course summary and open problems Dec. 7, 2005 Lecturer: Ryan O Donnell Scribe: Ioannis Giotis Topics we discuss in this

More information