arxiv: v1 [cs.ds] 3 Mar 2016

Transcription

1 Tigh Analysis of a Muliple-Swap Heurisic for Budgeed Red-Blue Median Zachary Friggsad Yifeng Zhang arxiv: v1 [cs.ds] 3 Mar 2016 Deparmen of Compuing Science Universiy of Albera {zacharyf,yifeng2}@ualbera.ca Absrac Budgeed Red-Blue Median is a generalizaion of classic k-median in ha here are wo ses of faciliies, say R and B, ha can be used o serve cliens locaed in some meric space. The goal is o open k r faciliies in R and k b faciliies in B for some given bounds k r, k b and connec each clien o heir neares open faciliy in a way ha minimizes he oal connecion cos. We exend work by Hajiaghayi, Khandekar, and Korsarz [2012] and show ha a muliple-swap local search heurisic can be used o obain a (5 + ɛ)-approximaion for Budgeed Red-Blue Median for any consan ɛ > 0. This is an improvemen over heir single swap analysis and beas he previous bes approximaion guaranee of 8 by Swamy [2014]. We also presen a maching lower bound showing ha for every p 1, here are insances of Budgeed Red-Blue Median wih local opimum soluions for he p-swap heurisic whose cos ( is 5 + Ω 1 p ) imes he opimum soluion cos. Thus, our analysis is igh up o he lower order erms. In paricular, for any ɛ > 0 we show he single-swap heurisic admis local opima whose cos can be as bad as 7 ɛ imes he opimum soluion cos. 1 Inroducion Faciliy locaion problems crop up in many areas of compuing science and operaions research. A ypical problem involves a se of cliens and possible faciliy locaions locaed in a meric space. The goal is o open some faciliies and connec each clien o some open faciliy as cheaply as possible. These problems become difficul when here are coss associaed wih opening faciliies or addiional consrains ha ensure we canno open oo many faciliies. We sudy Budgeed Red-Blue Median, one paricular insance of his ype of problem. Here we are given a se of cliens C, a se of red faciliies R, and a se of blue faciliies B. These are locaed in some meric space wih meric disances d(i, j) 0 for any wo i, j C R B. Addiionally, we are This research was underaken, in par, hanks o funding from he Canada Research Chairs program and an NSERC Discovery Gran. 1

2 given wo ineger bounds k r R and k b B. The goal is o selec/open k r red faciliies R and k b blue faciliies B o minimize cos(r B) := min d(i, j). i R B j C The classic NP-hard k-median problem appears as a special case when, say, R =. Thus, Budgeed Red-Blue Median is NP-hard. In his paper, we focus on approximaion algorihms for Budgeed Red-Blue Median, in paricular on local search echniques. 1.1 Previous Work The sudy of Budgeed Red-Blue Median from he perspecive of approximaion algorihms was iniiaed by Hajiaghayi, Khandekar, and Korsarz [9], where hey obain a consan-facor approximaion by a local search algorihm ha ieraively ries o swap one red and/or one blue faciliy in he given soluion. They do no specify he consan in heir analysis, bu i looks o be greaer han 8. Ciing [9] as inspiraion, Krishnaswamy e al. sudied a generalizaion of Budgeed Red-Blue Median known as Maroid Median [10]. Here, a maroid srucure is given over he se of faciliies and we can only open a se of faciliies if hey form an independen se in he maroid. They obain a consan-facor approximaion for Maroid Median hrough rounding an LP relaxaion. This was laer refined o an 8-approximaion by Swamy [15]. The special case of k-median is a classic opimizaion problem and has received a lo of aenion from boh heoreical and pracical communiies. The bes approximaion guaranee known so far is by Byrka e al. [5], who build heavily on he breakhrough work of Li and Svensson for he problem [11]. While local search echniques have been used somewha infrequenly in he design of approximaion algorihms in general, i may be fair o say ha hey have seen he mos success in faciliy locaion problems. For almos 10 years, he bes approximaion for k-median was based on a local search algorihm. Arya e al. [3] show ha a muliple-swap heurisic leads o a (3 + ɛ)-approximaion for k-median for any consan ɛ > 0. This analysis was simplified in [8], which inspires much of our analysis. Oher successful local search applicaions include a (1 + 2)-approximaion for Uncapaciaed Faciliy Locaion is also obained hrough local search [3, 6]. Local search has been very helpful in approximaing Capaciaed Faciliy Locaion, he firs consan-facor approximaion was by Pál, Tardos, and Wexler [13] and he curren bes approximaion is a (5 + ɛ)-approximaion by Bansal, Garg, and Gupa [4]. In he special case when all capaciies are uniform, Aggarwal e al. [1] obain a 3-approximaion. Even more examples of local search applied o oher faciliy locaion varians can be found in [2, 7, 8, 12, 14]. 1.2 Our Resuls and Techniques We show ha a muliswap generalizaion of he local search algorihm considered in [9] is a (5 + ɛ)- approximaion for Budgeed Red-Blue Median. Tha is, for a value p say he p-swap heurisic is he algorihm ha, upon given an iniial feasible soluion, ries o swap up o p faciliies of each 2

3 colour. If no such swap produces a cheaper soluion, i erminaes. Oherwise, i ieraes wih he now cheaper soluion. The formal descripion is given in Algorihm 1 in Secion 2. Say ha a soluion is locally opimum for he p-swap heurisic if no cheaper soluion can be found by swapping up o p faciliies of each colour. Le OP T denoe he cos of an opimum soluion. Our main resul is he following. Theorem 1 Any locally opimum soluion for he p-swap heurisic has cos a mos (5 + O(1/ p)) OP T. Using sandard echniques (briefly menioned in Secion 2), his readily leads o a polynomial-ime approximaion algorihm. By choosing p = θ(1/ɛ 2 ) we have he following. Theorem 2 For any consan ɛ > 0, Budgeed Red-Blue Median admis a polynomial-ime (5 + ɛ)-approximaion. This improves over he 8-approximaion for Budgeed Red-Blue Median in [15]. We emphasize he approximaion guaranee from Theorem 1 is for Budgeed Red-Blue Median only, he 8- approximaion in [15] is sill he bes approximaion for he general Maroid Median problem. Indeed, [10] show ha Maroid Median canno be approximaed wihin any consan facor using any consan number of swaps even in he generalizaion of Budgeed Red-Blue Median where here can be a super-consan number faciliy colours. We also presen a lower bound ha maches our analysis up he lower order erms. Theorem 3 For any inegers p, l wih 1 p l/2, here is an insance of Budgeed ( Red-Blue ) Median ha has a locally-opimum soluion for he p-swap heurisic wih cos a leas p 10p l+1 OP T. By leing l bu keeping p fixed, we see ha he p-swap heurisic canno guaranee a raio beer han p. So, Theorem 1 is igh up o lower order erms. Also, for p = 1 we see ha he single-swap heurisic analyzed in [9] is no beer han a 7-approximaion. Local search echniques are ypically analyzed by consrucing a se of candidae es swaps where some faciliies in he opimum soluion are swapped in and some from he local opimum are swapped ou in order o generae a useful inequaliy. One of he main feaures of he k-median analysis in [3] and [8] is ha such swaps can be considered ha ensure each faciliy in he global opimum is swapped in once and, by averaging some swaps, each faciliy in he local opimum is swapped ou o he exen of a mos 1 + O(ɛ) imes. Each ime a faciliy in he local opimum is swapped ou, hey pay an addiional 2 imes he global opimum cos for some cliens o reassign hem. We obain only a 5 + ɛ approximaion because we end up swapping ou some faciliies in he local opimum soluion o he exen of 2 + O(ɛ), hereby paying an addiional 2 + O(ɛ) more han in he k-median analysis. Ulimaely, his is because some of our iniial swaps generae inequaliies ha depend posiively on clien assignmen coss in he local opimum. So we consider addiional swaps ha do no inroduce any more posiive dependence on he local opimum o cancel hem ou. 3

4 This issue was also encounered in he analysis in [9]. In some sense, we are showing ha his is he only added difficuly over he sandard k-median analysis. However, he averaging argumens we use are a fair bi more sophisicaed han he analysis for k-median. 1.3 Organizaion Secion 2 presens he algorihm and describes some useful noaion. In paricular, i presens a way o decompose he global and local opimum soluion ino srucured groups ha are examined in he analysis. Secion 3 analyzes he qualiy of locally opimum soluions o prove Theorem 1. Secion 4 proves Theorem 3 wih an explici consrucion of a bad example. We conclude wih some remarks in Secion 5. 2 Noaion and Preliminaries Say ha a feasible soluion is a pair (R, B) of subses R R and B B wih R = k r and B = k b. Algorihm 1 describes he local search algorihm. Algorihm 1 The p-swap Heurisic for Budgeed Red-Blue Median Le (R, B) be arbirary feasible soluion. while here is some feasible soluion (R, B ) wih R R p and B B p and cos(r B ) < cos(r B) do (R, B) (R, B ) end while reurn (R, B) While a single ieraion of Algorihm 1 can be execued in n O(p) (where n is he oal number of locaions in he problem), i may be ha he number of ieraions is no polynomially bounded. We can employ a well-known rick o ensure i does erminae in a polynomial number of seps while losing only anoher ɛ in our analysis. The idea is o perform he updae only if cos(r B ) (1 ɛ/ ) cos(r B) where is some quaniy ha is polynomial in he inpu size. Our analysis is compaible wih his approach; one can check ha he oal weigh of all inequaliies we consider is polynomially bounded. For example, see [3] for deails. We do no focus any furher on his deail, and insead work oward analyzing he cos of he soluions produced by Algorihm 1 as i is saed. From now on, le S = R B wih R R, B B denoe an arbirary local opimum soluion. Tha is, here is no cheaper soluion (R, B ) wih R R p and B B p. Also fix a global opimum soluion O = R B where R B and B B. We assume ha S O =. This is wihou loss of generaliy, as we can duplicae each faciliy locaion in he inpu and say ha S use he firs copies and O use he second copies. I is easy o verify ha S is sill a local opimum soluion. To help analyze he cos, we will inroduce some noaion. For any clien j C, le s j S denoe he local opimum faciliy is closes o j and o j O be he opimum faciliy ha is closes o j. For breviy, le c j = d(j, s j ) be he cos of assigning j in he local opimum and c j = d(j, o j) he cos of 4

5 assigning j in he global opimum. Thus, cos(s) = j C c j and cos(o) = j C c j. For any faciliy i O we le N (i ) = {j C : o j = i } and for any i S we le N(i) = {j C : s j = i}. Le φ : O S map each faciliy in O o is neares faciliy in S, breaking ies arbirarily. For i S, le deg(i) = φ 1 (i). If deg(i) 0, le cen(i) be he faciliy in φ 1 (i) ha is closes o i, again breaking ies arbirarily. We also borrow some addiional noaion from [9]. Definiion 1 (very good, good, bad faciliy) A faciliy i S is very good if deg(i) = 0, good if no i φ 1 (i) has he same colour as i, and bad oherwise. The analysis in [9] divides S O ino blocks ha saisfy cerain properies. We require slighly sronger properies han heir blocks guaranee. We also use a slighly differen noion of wha i means for some i S o be a leader. The required properies are summarized in he following lemma. Lemma 1 We can pariion S O ino blocks T saisfying he following properies. T R = T R and T B = T B. For every i S T, we also have φ 1 (i) T. For every i O T, we have φ(i ) T. There is some faciliy î T S wih deg(î) > 0 designaed as he leader ha has he following properies. Every oher i T S {î} is eiher good or very good and all good i T S {î} have he same colour. We focus on analyzing one block a a ime o prove he approximaion guaranee. This provides us wih a cleaner way o describe he es swaps and he addiional srucure will help handle he ineviable cases where we have o swap ou some i S bu canno swap in all of φ 1 (i). For example, his can happen if all blue faciliies i B have deg(i) being very large (so all deg(i ) = 0 faciliies are red). We will sill need o close some of hem in order o open faciliies in B when generaing bounds via es swaps. 2.1 Generaing he Blocks We prove Lemma 1 in his secion. Firs, we describe how o pariion S O ino groups. These will hen be combined o form he final blocks. We say ha a group is a subse G of S O where G S = G O, here is exacly one î G S wih deg(î) > 0, and G O = φ 1 (î). Call his faciliy î he represenaive of he group. We classify groups G in one of hree ways. Balanced: G R = G R and G B = G B. Good: î is a good faciliy and all oher i G S î have a differen colour han î. Noe his means G R = G R ± 1. 5

6 Bad: G is neiher balanced nor good. Noe ha here he good and bad are referring o groups, we emphasize ha hese are differen han good and bad faciliies. Algorihm 2 describes a procedure for forming groups in a paricular way ha will be helpful in creaing he final blocks. Algorihm 2 Procedure for pariioning ino groups S S, O O while some faciliy i in S wih deg(i) > 0 do G φ 1 (i) + i if G X is a balanced group for some X S hen G G X else if G X is a good group for some X S hen G G X else Le X {i S : deg(i ) = 0} such ha G X is a bad group and all faciliies in S X have he same colour. c.f. Lemma 2 G G X. end if Oupu group G i is he represenaive of G S S G, O O G end while Lemma 2 Each ieraion correcly execues (i.e. succeeds in creaing a group). Proof. By a simple couning argumen, here are always exacly O {i S : deg(i) 0} very good faciliies in S. So we can always find a subse of very good faciliies X such ha G X is a group. We prove ha if he firs wo if condiions are false hen we can find X o ensure S X only conains faciliies of one colour. There are 2 cases. Suppose i is bad and, wihou loss of generaliy, ha i is also red. Because we canno exend G o be a balanced group, eiher here are less han φ 1 (i) B very good blue faciliies in S or less han φ 1 (i) R 1 very good red faciliies in S. In eiher case, firs add all very good faciliies from he deficien colour o X o use up ha colour and hen add enough very good faciliies o X of he oher colour o ensure X = φ 1 (i) 1. In he oher case when i is good, we again assume wihou loss of generaliy ha i is red. Because we canno form a good group, here are fewer han φ 1 (i) 1 very good blue faciliies in S. Use hem up when forming X and hen add enough very good red faciliies so ha X = φ 1 (i) 1. Le G be he collecion of groups oupu by Algorihm 2. We now show how o piece hese groups ogeher o form blocks. 6

7 Algorihm 3 Procedure for generaing blocks G G while here is some balanced group G in G do Oupu G as a block wih is own represenaive being he leader. G G G. end while while here are good groups G, G G wih differen coloured represenaives do Oupu he block G G and choose eiher represenaive as he leader. G G {G, G } end while while here is some bad group G G do c.f. Lemma 3. Le G 0 G G consis only of good groups such ha G + G 0 is a block. Oupu G + G 0 wih he represenaive of G as he leader. G G (G + G 0 ). end while I is easy o verify ha any block ha is oupu by his algorihm indeed saisfies he properies lised in Lemma 1. The following lemma explains why his procedure correcly execues and why all groups are used up. Tha is, i finishes he pariioning of S O ino blocks. For a union of groups G = G 1... G k, define he blue deficiency of G as G B G B. Lemma 3 If G is a bad group considered in some ieraion of he las loop, we can find he corresponding G 0 so ha G + G 0 is a block. Furhermore, afer he las while loop erminaes hen G =. Proof. Suppose, wihou loss of generaliy, ha he blue very good faciliies were used up he firs ime a bad group was formed in Algorihm 2. Thus, for every bad group G G we have G B < G B. Le G be a group considered in some ieraion of he las loop in Algorihm 3. As observed above, he blue deficiency of G is sricly posiive. The blue deficiency of he union of all groups in G is 0 because we have only removed blocks from G up o his poin and, by definiion, a block has blue deficiency 0. Thus, here mus be some oher group G G wih sricly negaive blue deficiency. I canno be ha G is bad, oherwise i has nonnegaive blue deficiency. I also canno be ha G is balanced or ha i is a good group wih a red represenaive, because such blocks also have nonnegaive blue deficiency. Therefore, G mus be good wih a blue represenaive. Good blocks wih blue represenaives have blue deficiency exacly -1. Add his G o G 0. Ieraing his argumen wih G + G 0, we add good groups wih blue represenaives o G 0 unil G + G 0 is a block. The layou in Figure 1 depics a block consruced in his manner, he lefmos group in he figure is he bad group G and he remaining groups form G 0. Afer he las loop here are no groups wih bad represenaives or balanced groups. Furhermore, all good groups mus have he same colour of represenaive by he second loop. If here were any good group, he blue deficiency of he union of groups in G would hen be nonzero, so here canno be any 7

8 good groups lef. Tha is, a he end of he las loop here are no more groups in G. 2.2 Sandard Bounds Before delving ino he analysis we noe he following wo bounds. The firs has been used exensively in local search analysis and was firs proven in [3] and he second was proven in [9]. For convenience we will include he proofs here. Lemma 4 For any j C, d(j, φ(o j )) c j 2c j. Proof. By he riangle inequaliy and he definiion of φ, we have d(j, φ(o j )) d(j, o j ) + d(o j, φ(o j )) c j + d(o j, s j ) 2c j + c j. Lemma 5 For any j C, d(j, cen(φ(o j ))) c j 3c j + c j. Proof. By he riangle inequaliy and Lemma 4, i suffices o prove d(φ(o j ), cen(φ(o j ))) c j + c j. By definiion of cen() and φ, d(φ(o j ), cen(φ(o j ))) d(φ(o j ), o j ) d(s j, o j ) c j + c j. Finally, we ofen consider operaions ha add or remove a single iem from a se. To keep he noaion cleaner, we le S + i and S i refer o S {i} and S {i}, respecively, for ses S and iems i. 3 Muliswap Analysis Recall ha we are assuming S = R B is a locally opimum soluion wih respec o he heurisic ha swaps a mos p faciliies of each colour and ha O = R B is some globally opimum soluion. We assume p = for some sufficienly large ineger. Focus on a single block T. For breviy, le T R = T R and T B = T B denoe he red and blue faciliies from he opimum soluion in T. Similarly le T R = T R and T B = T B denoe he red and blue faciliies from he local opimum soluion in T. The main goal of his secion is o demonsrae he following inequaliy for group T Theorem 4 For some absolue consan γ ha is independen of, we have [( 1 + γ ) ] [( c j c j γ j N (T R T B ) j N(T R T B ) ) c j + γ c j ]. 8

9 cen(î) cen(i 1 ) cen(i 2 ) cen(i 3 ) cen(i 4 ) îî i 1 i 2 i 3 i 4 Figure 1: Illusraion of a block T. The faciliies on he op are in T O and he faciliies on he boom are in T S. The direced edges depic φ, and he hick edges connec cen(i) o i. The faciliies coloured black lie in B, he faciliies coloured whie lie in R, and he faciliies coloured grey could eiher lie in B or R. Noe ha B = {i 1, i 2, i 3, i 4 }. The layou of he figure is suggesive of how he block was consruced by adding good groups o he iniial bad group in Algorihm 3 We firs show he simple deails of how his yields our main resul. Proof of Theorem 1. Summing he inequaliies saed in Theorem 4 over all blocks T, we see j C ( 5 + 2γ ) ( c j 1 γ ) c j. Muliplying hrough by Rearranging, we see γ, when > γ his shows cos(s) = j C c j j C j C 5 + 2γ γ c j c j. ( 5 + 7γ ) ( c j = 5 + 7γ ) cos(s ). γ γ Recall ha p = where p is he number of swaps considered in he local search algorihm. Thus, Algorihm 1 is a (5 + O(1/ p))-approximaion. The analysis breaks ino a number of cases based on wheher TR and/or T B are large. In each of he cases, we use he following noaion and assumpions. Le î denoe he leader in T. Wihou loss of generaliy, assume all oher i T B T R wih deg(i) > 0 are blue faciliies. Le B = {i T B î : deg(i) > 0}. Figure 1 illusraes his noaion. The swaps we consider in hese cases are quie varied, bu we always ensure we swap in cen(i) whenever some i S T wih deg(i) > 0 is swapped ou. This way, we can always bound he reassignmen cos of each clien j by using eiher Lemma 4 or Lemma 5. 9

10 3.1 Case T R 2, T B In his case, we simply swap ou all of T R T B and swap in all of TR T B. Because R B is a locally opimum soluion and because his swaps a mos 2 faciliies of each colour, we have. cos(s (T R T B) (T R T B )) cos(s) Of course, afer he swap each clien will move o is neares open faciliy. As is ypical in local search analysis, we explicily describe a (possibly subopimal) reassignmen of cliens o faciliies o upper bound his cos change. Each j N (TR T B ) is moved from s j o o j which incurs an assignmen cos change of exacly c j c j. Each j N(T R T B ) N (TR T B ) is moved o φ(o j). Noe ha φ(o j ) T so i remains open afer he swap. By Lemma 4, he assignmen cos change is bounded by 2c j. Every oher clien j ha has no already been reassigned remains a s j and incurs no assignmen cos change. Thus, j N (T R T B ) (c j c j ) + j N(T R T B ) which is even beer han wha we are required o show for Theorem 4. We noe ha he analysis Secion 3.4 could subsume his analysis (wih a worse consan), bu we have included i here anyway o provide a genle inroducion o some of he simpler aspecs of our approach. 2c j 3.2 Case T R 2 + 1, T B + 1 We sar by briefly discussing some challenges in his case. In he wors case, all of he i b T B have deg(i) being very large. The issue here is ha we need o swap in each i b T B in order o generae erms of he form c j c j for j wih o j = i b. Bu his requires us o swap ou some i b. Since we do no have enough swaps o simply swap in all of φ 1 (i b ), we simply swap in cen(i b ). Any clien j wih s j being closed and o j φ 1 (i b ) cen(i b ) canno be reassigned o φ(o j ), so we send i o cen(φ(o j )) and use Lemma 5 o bound he reassignmen cos. This leaves a erm of he form +c j, so we have o consider addiional swaps involving c j o cancel his ou. These addiional swaps cause us o lose a facor of roughly 5 insead of 3. Anoher smaller challenge is ha we do no wan o swap ou he leader î T S for a variey of echnical reasons. However, since TR and T B are boh big, his is no a problem. When we swap ou some i T O, we will jus swap in a randomly chosen faciliy in T S î of he same colour. The probabiliy any paricular faciliy is swapped in his way is very small. Ulimaely, each faciliy in T S will be swapped ou 2 + O(1/) imes in expecaion. To be precise, we pariion he se of cliens in N(T R T B ) ino wo groups: C bad := N(B) N (T R cen(b)) and C ok := N(T R T B î) C bad. We omi N(î) from C ok because we will never close î in his case. 10

11 The firs group is dubbed bad because here may be a swap where boh s j and φ(o j ) are closed ye o j is no opened so we can only use Lemma 5 o bound heir reassignmen cos. In fac, some cliens j C ok may also be involved in such a swap, bu we are able o use an averaging argumen for hese cliens o show ha he resuling +s j erm from using Lemma 5 appears wih negligible weigh and does no need o be cancelled. We consider he following wo ypes of swaps o generae our iniial inequaliy. For each i b T B, choose a random i b T B î. If i b B (i.e. deg(i b ) = 0) hen simply swap ou i b and swap in i b. If i b B hen swap ou i b and a random i r T R î and swap in i b and cen(i b ). For each i r T R cen(b), swap in i r and swap ou a randomly chosen i r T R î. By choosing faciliies a random, we mean uniformly a random from he given se and his should be done independenly for each invokaion of he swap. Lemma 6 j N (T B T R ) ( + 1 c j c j ) + j C ok [( ) c j + 1 ] c j j C bad (3c j + c j ). Proof. For breviy, we will le β R = T R β R = 1 or β B = 1. T R î and β B = T B. Noe ha β T B î R, β B +1 and ha eiher Firs consider a swap of he firs ype ha swaps in {i b, cen(i b)} and swaps ou {i b, i r } for some i b wih deg(i b ) > 0. Because R B is a local opimum he cos of he soluion does no decrease afer performing his swap. We provide an upper bound on he reassignmen cos. Each j N ({i b, cen(i b)}) is reassigned from s j o o j and incurs an assignmen cos change of c j c j. Every clien j N({i b, i r }) ha has no ye been reassigned is firs moved o φ(o j ). If his φ(o j ) remains open, assign j o i. By Lemma 4, he assignmen cos for j increases by a mos 2c j. If φ(o j) is no open hen φ(o j ) = i b (because deg(i r ) = 0) so we insead move j o cen(φ(o j )) = cen(i b ). Lemma 5 shows he assignmen cos increases by a mos 3c j +c j. This can only happen if s j {i r, i b } and φ(o j ) = i b. Combining hese observaions and using sligh overesimaes, we see (c j c j ) + 2c j + j N ({i b,cen(i b)}) j N({i b,i r}) φ(o j ) i b j N({i b,i r}) φ(o j )=i b (3c j + c j ). (1) Now, if he random choice for i b in he swap has deg(i b ) = 0, hen swapping {i b } ou and {i b } in generaes an even simpler inequaliy: (c j c j ) + 2c j. (2) j N (i b ) j N(i b ) 11

12 To see his, jus reassign each j N (i b ) from s j o o j and reassign he remaining j N(i b ) from s j o φ(o j ) (which remains open because deg(i b ) = 0) and use Lemma 4. Consider he expeced inequaliy ha is generaed for his fixed i b. We sar wih some useful facs ha follow sraigh from he definiions and he swap we jus performed. Any j N (cen(b)) has o j open wih probabiliy 1 T B î. Any j C bad has s j being closed wih probabiliy 1 T B î. Any j C ok N(T R ) has s j being closed wih probabiliy 1 T B î. When his happens, if o j is no opened hen φ(o j ) mus be open. Tha is, j C ok means o j T B cen(b). If o j T B hen φ(o j) = î (by he srucure of block T ) which remains open. If o j cen(b) hen eiher φ(o j ) was no closed, or else cen(φ(o j )) = o j was opened. Any j C ok N(T R ) has s j being closed wih probabiliy B 1. If o T B î T R î j and φ(o j ) are closed, 1 hen we move j o cen(φ(o j )). However, his can only happen wih probabiliy 1 T B î T R î since i mus be ha φ(o j ) is he blue faciliy ha was randomly chosen o be closed. Averaging (1) over all random choices and using some sligh overesimaes we see (c 1 j c j ) + T B î (c j c j ) j N (i r) + 1 T B î + 1 T B î Summing over all i b N (TB ) shows (c j c j ) + β B j N (TB ) +β B (3c j + c j ) + j C bad j C bad (3c j + c j ) + 1 T R î j N (cen(b)) j C ok N(T R ) j C ok N(T R ) j N (cen(b)) j C ok N(T R ) 2c j ( B 2c j + 3c j + c j ). (c j c j ) (3) 2c j + β B T R î j C ok N(T R ) ((2 B + 3)c j + c j ). Nex, consider he second ype of swap ha swaps in some i r TR cen(b) and swaps ou some randomly chosen i r T R î. Over all such swaps, he expeced number of imes each i r T R î is swapped ou is T R B = β T R î R B. In each such swap, we reassign j N (i T R î r) from s j o o j and every oher j N(i r ) from s j o φ(o j ) which is sill open because deg(i r ) = 0. Thus, j N (T R cen(b)) (c j c j ) + ( β R 12 B T R î ) j C ok N(T R ) 2c j

13 Scaling his bound by β B, adding i o (3), and recalling T R 2 shows (c j c j ) + β B (c j c j ) j N (TB ) j N (T R ) +β B (3c j + c j ) + 2c j+ + β B j C bad j C ok N(T R ) j C ok N(T R ) Recall ha β B, β R +1 and also β B β R +1 o complee he proof of Lemma 6. [(2β R + 3 ) 2 c j + 1 ] 2 c j. Our nex sep is o cancel erms of he form +c j in he bound from Lemma 6 for j C bad. To do his, we again perform he second ype of swap for each i TR cen(b) bu reassign cliens a bi differenly in he analysis. Lemma 7 (c j c j ) j C bad j C ok N(T R ) 2c j Proof. For each i r T R cen(b), swap i r in and a randomly chosen i r T r î. Raher han reassigning all j N (i r) o i r, we only reassign hose in C bad N (i r). Since deg(i r ) = 0 hen any oher j N(i r ) can be reassigned o φ(o j ) and which increases he cos by a mos 2c j. Summing over all i r, observing ha C bad T R cen(b), and also observing ha each j C ok has s j closed a mos β R +1 imes in expecaion, we derive he inequaliy saed in Lemma 7. Adding he bounds saed in Lemmas 6 and 7 shows ha Theorem 4 holds in his case. 3.3 Case T R 2 + 1, T B In his case, we sar by swapping in all of T B and swapping ou all of T B (including, perhaps, î if i is blue). In he same swap, we also swap in cen(t B ) and swap ou a random subse of he appropriae number of faciliies in T R î. This is possible as T R î cen(t B ). By random subse, we mean among all subses of T r î of he necessary size, choose one uniformly a random. As wih Secion 3.2, we begin wih a definiion of bad cliens ha is specific o his case: C bad := N(T B ) N (T R cen(t B )). Cliens j C bad may be involved in swaps where boh s j and φ(o j ) is closed ye o j is no opened and we canno make his negligible wih an averaging argumen. Lemma 8 (c j c j ) + 1 j N (T B cen(t B)) (3c j + c j ) + j N(T R ) j C bad (3c j + c j ) 13

14 Proof. Afer he swap, reassign every j N (T B cen(t B)) from s j o o j, for a cos change of c j c j. Every oher j ha has s j being closed is firs reassigned o φ(o j ). If his is no open, hen furher move j o cen(o j ) which mus be open because he only faciliies i T R T B wih deg(i) > 0 ha were closed lie in T B and we opened cen(t B ). If j N(T B ) C bad hen o j T B cen(t B) and we have already assigned j o o j. If j C bad hen we have moved j o cen(φ(o j )) and he cos change is 3c j + c j by Lemma 5. Finally, if j N(T R ) hen we eiher move j o φ(o j ) or o cen(φ(o j )) if φ(o j ) is no open. The wors-case bound on he reassignmen cos is 3c j +c j by Lemmas 4 and 5. However, noe ha s j T R is closed wih probabiliy only 1/, since we close a random subse of T r î of size a mos and T r î 2. We sill need o swap in T R cen(t B). For each such faciliy i r, swap in i r and swap ou a randomly chosen i r T R î. The analysis of hese swaps is essenially he nearly idenical swaps in Secion 3.2, so we omi i and merely summarize wha we ge by combining he resuling inequaliies wih he inequaliy from Lemma 8. Lemma 9 j N (T R T B ) (c j c j ) + j N(T R ) ( c j + 1 ) (3c j + c j ) + (3c j + c j ) j C bad We cancel he +c j erms for j C bad wih one furher collecion of swaps. For each i r T R cen(t B) we swap in i r and a randomly chosen i r T R î. The following lemma summarizes a bound we can obain from hese swaps. I is proven in essenially he same way as Lemma 7. Lemma 10 (c j c j ) j C bad j N(T R ) 2c j. Adding his o he bound from Lemma 9 shows j N (T R T B ) (c j c j ) + j N(T R T B ) ( c j + 1 ) c j Case T R 2, T B + 1 Because φ 1 (i) TR and deg(i) > 0 for each i B, hen B 2 as well. We will swap all of TR for all of T R, bu we will also swap some blue faciliies a he same ime. Le B = B and le B be an arbirary subse of TB of size B. If î T R B hen add î o B. If cen(î) TR B hen add cen(î) o B. A his poin, B B 1 Add an arbirary i b T B B o B or i b T B B o B o ensure B = B. 14

15 We begin by swapping ou T R B and swapping in TR B. The following lis summarizes he imporan properies of his selecion, he firs poin emphasizes ha his swap will no improve he objecive funcion since S is a locally opimum soluion for he p-swap heurisic where p = B = B and T R 2. T R was swapped in and T R was swapped ou. For each i T R T B wih deg(i) > 0, i was swapped ou and cen(i) was swapped in. The following is precisely he cliens j ha will be moved o cen(φ(o j )) in our analysis. C bad := [N(T R B ) N (T R B )] {j : φ(o j ) T R B }. As before, define C ok = N(T R T B ) C bad. The following bound is generaed from swapping ou T R B and swapping in T R B and follows from he same argumens we have been using hroughou he paper. Lemma 11 (c j c j ) + j N (TR B ) j C ok N(T R B ) 2c j + j C bad (3c j + c j ) Nex, le κ B : (TB B ) (T B B ) be an arbirary bijecion of he remaining blue faciliies ha were no swapped. For every i b T B B, consider he effec of swapping in i b and swapping ou κ B (i b ). Noe ha every faciliy i b swapped ou in his way has deg(i b ) = 0. So we can derive wo possible inequaliies from such swaps. (c j c j ) + 2c j and (c j c j ) + 2c j. (4) j N (i b ) j N(κ B (i b )) j N(κ B (i b )) j N (i b ) C bad The second inequaliy follows from only reassigning cliens j N (i b ) C bad from s j o o j. Adding he bound in Lemma 11 o he sum of boh inequaliies in over all i b T B B and noing ha κ B (TB B) (T R B ) =, we see (c j c j ) + 4c j. j N (TR T B ) j N(T R T B ) 4 Localiy Gaps Here we prove Theorem 3. Le p, l be inegers saisfying p 1 and l 2p. Consider he insance wih k r = p + 1 and k b = p(l + 1) depiced in Figure 2. Here, β = 2p and α = β (l p). The cos of he local opimum soluion is α (p + 1) + β pl + p 2 (l + 1) and he cos of he global opimum soluion is simply p 2 (l + 1). Through some careful simplificaion, we see he local opimum soluion has cos a leas p 10p l+1 imes he global opimum soluion. 15

16 p +1 ` ` p î p imes p(` + 1) 1 Figure 2: Illusraion of he bad localiy gap. Blue faciliies are depiced wih black and red faciliies are depiced wih whie. The op faciliies are he global opimum and he boom are he local opimum (all of R and B is depiced in he picure). Each clien is represened by a small black do. The meric is he shores pah meric of he presened graph, if wo locaions are no conneced in he picure hen heir disance is a very large value. Every edge in he righ-mos group wih p 2 (l + 1) cliens has lengh 1. Recall β = 2p and α = (l p)2p. To complee he proof of Theorem 3, we mus verify ha he presened local opimum soluion indeed canno be improved by swapping up o p faciliies of each colour. We verify ha he soluion depiced in Figure 2 is indeed a locally opimum soluion. Suppose R p red faciliies and B p blue faciliies are swapped. We break he analysis ino four simple cases. In wha follows, we refer o he lefmos collecion of only red faciliies in Figure 2 as he lef group, he righmos collecion of only blue faciliies as he righ group, and he remaining faciliies as he middle group. We also le he erm subgroup refer o one of he p smaller collecions of faciliies in he middle group. In each case, le B B denoe he number of global opimum faciliies from he middle group ha are swapped in. Recall ha î denoes he local opimum faciliy in he lef group. Case R = 0 The only cliens ha can move o a closer faciliy are he B cliens in he middle group ha have heir associaed opimum faciliies swapped in. Also, precisely B (p B + B ) faciliies in he righ group are no adjacen o any open faciliy so heir assignmen cos increases by 2. Overall, he assignmen cos change is exacly 2B (p B + B ) βb. As β = 2p and B p, his quaniy is minimized a B = B leaving us wih a cos change of 2Bp βb = 0. So, if R = 0 hen no choice of blue faciliies leads o an improving swap. Case R 1 and î is no swapped ou. In he lef group, precisely R cliens move o heir close faciliy and he oal savings is αr. In he middle group, precisely B cliens move o heir close faciliy and he oal savings is βb. 16

17 In fac, i is easy o see ha he cheapes such swap occurs when he B p l faciliies in he middle group ha are swapped in are par of subgroups where he local opimum faciliy is swapped ou (which is why we assume R 1). So, here are exacly Rl B oher cliens j where boh o j and s j are closed and each pays an addiional β o be conneced. Finally, he righ group pays an addiional 2B(p B + B ) o be conneced. Overall, he cos increases by 2B(p B +B )+β(rl 2B ) αr. As 2B 2β = 2B 4p 2p, his is minimized a B = B. The cos change is hen 2Bp+β(Rl 2B) αr. Recall ha α = (l p)β < lβ, so his is, in urn, minimized when R = 1. Reducing furher, he cos change is 2Bp + βl 2Bβ α. Seing B = p o maximize, he change is 2p 2 + 2pl 4p 2 (l p)2p = 0. So, no swap ha swaps a leas one red faciliy bu no î can find a cheaper soluion. Case R = 1 and î is swapped ou. The cos change in he lef group is (p 1)α 0 since p cliens mus move an addiional α and only one clien saves α. The cos change from he remaining groups is he same as in he firs case R = 0, so he overall assignmen cos does no decrease. Case R 2 and î is swapped ou. The cos change in he firs group is exacly (p + 1 2R)α. Similar o he second case, he cos change in his case is minimized when each subgroup ha has is local opimum faciliy closed also has one of is global opimum faciliy opened, and all B faciliies opened in he middle group belong o a subgroup having is local opimum closed. The cos change is hen 2B(p B +B )+β((r 1)l 2B )+α(p+1 2R). Again, his is minimized a B = B which yields a cos change of 2Bp + β((r 1)l 2B) + α(p + 1 2R). Now, βl 2α because l 2p, so his is furher minimized a R = p and he cos increase is 2Bp+β((p 1)l 2B) α(p 1). Again, seing B = p o minimize he cos change we see i is 2p 2 + β((p 1)l 2p) α(p 1). Expanding wih β = 2p and α = 2p(l p), he cos change finally seen o be The las expression is nonnegaive for p 2. 2p 2 + 2p(p 1)l 2p(l p)(p 1) = 2p 3 4p Summarizing No maer which p red and p blue faciliies are swapped, he above analysis shows he assignmen cos does no decrease. The only poenially concerning aspec is ha he very las case derived an inequaliy ha only holds when p 2. Sill, his analysis does apply o he single-swap case (i.e. p = 1) since he las case wih R 2 does no need o be considered when p = 1. 17

18 5 Conclusion We have demonsraed ha a naural p-swap local search procedure for Budgeed Red-Blue Median is a (5 + O(1/ p))-approximaion. This guaranees a beer approximaion raio han he single-swap heurisic from [9], which we showed may find soluions whose cos is (7 ɛ) OP T for arbirarily small ɛ. Our analysis is essenially igh in ha he p-swap heurisic may find soluions whose cos is (5 + 2 p ɛ) OP T. More generally, one can ask abou he p-swap heurisic for he generalizaion where here are many differen faciliy colours. If he number of colours is par of he inpu hen any local search procedure ha swaps only a consan number of faciliies in oal canno provide good approximaion guaranees [10]. However, if he number of differen colours is bounded by a consan, hen perhaps one can ge beer approximaions hrough muliple-swap heurisics. However, generalizing he approaches aken wih Budgeed Red-Blue Median o his seing seems more difficul; one challenge is ha i is no possible o ge such nicely srucured blocks. I would also be ineresing o see wha oher special cases of Maroid Median admi good local-search based approximaions. For example, he Mobile Faciliy Locaion problem sudied in [2] is anoher special case of Maroid Median ha admis a (3 + ɛ)-approximaion hrough local search. Finally, he localiy gap of he p-swap heurisic for k-median is known o be p [3] and we have jus shown i is a leas p for Budgeed Red-Blue Median. Even if he muliple-swap heurisic for he generalizaion o a consan number of colours can provide a good approximaion, his consan may be worse han he alernaive 8-approximaion obained hrough Swamy s general Maroid Median approximaion [15]. References [1] A. Aggarwal, L. Anand, M. Bansal, N. Garg, N. Gupa, S. Gupa, and S. Jain. A 3-approximaion for faciliy locaion wih uniform capaciies. In Proc. of IPCO, [2] S. Ahmadian, Z. Friggsad, and C. Swamy. Local search heurisics for he mobile faciliy locaion. In Proc. of SODA, [3] V. Arya, N. Garg, R. Khandekar, A. Meyerson, K. Munagala, and V. Pandi. Local search heurisics for k-median and faciliy locaion problems. SIAM J. Compu, 33(3): , [4] M. Bansal, N. Garg, N. Gupa. A 5-approximaion for capaciaed faciliy locaion. In Proc. of ESA, [5] J. Byrka, T. Pensyl, B. Rybicki, A. Srinivasan, and K. Trinh. An improved approximaion for k-median, and posiive correlaion in budgeed opimizaion. In Proc. of SODA, [6] M. Charikar and S. Guha. Improved combinaorial algorihms for faciliy locaion problems. SIAM J. Compu, 34(4): ,

19 [7] I. Gørz and V. Nagarajan. Locaing depos for capaciaed vehicle rouing. In Proc. of APPROX, [8] A. Gupa and K. Tangwongsan. Simpler analysis of local search algorihms for faciliy locaion. CoRR, abs/ , [9] M. Hajiaghayi, R. Khandekar, and G. Korsarz. Local search algorihms for he red-blue median problem. Algorihmica, 63(4): , [10] R. Krishnaswamy, A. Kumar, V. Nagarajan, Y. Sabharwal, and B. Saha. The maroid median problem. In Proc. of SODA, 2011 [11] S. Li and O. Svensson. Approximaing k-median via pseudo-approximaion. In Proc. of STOC, [12] M. Mahdian and M. Pál. Universal faciliy locaion In Proc. of ESA, [13] M. Pál, É. Tardos, and T. Wexler. Faciliy locaion wih nonuniform hard capaciies. In Proc. of FOCS, [14] Z. Svikina and É. Tardos. Faciliy locaion wih hierarchical faciliy coss. ACM Transacions on Algorihms, 6(2), [15] C. Swamy. Improved approximaion algorihms for maroid and knapsack problems and applicaions. In Proc. of APPROX,