Convex Programming for Scheduling Unrelated Parallel Machines

Size: px
Start display at page:

Download "Convex Programming for Scheduling Unrelated Parallel Machines"

Transcription

1 Convex Prograing for Scheduling Unrelated Parallel Machines Yossi Azar Air Epstein Abstract We consider the classical proble of scheduling parallel unrelated achines. Each job is to be processed by exactly one achine. Processing job j on achine i requires tie p ij. The goal is to find a schedule that iniizes the l p nor. Previous work showed a 2-approxiation algorith for the proble with respect to the l nor. For any fixed l p nor the previously known approxiation algorith has a perforance of θ(p). We provide a 2-approxiation algorith for any fixed l p nor (p > 1). This algorith uses convex prograing relaxation. We also give a 2-approxiation algorith for the l 2 nor. This algorith relies on convex quadratic prograing relaxation. To the best of our knowledge, this is the first tie that general convex prograing techniques (apart fro SDPs and CQPs) are used in the area of scheduling. We show for any given l p nor a PTAS for any fixed nuber of achines. We also consider the ultidiensional generalization of the proble in which the jobs are d-diensional. Here the goal is to iniize the l p nor of the generalized load vector, which is a atrix where the rows represent the achines and the coluns represent the jobs diension. For this proble we give a (d + 1)-approxiation algorith for any fixed l p nor (p > 1). 1 Introduction We consider the classical proble of scheduling jobs on parallel unrelated achines. Lenstra et. al [14] and Shoys and Tardos [16] provided a 2-approxiation algorith for iniizing the akespan (l nor). However, for the l p nor only θ(p)-approxiation algorith was known (see [2]). We provide a 2-approxiation algorith for any l p nor. In addition we show a 2-approxiation algorith for the l 2 nor. Our approxiation algoriths are based on convex prograing relaxations. To the best of our knowledge, this is the first tie that general convex prograing techniques (apart fro SDPs and CQPs) are used in the area of scheduling. Seidefinite prograing (SDP) and convex quadratic prograing (CQP) are special cases of convex prograing (CP). Given any ǫ > 0 convex progras can be solved within an additive error of ǫ under soe requireents on the convex objective function and on the feasible space. This can be done through the ellipsoid algorith (Grötschel et. al [9]) and ore efficiently using interior-point ethods (see e.g, Nesterov and Neirovsky [15]). Linear prograing (LP) relaxations have been proved to be a useful tool in the design and analysis of approxiation algoriths for any graph and cobinatorial probles. There are several applications of linear prograing relaxations for achine scheduling probles, see, e.g., [14, 16, 10, 4, 5]. The iportance of seidefinite prograing is that soeties it leads to tighter relaxations for any graph and cobinatorial probles. Grötchel et. al [8] used seidefinite prograing to design a polynoial tie algorith for finding the largest stable set in a perfect graph. Goeans and School of Coputer Science, Tel-Aviv University. azar@tau.ac.il. Supported in part by Geran-Israeli Foundation and by the Israel Science Foundation. School of Coputer Science, Tel Aviv University. airep@tau.ac.il. Supported in part by the Geran-Israeli Foundation and by the Israel Science Foundation. 1

2 Williason [7] were the first to use seidefinite prograing relaxations in the design of approxiation algoriths. They used seidefinite relaxations for the probles MAXCUT, MAXDICUT and MAX2SAT. Convex quadratic prograing and seidefinite prograing relaxations in the area of scheduling were first used by Skutella [17]. He used convex quadratic prograing relaxations to design approxiation algoriths for the proble of scheduling unrelated parallel achines so as to iniize total weighted copletion tie of jobs. Techniques: In the design of the 2-approxiation algorith for scheduling jobs on unrelated achines we forulate the proble as a convex progra, where the objective function is the l p nor (p > 1). The obvious CP relaxation yields a large integrality gap. To overcoe this proble we odify the objective function of the CP. The new objective function yields a bounded gap. Our rounding technique is based on the rounding technique of Shoys and Tardos for the generalized assignent proble [16]. They used this rounding technique for the case of l nor. However, they did not need to use the extra property of not increasing the cost. Interestingly in our rounding ethod for the l p nor we need to use this extra property. We use their technique in an enhanced anner using the additional ter in the odified objective function of the convex progra as the cost of the fractional weighted atching of the bipartite graph they for. Then we exploit the property That there exists an integral atching with no greater cost. This atching defines the schedule of the jobs. For the l 2 nor we use the sae convex progra together with randoized rounding to obtain a 2-approxiation algorith. For any l p nor we also design a slightly better than a 2-approxiation algorith for the restricted assignent odel by using a bootstrapping of a 2-approxiation algorith. Additionally we use convex prograing relaxation in the design of a PTAS to the proble. 1.1 Proble Definition We have parallel achines and n independent jobs, where job j takes positive integral processing tie p ij when processed by achine i. The load of achine is the total processing tie required for the jobs assigned to it. The cost of an assignent for an input sequence of jobs is defined as the l p nor of the load vector. Specifically, the l nor is the akespan (or axiu load) and the l 2 nor is the Euclidean nor, which is equivalent to the su of the squares of the load vector. The goal of an assignent algorith is to assign all the jobs so as to iniize the cost. Consider for exaple the case where the weight of a job corresponds to its achine disk access frequency. Each job ay see a delay that is proportional to the load on the achine it is assigned to. Then the average delay over all disk accesses is proportional to the su of squares of the achines loads (naely the l 2 nor of the corresponding achines load vector) whereas the axiu delay is proportional to the axiu load. 1.2 Our Results We show the following results for scheduling jobs on unrelated achines: A 2-approxiation polynoial algorith for the general proble for any given l p nor (p > 1). This iproves the previous θ(p) approxiation algorith given in [2]. A 2-approxiation polynoial algorith for the l 2 nor for the proble, iproving the previous approxiation algorith given in [2]. A PTAS for fixed nuber of achines for any given l p nor with space which is polynoial in both 1 ǫ and (and the input size). We also consider a generalization of the proble and a special case of the proble and obtain the following results: 2

3 We consider the case in which jobs are d-diensional and show a d + 1-approxiation algorith. We consider the restricted assignent odel where each job has a size and should be assigned to one out of soe subset of achines. For this proble we show a slightly better than a 2-approxiation algorith for any l p nor. 1.3 Previous Results Lenstra et. al [14] and Shoys and Tardos [16] presented a 2-approxiation algorith for the akespan, however their algorith does not guarantee any constant approxiation ratio to optial solutions for any other nors (it is easy to coe up with a concrete exaple to support that). For any given l p nor the only previous approxiation algorith for unrelated achines, presented by Awerbuch et al. [2], has a perforance of θ(p) (this algorith was presented as an on-line algorith). Our ain result is a 2-approxiation polynoial algorith for any given l p nor (p > 1). It is also known that there is no approxiation polynoial algorith for the l nor with ratio better then 3/2 (see [14]). In addition the proble is AP X-Hard for any fixed p (see [3]). These hardness results hold for the restricted assignent odel as well. For the l 2 nor the only previous approxiation algorith for unrelated achines, presented by Awerbuch et al. [2], has a perforance of (this algorith was presented as an on-line algorith). We iprove this result by providing a 2-approxiation polynoial algorith for the l 2 nor. Recall that for the l p nor (p > 1) the proble of scheduling in the restricted assignent odel is APX-hard. Thus, there is no PTAS for the proble unless (P = NP ). However, if the nuber of achines is fixed a PTAS can be achieved. We present a PTAS for any given nor and any fixed nuber of achines with better space coplexity then the FPTAS presented for the proble in [3]. Note that for iniizing the akespan Horowitz and Sahni [13] presented a FPTAS for any fixed nuber of achines. Lenstra et al. [14] suggested a PTAS for the sae proble (i.e. iniizing the akespan) with better space coplexity. Our algorith for the restricted assignent odel has an approxiation ratio of 2 Ω( 1 2 p ). Previously, Azar et al. [3] presented an all-nor 2-approxiation polynoial algorith which provides a 2-approxiation to all nors siultaneously. Their algorith gives a 2-approxiation to any fixed l p nor. Our iproved algorith uses their algorith recursively. For d-diensional jobs we present a (d + 1)-approxiation algorith for any fixed diension d and any fixed l p nor (p > 1). This is in contrast to the θ(p) algorith that can be obtained fro [2]. Other related results: Other scheduling odels have also been studied. For the identical achines odel, where each job has an associated weight and can be assigned to any achine, Hochbau and Shoys [12] presented a PTAS for the case of iniizing the akespan. Later, Alon et al. [1] showed a PTAS for any l p nor in the identical achines odel. For the related achines odel, in which each achine has a speed and the achine load equals the su of jobs weights assigned to it divided by its speed, Hochbau and Shoys [11] presented a PTAS for the case of iniizing the akespan. Epstein and Sgall [6] showed a PTAS for any l p nor in the sae odel. 1.4 Paper Structure In Section 3 we present our approxiation algorith for any l p nor. In Section 4 we present an approxiation algorith for the l 2 nor. In section 5 we give for any given l p nor a slightly better approxiation algorith for the restricted assignent odel. In section 6 we construct for any given l p nor a PTAS for any fixed nuber of achines. In Section 7 we consider the ultidiensional 3

4 generalization of the proble and for this proble we present an approxiation algorith for any l p nor. 2 The Approxiation Algorith (p > 1) 2.1 Convex Prograing Forulation We define the following iniization proble in the unrelated achines odel, where there is a fixed processing tie p ij associated with each achine i = 1,..., and each job j = 1,...,n. Integer solutions to the following convex progra (CP1) give the optial schedules. in t p i x ij = 1 for j = 1,...,n x ij p ij t i = 0 for i = 1,..., x ij 0 for j = 1,...,n, i = 1,...,, where for each achine i = 1,..., and each job j = 1,...,n the variable x ij denotes the relative fraction of job j on achine i and for each achine i = 1,..., the variable t i denotes the load of achine i. We denote the optiu integer solution by OPT p, which is the optiu l p nor to the power of p and OPT is the optiu l p nor. Because of solving convex progra requireents, we change the linear equality constraints of the convex progra to linear inequality constraints, which does not change the optial solution value as follows x ij 1 for j = 1,...,n x ij p ij t i 0 for i = 1,..., x ij 0 for j = 1,...,n, i = 1,...,. This CP relaxation has large integrality gap. To overcoe this proble we odify the objective function in a way which also helps us in our rounding technique as follows. Let g(t ) = tp i be the original objective function. We call it the l p nor function. Let c(x ) = n x ijp p ij be the cost function. Our odified objective function is f(x, t ) = g(t ) + c(x ) and the objective is in f(x, t ). We call the odified convex progra (CP2). Solvability of Convex Progra: Convex progra can be solved within an additive error of ǫ in polynoial tie for any given ǫ > 0 when the feasible region is a convex copact set with nonepty interior (i.e. nonzero volue) under soe requireents (see, e.g., [9, 15]). Specifically, it can be solved for iniizing an objective function which is convex and differentiable if we have a (polynoial tie) separation oracle for the feasible set and the possibility to copute the objective and its subgradient at a given point (in polynoial tie). When these requireents hold we can use for exaple the ellipsoid algorith to solve the optiization iniization proble. To ipleent the ellipsoid algorith we use the separation oracle for the feasible set and the fact that the objective 4

5 function is convex and differentiable. Specifically, we can copute the subgradient, at any given point to obtain a separation half-space to exclude points that are not in the optial set. Since all the constraints in (CP2) are linear inequalities the feasible region is convex. Moreover, the separation oracle is easy to ipleent. Also it is easy to see that the feasible region has a positive volue. The objective function is su of convex functions and hence convex. Moreover, it is easy to copute its value and its subgradient at a given point. Hence, (CP2) is solvable in polynoial tie for any accuracy. We note that in the first proof we show how to overcoe the additive error of ǫ that results fro solving the convex progra. In all other proofs we assue that we get the exact solution to the convex progra, since we can easily overcoe the additive error of ǫ as done in the first proof. Lea 2.1 Let x, t be an optiu solution to (CP2), with value f(x, t ). Then f(x, t ) 2OPT p. Proof: A possible feasible solution to (CP2) is the optiu integer solution to (CP1) denoted by x 0, t 0. For this solution g(t 0) = OPTp, c(x 0 ) OPTp and f(x, t ) f(x 0, t 0), where the first inequality follows fro the fact that for a feasible integer solution to (CP1) denoted by x, holds t g(t ) = (t i )p = ( x ij p ij) p x ij pp ij = c(x ). Hence f(x, t ) f(x 0, t 0) = g(t 0) + c(x 0) 2OPTp. This copletes the proof. 2.2 Convex Prograing Rounding Theore 2.1 The fractional solution to (CP2) can be rounded in polynoial tie to an integral assignent which gives a value which is at ost twice of the optiu for the l p nor. Proof: Given the fractional assignent {x ij } we will show how to construct the desired integral assignent {ˆx ij } in polynoial tie. We use the sae rounding algorith used by Shoys and Tardos for the Generalized Assignent Proble [16]. They showed how to convert a fractional solution {x ij } to an integer solution {ˆx ij } which satisfies the following ˆt i t i + q i ˆx ij c ij x ij c ij, where q i is the size the largest job assigned to achine i by the integral assignent {ˆx ij } and c ij is the cost of job j on achine i. We define c ij = p p ij. Then we obtain x ij c ij = x ij p p ij which is the cost ter in the objective function of (CP2). Now we use the sae rounding procedure defined above with the linear cost function defined by the coefficients c ij. Next we show that the l p nor of the schedule constructed is at ost twice of the optiu g(ˆt ) = ˆt p i (t i + q i ) p 2 p 1 (t p i + qp i ) = 2p 1 ( t p i + q p i ) 2 p 1 ( t p i + ˆx ij p p ij ) 2p 1 ( t p i + = 2 p 1 f(x, t ) 2 p 1 (2OPT p + ǫ) = 2 p OPT p + 2 p 1 ǫ. 5 x ij p p ij )

6 The first inequality follows fro the fact that the load on each achine i is not greater then t i + q i. The second inequality follows fro the inequality (x + y) p 2 p 1 (x p + y p ). The fourth inequality follows fro the fact that ˆx ij p p ij x ij p p ij. The last inequality follows fro Lea 2.1 and the fact that we get an optial solution to (CP2) up to an additive error of ǫ. By choosing ǫ = 1 2 p we get g(ˆt ) 2 p OPT p Since g(ˆt ) and OPT p are positive integral nubers we obtain This copletes the proof. (g(ˆt )) 1 p 2OPT. The proof of the following theore appears in the Appendix. Theore 2.2 ) The approxiation ratio provided by the approxiation algorith is lower bounded by 2 O. ( lnp p 3 Approxiation Algorith (p = 2) The odified objective function of (CP2) for the case p = 2 is in t 2 i + x ij p 2 ij, which gives a convex quadratic progra (CQP) that can be solved within an additive error of ǫ in polynoial tie for any given ǫ > 0. We use randoized rounding: each job j is assigned independently at rando to one of the achines with probabilities given through the values {x ij }; notice that x ij = 1. We denote the obtained integral assignent by {ˆx ij }. Lea 3.1 For the solution {ˆx ij } obtained by randoized rounding: E[ˆt 2 i ] (E[ˆt i ]) 2 = x i,j (1 x i,j )p 2 i,j. Proof: We have E[ˆt 2 i ] (E[ˆt i ]) 2 = V ar[ˆt i ] = x i,j (1 x i,j )p 2 i,j. The first equality follows fro the definition of the variance. The second equality follows fro the linearity of expectation and the independence of the indicator rando variables ˆx ij and ˆx ik for j k. This copletes the proof of the Lea. 6

7 Theore 3.1 The fractional solution to (CQP) can be rounded in polynoial tie to an integral assignent which gives a value which is at ost 2 of the optiu for the l p nor. Proof: We have E[g(ˆt )] = E[ ˆt 2 i ] = E[ˆt 2 i ] = (E[ˆt i ]) 2 + = t 2 i + = f(x, t ) 2OPT 2. x i,j (1 x i,j )p 2 i,j t 2 i + x i,j (1 x i,j )p 2 i,j x i,j p 2 i,j The second equality follows fro the linearity of expectation. The third equality follows fro Lea 3.1 and the last inequality follows fro Lea 2.1. Hence This copletes the proof. (E[g(ˆt )]) 1 2 2OPT. The randoized rounding algorith can easily be derandoized by the ethod of conditional probabilities. 4 Slightly Better Approxiation Algorith for the Restricted Assignent Model (p > 1) Now we turn to the restricted assignent odel. For iproving the 2-Approxiation algorith for the restricted assignent odel we can use either the approxiation algorith presented in the previous section for unrelated achines with its rounding schee or the 2-Approxiation algorith presented by Azar et al. [3] with its rounding schee. When we use the first algorith we denote by H 1 the schedule that contains all the jobs assigned to each achine except the biggest job assigned to each achine. We denote by H 2 the schedule consisting of the big jobs that are not in H 1. When using the latter algorith and its rounding schee which has two phases, we denote by H 1 the schedule consisting of the jobs assigned in the first rounding phase and we denote by H 2 the schedule consisting of the jobs assigned in the second rounding phase. This schedule assigns only one job per achine. We denote by OPT(H 1 ) the optial schedule of the jobs in H 1. We denote by OPT the optial schedule. We have: OPT p H 1 p, (1) OPT p H 2 p, (2) OPT p OPT(H 1 ) p + H 2 p. (3) Now we apply the 2-approxiation algorith for the jobs in H 1, which returns a new schedule H 3. We define the schedule H returned by the algorith as follows: { H1 + H H = 2 H 1 + H 2 p H 2 + H 3 p H 2 + H 3 otherwise 7

8 Next we prove the approxiation ratio of the approxiation algorith. Let ǫ > 0 to be deterined. We consider two cases: If H 2 p (1 ǫ) OPT p then H p H 1 + H 2 p 2 p 1 ( H 1 p + H 2 p ) 2 p 1 ( OPT p + (1 ǫ) OPT p ) = 2 p 1 (2 ǫ) OPT p, where the first inequality follows fro the inequality (x + y) p 2 p 1 (x p + y p ). If H 2 p > (1 ǫ) OPT p we obtain the following: It follows fro (3) that OPT(H 1 ) p ǫ OPT p, hence We obtain H 3 p 2 p OPT(H 1 ) p 2 p ǫ OPT p. H p H 2 + H 3 p 2 p 1 ( H 2 p + H 3 p ) 2 p 1 ( OPT p + 2 p ǫ OPT p ) = 2 p 1 (1 + 2 p ǫ) OPT p. We choose ǫ = 2 p+1, which gives { H p ax 2 p 1 (2 1 } 2 p+1),2p 13 OPT p = (2 p ) OPT p. Hence The following theore suarize the result. H OPT 2(1 1 4p2 p) = 2 1 2p2 p. Theore 4.1 For the restricted assignent odel there is a 2 1 2p2 p approxiation algorith for the l p nor that runs in polynoial tie. 5 PTAS for any fixed nuber of achines and a given l p nor We describe a polynoial tie approxiation schee for any fixed nuber of achines and a given l p nor, i.e. (1 + ǫ)-approxiation algorith for any ǫ > 0 running in polynoial tie. The running tie of the algorith will be bounded by a function that is the product of (n + 1) 2 /ǫ and a polynoial in the size of the input. By the hardness of approxiation result presented in [3], there is no approxiation schee (PTAS or FPTAS) for a given nor and any nuber of achines unless P = NP. Azar et al. [3] showed a fully polynoial tie approxiation schee which is a odification of the ethod presented initially by Horowitz and Sahni in [13]. Our PTAS is a odification of the algorith constructed by Lenstra et. al [14]. The significance of the new algorith is the iproveent in space usage. The space required by the old schee is (n + 1) /ǫ whereas the new schee uses space that is polynoial in both 1 ǫ and (and the input size). For any ǫ > 0 our algorith is as follows: We consider a scheduling proble in the unrelated achines odel, when there is a fixed processing tie p ij associated with each achine i = 1,..., and each job j = 1,...,n. We consider the decision version of the proble with l p nor at ost T. 8

9 For any schedule for the instance with value T, we classify the assignent of a job to a achine as either long or short, depending on whether or not the processing tie in question is greater then ǫt/. No achine can handle /ǫ or ore long assignents before tie T. Thus, for any instance there are less than (n + 1) 2 /ǫ schedules of long assignents. Consider an instance with value T that has a feasible schedule. Let t i be the total processing tie on achine i for that schedule. This schedule includes a partial schedule of long assignents. Suppose that for achine i the long assignents aount to a total processing tie l i, and thus the reaining jobs are copleted within tie d i = t i l i. We define t = ǫt/ For assigning the reaining jobs we solve the following convex progra in t p i x ij 1 for j = 1,...,n x ij p ij t i + l i 0 for i = 1,..., x ij 0 for j = 1,...,n, i = 1,..., x ij = 0 if p ij > t j = 1,...,n, i = 1,..., We present the following theore, which is siilar to a theore given in [16] and has the sae proof. Theore 5.1 If the convex progra has a feasible solution with value less then or equals to T p, then there exists a schedule with l p nor at ost T, such that each achine i has load of at ost t i + t. We see that the convex progra ust have a feasible solution, so that we can apply theore 5.1. The resulting integral solution yields a schedule of short assignents such that the total processing tie taken by short assignents to achine i is at ost t i l i + ǫt/. Cobining this with the schedule of long assignents, we get a schedule where the total tie used by achine i is at ost l i + t i l i + ǫt/ = t i + ǫt/. For the l p nor we obtain t i + ǫt/ t i + ǫt/ T + ǫt = (1 + ǫ)t. We try all possible schedules of long assignents. For each schedule of long assignents we solve the convex progra and apply theore 5.1. If we obtained a schedule using theore 5.1, we return this schedule which has l p nor at ost (1+ǫ)T. Otherwise we answer no. The following theore gives the result. Theore 5.2 The described algorith is a PTAS that requires tie bounded by a polynoial in, log 1/ǫ, and the input size. 6 Approxiation Schee for Multidiensional Jobs (p > 1) We generalize the proble, by defining ultidiensional jobs. In the new proble we consider scheduling parallel unrelated achines. Each job is d-diensional and has to be processed by exactly one achine. Processing job j on achine i in diension k requires tie p ikj. The goal is to find a schedule that iniizes the l p nor of the generalized load vector, which is a atrix where the rows represent the achines and the coluns represent the jobs diension. 9

10 6.1 Convex Prograing Forulation Integer solutions to the following convex progra (CP3) give the optial schedules, where the value of the l p nor of the optial schedule is T 1 p. inf(t ) = d k=1 t p ik x ij 1 for j = 1,...,n x ij p ikj t ik 0 for i = 1,...,, k = 1,...,d c(x ) = d k=1 x ij p p ikj T x ij 0 for j = 1,...,n, i = 1,..., We call the function c(x ) the cost function. 6.2 Convex Prograing Rounding Theore 6.1 If (CP3) has a feasible solution with l p nor value at ost T 1 p, then the fractional solution to (CP3) can be rounded in polynoial tie to an integral assignent which gives a value which is at ost (d + 1)T 1 p for the l p nor. Proof: Given the fractional assignent {x ij } we will show how to construct the desired integral assignent {ˆx ij } in polynoial tie. We ove to the 1-diensional proble by defining 1-diensional d d jobs p ij = p ikj. The load of achine i denoted by t i is t i = t ik. Now for the new 1- k=1 diensional proble instance, we use the fractional solution obtained for the d-diensional instance and we perfor the sae rounding procedure we used for the 1-diensional case, but now We define c ij = d k=1 pp ikj. Then we obtain d x ij c ij = x ij which is the cost function c(x ). After perforing the rounding we return to the original d-diensional jobs. Let {ˆt ik } be the load of achine i in diension k after the rounding, let {ˆq ik } be the processing tie in diension k of the largest job that was atched to achine i by the integral assignent {ˆx ij } and let t ik = ˆt ik ˆq ik. We obtain the following: k=1 k=1 p p ikj ˆt p = t + ˆq p t p + ˆq p d t p + ˆq p Let t i = = d t p + ˆq p dt 1 p + T 1 p = (d + 1)T 1 p. d t ik. The second inequality follows fro the fact that after the rounding t i t i, the k=1 pigeonhole principle and the convexity of the l p nor. The last inequality follows fro the fact that f(t ) T, c(x ) T and the fact that c(ˆx ) c(x ). This copletes the proof. 10

11 References [1] N. Alon, Y. Azar, G. Woeginger, and T. Yadid. Approxiation schees for scheduling on parallel achines. Journal of Scheduling, 1(1):55 66, [2] B. Awerbuch, Y. Azar, E. Grove, M. Kao, P. Krishnan, and J. Vitter. Load balancing in the l p nor. In Proc. of the 36th Annual Syposiu on Foundations of Coputer Science (FOCS95), pages , [3] Y. Azar, L. Epstein, Y. Richter, and G. Woeginger. All-nor approxiation algoriths. In Proc. 8th Scandinavian Workshop on Algorith Theory (SWAT), pages , [4] S. Chakrabarti, C. A. Phillips, A. S. Schulz, D. B. Shoys, C. Stein, and J. Wein. Iproved scheduling algoriths for insu criteria. In Proc. 23rd International Colloquiu on Autoata, Languages and Prograing, pages , [5] F.A. Chudak and D.B. Shoys. Approxiation algoriths for precedence constrained scheduling probles on parallel achines that run at different speeds. Journal of Algoriths, 30: , [6] L. Epstein and J. Sgall. Approxiation schees for scheduling on uniforly related and identical parallel achines. In Proc. 7th Annual European Syposiu on Algoriths, pages , [7] M.X. Goeans and D.P Williason. Iproved approxiation algoriths for axiu cut and satisfiability probles using seidefinite prograing. Journal of the Association for Coputing Machinery, 42: , [8] M. Grötschel, L. Lovasz, and A. Schrijver. The ellipsoid ethod and its consequences in cobinatorial optiization. Cobinatorica, 1: , (Corrigendu:4(1984), ). [9] M. Grötschel, L. Lovasz, and A. Schrijver. Geoetric Algoriths and Cobinatorial Optiization. Springer-Verlag, [10] L. Hall, A. Schulz, D. Shoys, and J. Wein. Scheduling to iniize average copletion tie: Off-line and on-line approxiation algoriths. Matheatics of Operations Research, 22: , [11] D. Hochbau and D. Shoys. A polynoial approxiation schee for scheduling on unifor processors: Using the dual approxiation approach. SIAM Journal on Coputing, 17(3): , [12] D. S. Hochbau and D. B. Shoys. Using dual approxiation algoriths for scheduling probles: Theoretical and practical results. J. Assoc. Coput. Mach., 34(1): , January [13] E. Horowitz and S. Sahni. Exact and approxiate algoriths for scheduling non-identical processors. Journal of the Association for Coputing Machinery, 23: , [14] J.K. Lenstra, D.B. Shoys, and E. Tardos. Approxiation algoriths for scheduling unrelated parallel achines. Math. Prog., 46: , [15] Y. Nesterov and A. Neirovskii. Interior-point polynoial algoriths in convex prograing. SIAM Studies in Applied Matheatics. SIAM,

12 [16] D. Shoys and E. Tardos. An approxiation algorith for the generalized assignent proble. Matheatical Prograing A, 62: , Also in the proceeding of the 4th Annual ACM-SIAM Syposiu on Discrete Algoriths, [17] M. Skutella. Convex quadratic and seidefinite prograing relaxations in scheduling. Journal of the Association for Coputing Machinery, 48(2): , A Appendix A.1 Proof of Theore 2.2 Let. We construct proble instance for the identical achines odel. We consider the achines as points in the interval (0,1], each achine is represented by a point t (0,1], and the load of the achines is represented as a function f(t) in that interval. Let 0 < α < 1. We consider the following instance. There are infinitesially sall jobs of total volue 1 α and unit jobs of total volue α. The optial schedule has l p nor 1 and there is no better fractional assignent. The optial algorith assigns the unit jobs of total volue α evenly to α achines and assigns the infinitesially sall jobs of total volue 1 α evenly to the other 1 α achines. Suppose that the fractional schedule is as follows: The infinitesially sall jobs of total volue 1 α are assigned evenly to all the achines and the unit jobs of total volue α are also assigned evenly to all the achines (α fraction of a unit job is assigned to each achine). Rounding this fractional solution gives the following schedule: The infinitesially sall jobs of total volue 1 α are assigned evenly to all the achines and the unit jobs of total volue α are assigned evenly to α achines (one unit job is assigned to each of these achines). Let A and Opt be the l p nors of the approxiation and off-line algoriths respectively and let C be the approxiation ratio of the algorith. A p = α(2 α) p + (1 α)(1 α) p = α(2 α) p + (1 α) p+1 Opt p = α1 p + (1 α)1 p = 1 ( ) A p C p = α(2 α) p + (1 α) p+1 Opt We choose α = 1 p and we obtain C p 1 p ( 2 p) 1 p ( ) p+1 1 ( 2 1 p. p p p) Hence C ( )1 ( 1 p 2 1 ) ( = e ln p p 2 1 ) ( 1 ln p )( 2 1 ) = 2 O p p p p p ( ln p p ), where the second inequality follows fro the inequality e x 1 x. This copletes the proof. 12

List Scheduling and LPT Oliver Braun (09/05/2017)

List Scheduling and LPT Oliver Braun (09/05/2017) List Scheduling and LPT Oliver Braun (09/05/207) We investigate the classical scheduling proble P ax where a set of n independent jobs has to be processed on 2 parallel and identical processors (achines)

More information

Bipartite subgraphs and the smallest eigenvalue

Bipartite subgraphs and the smallest eigenvalue Bipartite subgraphs and the sallest eigenvalue Noga Alon Benny Sudaov Abstract Two results dealing with the relation between the sallest eigenvalue of a graph and its bipartite subgraphs are obtained.

More information

All-norm Approximation Algorithms

All-norm Approximation Algorithms All-norm Approximation Algorithms Yossi Azar Leah Epstein Yossi Richter Gerhard J. Woeginger Abstract A major drawback in optimization problems and in particular in scheduling problems is that for every

More information

Stochastic Machine Scheduling with Precedence Constraints

Stochastic Machine Scheduling with Precedence Constraints Stochastic Machine Scheduling with Precedence Constraints Martin Skutella Fakultät II, Institut für Matheatik, Sekr. MA 6-, Technische Universität Berlin, 0623 Berlin, Gerany skutella@ath.tu-berlin.de

More information

Lecture 21. Interior Point Methods Setup and Algorithm

Lecture 21. Interior Point Methods Setup and Algorithm Lecture 21 Interior Point Methods In 1984, Kararkar introduced a new weakly polynoial tie algorith for solving LPs [Kar84a], [Kar84b]. His algorith was theoretically faster than the ellipsoid ethod and

More information

On the Inapproximability of Vertex Cover on k-partite k-uniform Hypergraphs

On the Inapproximability of Vertex Cover on k-partite k-uniform Hypergraphs On the Inapproxiability of Vertex Cover on k-partite k-unifor Hypergraphs Venkatesan Guruswai and Rishi Saket Coputer Science Departent Carnegie Mellon University Pittsburgh, PA 1513. Abstract. Coputing

More information

A Note on Scheduling Tall/Small Multiprocessor Tasks with Unit Processing Time to Minimize Maximum Tardiness

A Note on Scheduling Tall/Small Multiprocessor Tasks with Unit Processing Time to Minimize Maximum Tardiness A Note on Scheduling Tall/Sall Multiprocessor Tasks with Unit Processing Tie to Miniize Maxiu Tardiness Philippe Baptiste and Baruch Schieber IBM T.J. Watson Research Center P.O. Box 218, Yorktown Heights,

More information

Algorithms for parallel processor scheduling with distinct due windows and unit-time jobs

Algorithms for parallel processor scheduling with distinct due windows and unit-time jobs BULLETIN OF THE POLISH ACADEMY OF SCIENCES TECHNICAL SCIENCES Vol. 57, No. 3, 2009 Algoriths for parallel processor scheduling with distinct due windows and unit-tie obs A. JANIAK 1, W.A. JANIAK 2, and

More information

arxiv: v1 [cs.ds] 3 Feb 2014

arxiv: v1 [cs.ds] 3 Feb 2014 arxiv:40.043v [cs.ds] 3 Feb 04 A Bound on the Expected Optiality of Rando Feasible Solutions to Cobinatorial Optiization Probles Evan A. Sultani The Johns Hopins University APL evan@sultani.co http://www.sultani.co/

More information

1 Identical Parallel Machines

1 Identical Parallel Machines FB3: Matheatik/Inforatik Dr. Syaantak Das Winter 2017/18 Optiizing under Uncertainty Lecture Notes 3: Scheduling to Miniize Makespan In any standard scheduling proble, we are given a set of jobs J = {j

More information

Lecture 9 November 23, 2015

Lecture 9 November 23, 2015 CSC244: Discrepancy Theory in Coputer Science Fall 25 Aleksandar Nikolov Lecture 9 Noveber 23, 25 Scribe: Nick Spooner Properties of γ 2 Recall that γ 2 (A) is defined for A R n as follows: γ 2 (A) = in{r(u)

More information

time time δ jobs jobs

time time δ jobs jobs Approxiating Total Flow Tie on Parallel Machines Stefano Leonardi Danny Raz y Abstract We consider the proble of optiizing the total ow tie of a strea of jobs that are released over tie in a ultiprocessor

More information

Complex Quadratic Optimization and Semidefinite Programming

Complex Quadratic Optimization and Semidefinite Programming Coplex Quadratic Optiization and Seidefinite Prograing Shuzhong Zhang Yongwei Huang August 4 Abstract In this paper we study the approxiation algoriths for a class of discrete quadratic optiization probles

More information

Introduction to Discrete Optimization

Introduction to Discrete Optimization Prof. Friedrich Eisenbrand Martin Nieeier Due Date: March 9 9 Discussions: March 9 Introduction to Discrete Optiization Spring 9 s Exercise Consider a school district with I neighborhoods J schools and

More information

13.2 Fully Polynomial Randomized Approximation Scheme for Permanent of Random 0-1 Matrices

13.2 Fully Polynomial Randomized Approximation Scheme for Permanent of Random 0-1 Matrices CS71 Randoness & Coputation Spring 018 Instructor: Alistair Sinclair Lecture 13: February 7 Disclaier: These notes have not been subjected to the usual scrutiny accorded to foral publications. They ay

More information

Randomized Recovery for Boolean Compressed Sensing

Randomized Recovery for Boolean Compressed Sensing Randoized Recovery for Boolean Copressed Sensing Mitra Fatei and Martin Vetterli Laboratory of Audiovisual Counication École Polytechnique Fédéral de Lausanne (EPFL) Eail: {itra.fatei, artin.vetterli}@epfl.ch

More information

Homework 3 Solutions CSE 101 Summer 2017

Homework 3 Solutions CSE 101 Summer 2017 Hoework 3 Solutions CSE 0 Suer 207. Scheduling algoriths The following n = 2 jobs with given processing ties have to be scheduled on = 3 parallel and identical processors with the objective of iniizing

More information

Approximation in Stochastic Scheduling: The Power of LP-Based Priority Policies

Approximation in Stochastic Scheduling: The Power of LP-Based Priority Policies Approxiation in Stochastic Scheduling: The Power of -Based Priority Policies Rolf Möhring, Andreas Schulz, Marc Uetz Setting (A P p stoch, r E( w and (B P p stoch E( w We will assue that the processing

More information

Support Vector Machines. Machine Learning Series Jerry Jeychandra Blohm Lab

Support Vector Machines. Machine Learning Series Jerry Jeychandra Blohm Lab Support Vector Machines Machine Learning Series Jerry Jeychandra Bloh Lab Outline Main goal: To understand how support vector achines (SVMs) perfor optial classification for labelled data sets, also a

More information

Quantum algorithms (CO 781, Winter 2008) Prof. Andrew Childs, University of Waterloo LECTURE 15: Unstructured search and spatial search

Quantum algorithms (CO 781, Winter 2008) Prof. Andrew Childs, University of Waterloo LECTURE 15: Unstructured search and spatial search Quantu algoriths (CO 781, Winter 2008) Prof Andrew Childs, University of Waterloo LECTURE 15: Unstructured search and spatial search ow we begin to discuss applications of quantu walks to search algoriths

More information

Model Fitting. CURM Background Material, Fall 2014 Dr. Doreen De Leon

Model Fitting. CURM Background Material, Fall 2014 Dr. Doreen De Leon Model Fitting CURM Background Material, Fall 014 Dr. Doreen De Leon 1 Introduction Given a set of data points, we often want to fit a selected odel or type to the data (e.g., we suspect an exponential

More information

Worst-case performance of critical path type algorithms

Worst-case performance of critical path type algorithms Intl. Trans. in Op. Res. 7 (2000) 383±399 www.elsevier.co/locate/ors Worst-case perforance of critical path type algoriths G. Singh, Y. Zinder* University of Technology, P.O. Box 123, Broadway, NSW 2007,

More information

The Methods of Solution for Constrained Nonlinear Programming

The Methods of Solution for Constrained Nonlinear Programming Research Inventy: International Journal Of Engineering And Science Vol.4, Issue 3(March 2014), PP 01-06 Issn (e): 2278-4721, Issn (p):2319-6483, www.researchinventy.co The Methods of Solution for Constrained

More information

A Note on Online Scheduling for Jobs with Arbitrary Release Times

A Note on Online Scheduling for Jobs with Arbitrary Release Times A Note on Online Scheduling for Jobs with Arbitrary Release Ties Jihuan Ding, and Guochuan Zhang College of Operations Research and Manageent Science, Qufu Noral University, Rizhao 7686, China dingjihuan@hotail.co

More information

Multiprocessor scheduling with rejection

Multiprocessor scheduling with rejection Multiprocessor scheduling with rejection Bartal, Y.; Leonardi, S.; Marchetti Spaccaela, A.; Sgall, J.; Stougie, L. Published in: SIAM Journal on Discrete Matheatics DOI: 10.1137/S0895480196300522 Published:

More information

This model assumes that the probability of a gap has size i is proportional to 1/i. i.e., i log m e. j=1. E[gap size] = i P r(i) = N f t.

This model assumes that the probability of a gap has size i is proportional to 1/i. i.e., i log m e. j=1. E[gap size] = i P r(i) = N f t. CS 493: Algoriths for Massive Data Sets Feb 2, 2002 Local Models, Bloo Filter Scribe: Qin Lv Local Models In global odels, every inverted file entry is copressed with the sae odel. This work wells when

More information

A note on the multiplication of sparse matrices

A note on the multiplication of sparse matrices Cent. Eur. J. Cop. Sci. 41) 2014 1-11 DOI: 10.2478/s13537-014-0201-x Central European Journal of Coputer Science A note on the ultiplication of sparse atrices Research Article Keivan Borna 12, Sohrab Aboozarkhani

More information

Hybrid System Identification: An SDP Approach

Hybrid System Identification: An SDP Approach 49th IEEE Conference on Decision and Control Deceber 15-17, 2010 Hilton Atlanta Hotel, Atlanta, GA, USA Hybrid Syste Identification: An SDP Approach C Feng, C M Lagoa, N Ozay and M Sznaier Abstract The

More information

Support Vector Machine Classification of Uncertain and Imbalanced data using Robust Optimization

Support Vector Machine Classification of Uncertain and Imbalanced data using Robust Optimization Recent Researches in Coputer Science Support Vector Machine Classification of Uncertain and Ibalanced data using Robust Optiization RAGHAV PAT, THEODORE B. TRAFALIS, KASH BARKER School of Industrial Engineering

More information

The Simplex Method is Strongly Polynomial for the Markov Decision Problem with a Fixed Discount Rate

The Simplex Method is Strongly Polynomial for the Markov Decision Problem with a Fixed Discount Rate The Siplex Method is Strongly Polynoial for the Markov Decision Proble with a Fixed Discount Rate Yinyu Ye April 20, 2010 Abstract In this note we prove that the classic siplex ethod with the ost-negativereduced-cost

More information

Block designs and statistics

Block designs and statistics Bloc designs and statistics Notes for Math 447 May 3, 2011 The ain paraeters of a bloc design are nuber of varieties v, bloc size, nuber of blocs b. A design is built on a set of v eleents. Each eleent

More information

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Course Notes for EE227C (Spring 2018): Convex Optiization and Approxiation Instructor: Moritz Hardt Eail: hardt+ee227c@berkeley.edu Graduate Instructor: Max Sichowitz Eail: sichow+ee227c@berkeley.edu October

More information

e-companion ONLY AVAILABLE IN ELECTRONIC FORM

e-companion ONLY AVAILABLE IN ELECTRONIC FORM OPERATIONS RESEARCH doi 10.1287/opre.1070.0427ec pp. ec1 ec5 e-copanion ONLY AVAILABLE IN ELECTRONIC FORM infors 07 INFORMS Electronic Copanion A Learning Approach for Interactive Marketing to a Custoer

More information

Exact tensor completion with sum-of-squares

Exact tensor completion with sum-of-squares Proceedings of Machine Learning Research vol 65:1 54, 2017 30th Annual Conference on Learning Theory Exact tensor copletion with su-of-squares Aaron Potechin Institute for Advanced Study, Princeton David

More information

arxiv: v1 [cs.ds] 29 Jan 2012

arxiv: v1 [cs.ds] 29 Jan 2012 A parallel approxiation algorith for ixed packing covering seidefinite progras arxiv:1201.6090v1 [cs.ds] 29 Jan 2012 Rahul Jain National U. Singapore January 28, 2012 Abstract Penghui Yao National U. Singapore

More information

A Better Algorithm For an Ancient Scheduling Problem. David R. Karger Steven J. Phillips Eric Torng. Department of Computer Science

A Better Algorithm For an Ancient Scheduling Problem. David R. Karger Steven J. Phillips Eric Torng. Department of Computer Science A Better Algorith For an Ancient Scheduling Proble David R. Karger Steven J. Phillips Eric Torng Departent of Coputer Science Stanford University Stanford, CA 9435-4 Abstract One of the oldest and siplest

More information

Longest Processing Time rule for identical parallel machines revisited

Longest Processing Time rule for identical parallel machines revisited Longest Processing Tie rule for identical parallel achines revisited Federico Della Croce a,b,, Rosario Scataacchia a arxiv:1801.05489v1 [cs.ds] 16 Jan 2018 a Dipartiento di Ingegneria Gestionale e della

More information

1 Bounding the Margin

1 Bounding the Margin COS 511: Theoretical Machine Learning Lecturer: Rob Schapire Lecture #12 Scribe: Jian Min Si March 14, 2013 1 Bounding the Margin We are continuing the proof of a bound on the generalization error of AdaBoost

More information

Integrality gaps of 2 o(1) for Vertex Cover SDPs in the Lovász-Schrijver hierarchy

Integrality gaps of 2 o(1) for Vertex Cover SDPs in the Lovász-Schrijver hierarchy Integrality gaps of o(1) for Vertex Cover SDPs in the Lovász-Schrijver hierarchy Konstantinos Georgiou Avner Magen Toniann Pitassi Iannis Tourlakis Departent of Coputer Science University of Toronto 10

More information

Faster and Simpler Algorithms for Multicommodity Flow and other. Fractional Packing Problems. Abstract

Faster and Simpler Algorithms for Multicommodity Flow and other. Fractional Packing Problems. Abstract Faster and Sipler Algoriths for Multicoodity Flow and other Fractional Packing Probles Naveen Garg Jochen Koneann y Abstract This paper considers the proble of designing fast, approxiate, cobinatorial

More information

Polygonal Designs: Existence and Construction

Polygonal Designs: Existence and Construction Polygonal Designs: Existence and Construction John Hegean Departent of Matheatics, Stanford University, Stanford, CA 9405 Jeff Langford Departent of Matheatics, Drake University, Des Moines, IA 5011 G

More information

Multi-Dimensional Hegselmann-Krause Dynamics

Multi-Dimensional Hegselmann-Krause Dynamics Multi-Diensional Hegselann-Krause Dynaics A. Nedić Industrial and Enterprise Systes Engineering Dept. University of Illinois Urbana, IL 680 angelia@illinois.edu B. Touri Coordinated Science Laboratory

More information

Recovering Data from Underdetermined Quadratic Measurements (CS 229a Project: Final Writeup)

Recovering Data from Underdetermined Quadratic Measurements (CS 229a Project: Final Writeup) Recovering Data fro Underdeterined Quadratic Measureents (CS 229a Project: Final Writeup) Mahdi Soltanolkotabi Deceber 16, 2011 1 Introduction Data that arises fro engineering applications often contains

More information

Tight Information-Theoretic Lower Bounds for Welfare Maximization in Combinatorial Auctions

Tight Information-Theoretic Lower Bounds for Welfare Maximization in Combinatorial Auctions Tight Inforation-Theoretic Lower Bounds for Welfare Maxiization in Cobinatorial Auctions Vahab Mirrokni Jan Vondrák Theory Group, Microsoft Dept of Matheatics Research Princeton University Redond, WA 9805

More information

Stochastic Subgradient Methods

Stochastic Subgradient Methods Stochastic Subgradient Methods Lingjie Weng Yutian Chen Bren School of Inforation and Coputer Science University of California, Irvine {wengl, yutianc}@ics.uci.edu Abstract Stochastic subgradient ethods

More information

Models and Algorithms for Stochastic Online Scheduling 1

Models and Algorithms for Stochastic Online Scheduling 1 Models and Algoriths for Stochastic Online Scheduling 1 Nicole Megow Technische Universität Berlin, Institut für Matheatik, Strasse des 17. Juni 136, 10623 Berlin, Gerany. eail: negow@ath.tu-berlin.de

More information

Intelligent Systems: Reasoning and Recognition. Perceptrons and Support Vector Machines

Intelligent Systems: Reasoning and Recognition. Perceptrons and Support Vector Machines Intelligent Systes: Reasoning and Recognition Jaes L. Crowley osig 1 Winter Seester 2018 Lesson 6 27 February 2018 Outline Perceptrons and Support Vector achines Notation...2 Linear odels...3 Lines, Planes

More information

Kernel Methods and Support Vector Machines

Kernel Methods and Support Vector Machines Intelligent Systes: Reasoning and Recognition Jaes L. Crowley ENSIAG 2 / osig 1 Second Seester 2012/2013 Lesson 20 2 ay 2013 Kernel ethods and Support Vector achines Contents Kernel Functions...2 Quadratic

More information

A Self-Organizing Model for Logical Regression Jerry Farlow 1 University of Maine. (1900 words)

A Self-Organizing Model for Logical Regression Jerry Farlow 1 University of Maine. (1900 words) 1 A Self-Organizing Model for Logical Regression Jerry Farlow 1 University of Maine (1900 words) Contact: Jerry Farlow Dept of Matheatics Univeristy of Maine Orono, ME 04469 Tel (07) 866-3540 Eail: farlow@ath.uaine.edu

More information

Support Vector Machines. Goals for the lecture

Support Vector Machines. Goals for the lecture Support Vector Machines Mark Craven and David Page Coputer Sciences 760 Spring 2018 www.biostat.wisc.edu/~craven/cs760/ Soe of the slides in these lectures have been adapted/borrowed fro aterials developed

More information

E0 370 Statistical Learning Theory Lecture 6 (Aug 30, 2011) Margin Analysis

E0 370 Statistical Learning Theory Lecture 6 (Aug 30, 2011) Margin Analysis E0 370 tatistical Learning Theory Lecture 6 (Aug 30, 20) Margin Analysis Lecturer: hivani Agarwal cribe: Narasihan R Introduction In the last few lectures we have seen how to obtain high confidence bounds

More information

An incremental mirror descent subgradient algorithm with random sweeping and proximal step

An incremental mirror descent subgradient algorithm with random sweeping and proximal step An increental irror descent subgradient algorith with rando sweeping and proxial step Radu Ioan Boţ Axel Böh April 6, 08 Abstract We investigate the convergence properties of increental irror descent type

More information

FLOWSHOP SCHEDULES WITH SEQUENCE DEPENDENT SETUP TIMES

FLOWSHOP SCHEDULES WITH SEQUENCE DEPENDENT SETUP TIMES Journal of the Operations Research Society of Japan Vo!. 29, No. 3, Septeber 1986 1986 The Operations Research Society of Japan FLOWSHOP SCHEDULES WITH SEQUENCE DEPENDENT SETUP TIMES Jatinder N. D. Gupta

More information

On the Communication Complexity of Lipschitzian Optimization for the Coordinated Model of Computation

On the Communication Complexity of Lipschitzian Optimization for the Coordinated Model of Computation journal of coplexity 6, 459473 (2000) doi:0.006jco.2000.0544, available online at http:www.idealibrary.co on On the Counication Coplexity of Lipschitzian Optiization for the Coordinated Model of Coputation

More information

Constrained Consensus and Optimization in Multi-Agent Networks arxiv: v2 [math.oc] 17 Dec 2008

Constrained Consensus and Optimization in Multi-Agent Networks arxiv: v2 [math.oc] 17 Dec 2008 LIDS Report 2779 1 Constrained Consensus and Optiization in Multi-Agent Networks arxiv:0802.3922v2 [ath.oc] 17 Dec 2008 Angelia Nedić, Asuan Ozdaglar, and Pablo A. Parrilo February 15, 2013 Abstract We

More information

SPECTRUM sensing is a core concept of cognitive radio

SPECTRUM sensing is a core concept of cognitive radio World Acadey of Science, Engineering and Technology International Journal of Electronics and Counication Engineering Vol:6, o:2, 202 Efficient Detection Using Sequential Probability Ratio Test in Mobile

More information

An incremental mirror descent subgradient algorithm with random sweeping and proximal step

An incremental mirror descent subgradient algorithm with random sweeping and proximal step An increental irror descent subgradient algorith with rando sweeping and proxial step Radu Ioan Boţ Axel Böh Septeber 7, 07 Abstract We investigate the convergence properties of increental irror descent

More information

CS Lecture 13. More Maximum Likelihood

CS Lecture 13. More Maximum Likelihood CS 6347 Lecture 13 More Maxiu Likelihood Recap Last tie: Introduction to axiu likelihood estiation MLE for Bayesian networks Optial CPTs correspond to epirical counts Today: MLE for CRFs 2 Maxiu Likelihood

More information

Mixed Robust/Average Submodular Partitioning

Mixed Robust/Average Submodular Partitioning Mixed Robust/Average Subodular Partitioning Kai Wei 1 Rishabh Iyer 1 Shengjie Wang 2 Wenruo Bai 1 Jeff Biles 1 1 Departent of Electrical Engineering, University of Washington 2 Departent of Coputer Science,

More information

On Constant Power Water-filling

On Constant Power Water-filling On Constant Power Water-filling Wei Yu and John M. Cioffi Electrical Engineering Departent Stanford University, Stanford, CA94305, U.S.A. eails: {weiyu,cioffi}@stanford.edu Abstract This paper derives

More information

Feature Extraction Techniques

Feature Extraction Techniques Feature Extraction Techniques Unsupervised Learning II Feature Extraction Unsupervised ethods can also be used to find features which can be useful for categorization. There are unsupervised ethods that

More information

COS 424: Interacting with Data. Written Exercises

COS 424: Interacting with Data. Written Exercises COS 424: Interacting with Data Hoework #4 Spring 2007 Regression Due: Wednesday, April 18 Written Exercises See the course website for iportant inforation about collaboration and late policies, as well

More information

Testing Properties of Collections of Distributions

Testing Properties of Collections of Distributions Testing Properties of Collections of Distributions Reut Levi Dana Ron Ronitt Rubinfeld April 9, 0 Abstract We propose a fraework for studying property testing of collections of distributions, where the

More information

CSE525: Randomized Algorithms and Probabilistic Analysis May 16, Lecture 13

CSE525: Randomized Algorithms and Probabilistic Analysis May 16, Lecture 13 CSE55: Randoied Algoriths and obabilistic Analysis May 6, Lecture Lecturer: Anna Karlin Scribe: Noah Siegel, Jonathan Shi Rando walks and Markov chains This lecture discusses Markov chains, which capture

More information

Fast Montgomery-like Square Root Computation over GF(2 m ) for All Trinomials

Fast Montgomery-like Square Root Computation over GF(2 m ) for All Trinomials Fast Montgoery-like Square Root Coputation over GF( ) for All Trinoials Yin Li a, Yu Zhang a, a Departent of Coputer Science and Technology, Xinyang Noral University, Henan, P.R.China Abstract This letter

More information

arxiv: v1 [math.na] 10 Oct 2016

arxiv: v1 [math.na] 10 Oct 2016 GREEDY GAUSS-NEWTON ALGORITHM FOR FINDING SPARSE SOLUTIONS TO NONLINEAR UNDERDETERMINED SYSTEMS OF EQUATIONS MÅRTEN GULLIKSSON AND ANNA OLEYNIK arxiv:6.395v [ath.na] Oct 26 Abstract. We consider the proble

More information

1 Proof of learning bounds

1 Proof of learning bounds COS 511: Theoretical Machine Learning Lecturer: Rob Schapire Lecture #4 Scribe: Akshay Mittal February 13, 2013 1 Proof of learning bounds For intuition of the following theore, suppose there exists a

More information

Tight Complexity Bounds for Optimizing Composite Objectives

Tight Complexity Bounds for Optimizing Composite Objectives Tight Coplexity Bounds for Optiizing Coposite Objectives Blake Woodworth Toyota Technological Institute at Chicago Chicago, IL, 60637 blake@ttic.edu Nathan Srebro Toyota Technological Institute at Chicago

More information

Ch 12: Variations on Backpropagation

Ch 12: Variations on Backpropagation Ch 2: Variations on Backpropagation The basic backpropagation algorith is too slow for ost practical applications. It ay take days or weeks of coputer tie. We deonstrate why the backpropagation algorith

More information

Constant-Space String-Matching. in Sublinear Average Time. (Extended Abstract) Wojciech Rytter z. Warsaw University. and. University of Liverpool

Constant-Space String-Matching. in Sublinear Average Time. (Extended Abstract) Wojciech Rytter z. Warsaw University. and. University of Liverpool Constant-Space String-Matching in Sublinear Average Tie (Extended Abstract) Maxie Crocheore Universite de Marne-la-Vallee Leszek Gasieniec y Max-Planck Institut fur Inforatik Wojciech Rytter z Warsaw University

More information

Sharp Time Data Tradeoffs for Linear Inverse Problems

Sharp Time Data Tradeoffs for Linear Inverse Problems Sharp Tie Data Tradeoffs for Linear Inverse Probles Saet Oyak Benjain Recht Mahdi Soltanolkotabi January 016 Abstract In this paper we characterize sharp tie-data tradeoffs for optiization probles used

More information

4 = (0.02) 3 13, = 0.25 because = 25. Simi-

4 = (0.02) 3 13, = 0.25 because = 25. Simi- Theore. Let b and be integers greater than. If = (. a a 2 a i ) b,then for any t N, in base (b + t), the fraction has the digital representation = (. a a 2 a i ) b+t, where a i = a i + tk i with k i =

More information

Convolutional Codes. Lecture Notes 8: Trellis Codes. Example: K=3,M=2, rate 1/2 code. Figure 95: Convolutional Encoder

Convolutional Codes. Lecture Notes 8: Trellis Codes. Example: K=3,M=2, rate 1/2 code. Figure 95: Convolutional Encoder Convolutional Codes Lecture Notes 8: Trellis Codes In this lecture we discuss construction of signals via a trellis. That is, signals are constructed by labeling the branches of an infinite trellis with

More information

A Bernstein-Markov Theorem for Normed Spaces

A Bernstein-Markov Theorem for Normed Spaces A Bernstein-Markov Theore for Nored Spaces Lawrence A. Harris Departent of Matheatics, University of Kentucky Lexington, Kentucky 40506-0027 Abstract Let X and Y be real nored linear spaces and let φ :

More information

The Simplex and Policy-Iteration Methods are Strongly Polynomial for the Markov Decision Problem with a Fixed Discount Rate

The Simplex and Policy-Iteration Methods are Strongly Polynomial for the Markov Decision Problem with a Fixed Discount Rate The Siplex and Policy-Iteration Methods are Strongly Polynoial for the Markov Decision Proble with a Fixed Discount Rate Yinyu Ye April 20, 2010; revised Noveber 30, 2010 Abstract We prove that the classic

More information

Computational and Statistical Learning Theory

Computational and Statistical Learning Theory Coputational and Statistical Learning Theory Proble sets 5 and 6 Due: Noveber th Please send your solutions to learning-subissions@ttic.edu Notations/Definitions Recall the definition of saple based Radeacher

More information

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Course Notes for EE7C (Spring 018: Convex Optiization and Approxiation Instructor: Moritz Hardt Eail: hardt+ee7c@berkeley.edu Graduate Instructor: Max Sichowitz Eail: sichow+ee7c@berkeley.edu October 15,

More information

The Hilbert Schmidt version of the commutator theorem for zero trace matrices

The Hilbert Schmidt version of the commutator theorem for zero trace matrices The Hilbert Schidt version of the coutator theore for zero trace atrices Oer Angel Gideon Schechtan March 205 Abstract Let A be a coplex atrix with zero trace. Then there are atrices B and C such that

More information

A Simple Regression Problem

A Simple Regression Problem A Siple Regression Proble R. M. Castro March 23, 2 In this brief note a siple regression proble will be introduced, illustrating clearly the bias-variance tradeoff. Let Y i f(x i ) + W i, i,..., n, where

More information

New Slack-Monotonic Schedulability Analysis of Real-Time Tasks on Multiprocessors

New Slack-Monotonic Schedulability Analysis of Real-Time Tasks on Multiprocessors New Slack-Monotonic Schedulability Analysis of Real-Tie Tasks on Multiprocessors Risat Mahud Pathan and Jan Jonsson Chalers University of Technology SE-41 96, Göteborg, Sweden {risat, janjo}@chalers.se

More information

A general forulation of the cross-nested logit odel Michel Bierlaire, Dpt of Matheatics, EPFL, Lausanne Phone: Fax:

A general forulation of the cross-nested logit odel Michel Bierlaire, Dpt of Matheatics, EPFL, Lausanne Phone: Fax: A general forulation of the cross-nested logit odel Michel Bierlaire, EPFL Conference paper STRC 2001 Session: Choices A general forulation of the cross-nested logit odel Michel Bierlaire, Dpt of Matheatics,

More information

Research Article Approximate Multidegree Reduction of λ-bézier Curves

Research Article Approximate Multidegree Reduction of λ-bézier Curves Matheatical Probles in Engineering Volue 6 Article ID 87 pages http://dxdoiorg//6/87 Research Article Approxiate Multidegree Reduction of λ-bézier Curves Gang Hu Huanxin Cao and Suxia Zhang Departent of

More information

. The univariate situation. It is well-known for a long tie that denoinators of Pade approxiants can be considered as orthogonal polynoials with respe

. The univariate situation. It is well-known for a long tie that denoinators of Pade approxiants can be considered as orthogonal polynoials with respe PROPERTIES OF MULTIVARIATE HOMOGENEOUS ORTHOGONAL POLYNOMIALS Brahi Benouahane y Annie Cuyt? Keywords Abstract It is well-known that the denoinators of Pade approxiants can be considered as orthogonal

More information

Distributed Subgradient Methods for Multi-agent Optimization

Distributed Subgradient Methods for Multi-agent Optimization 1 Distributed Subgradient Methods for Multi-agent Optiization Angelia Nedić and Asuan Ozdaglar October 29, 2007 Abstract We study a distributed coputation odel for optiizing a su of convex objective functions

More information

APPROXIMATION BOUNDS FOR SPARSE PRINCIPAL COMPONENT ANALYSIS

APPROXIMATION BOUNDS FOR SPARSE PRINCIPAL COMPONENT ANALYSIS APPROXIMATION BOUNDS FOR SPARSE PRINCIPAL COMPONENT ANALYSIS ALEXANDRE D ASPREMONT, FRANCIS BACH, AND LAURENT EL GHAOUI ABSTRACT. We produce approxiation bounds on a seidefinite prograing relaxation for

More information

arxiv: v1 [cs.ds] 17 Mar 2016

arxiv: v1 [cs.ds] 17 Mar 2016 Tight Bounds for Single-Pass Streaing Coplexity of the Set Cover Proble Sepehr Assadi Sanjeev Khanna Yang Li Abstract arxiv:1603.05715v1 [cs.ds] 17 Mar 2016 We resolve the space coplexity of single-pass

More information

The Simplex and Policy-Iteration Methods are Strongly Polynomial for the Markov Decision Problem with a Fixed Discount Rate

The Simplex and Policy-Iteration Methods are Strongly Polynomial for the Markov Decision Problem with a Fixed Discount Rate The Siplex and Policy-Iteration Methods are Strongly Polynoial for the Markov Decision Proble with a Fixed Discount Rate Yinyu Ye Departent of Manageent Science and Engineering, Stanford University, Stanford,

More information

A Low-Complexity Congestion Control and Scheduling Algorithm for Multihop Wireless Networks with Order-Optimal Per-Flow Delay

A Low-Complexity Congestion Control and Scheduling Algorithm for Multihop Wireless Networks with Order-Optimal Per-Flow Delay A Low-Coplexity Congestion Control and Scheduling Algorith for Multihop Wireless Networks with Order-Optial Per-Flow Delay Po-Kai Huang, Xiaojun Lin, and Chih-Chun Wang School of Electrical and Coputer

More information

Lecture 20 November 7, 2013

Lecture 20 November 7, 2013 CS 229r: Algoriths for Big Data Fall 2013 Prof. Jelani Nelson Lecture 20 Noveber 7, 2013 Scribe: Yun Willia Yu 1 Introduction Today we re going to go through the analysis of atrix copletion. First though,

More information

Randomized Accuracy-Aware Program Transformations For Efficient Approximate Computations

Randomized Accuracy-Aware Program Transformations For Efficient Approximate Computations Randoized Accuracy-Aware Progra Transforations For Efficient Approxiate Coputations Zeyuan Allen Zhu Sasa Misailovic Jonathan A. Kelner Martin Rinard MIT CSAIL zeyuan@csail.it.edu isailo@it.edu kelner@it.edu

More information

Foundations of Machine Learning Boosting. Mehryar Mohri Courant Institute and Google Research

Foundations of Machine Learning Boosting. Mehryar Mohri Courant Institute and Google Research Foundations of Machine Learning Boosting Mehryar Mohri Courant Institute and Google Research ohri@cis.nyu.edu Weak Learning Definition: concept class C is weakly PAC-learnable if there exists a (weak)

More information

Boosting with log-loss

Boosting with log-loss Boosting with log-loss Marco Cusuano-Towner Septeber 2, 202 The proble Suppose we have data exaples {x i, y i ) i =... } for a two-class proble with y i {, }. Let F x) be the predictor function with the

More information

On Rough Interval Three Level Large Scale Quadratic Integer Programming Problem

On Rough Interval Three Level Large Scale Quadratic Integer Programming Problem J. Stat. Appl. Pro. 6, No. 2, 305-318 2017) 305 Journal of Statistics Applications & Probability An International Journal http://dx.doi.org/10.18576/jsap/060206 On Rough Interval Three evel arge Scale

More information

Divisibility of Polynomials over Finite Fields and Combinatorial Applications

Divisibility of Polynomials over Finite Fields and Combinatorial Applications Designs, Codes and Cryptography anuscript No. (will be inserted by the editor) Divisibility of Polynoials over Finite Fields and Cobinatorial Applications Daniel Panario Olga Sosnovski Brett Stevens Qiang

More information

Consistent Multiclass Algorithms for Complex Performance Measures. Supplementary Material

Consistent Multiclass Algorithms for Complex Performance Measures. Supplementary Material Consistent Multiclass Algoriths for Coplex Perforance Measures Suppleentary Material Notations. Let λ be the base easure over n given by the unifor rando variable (say U over n. Hence, for all easurable

More information

Iterative Decoding of LDPC Codes over the q-ary Partial Erasure Channel

Iterative Decoding of LDPC Codes over the q-ary Partial Erasure Channel 1 Iterative Decoding of LDPC Codes over the q-ary Partial Erasure Channel Rai Cohen, Graduate Student eber, IEEE, and Yuval Cassuto, Senior eber, IEEE arxiv:1510.05311v2 [cs.it] 24 ay 2016 Abstract In

More information

Optimum Value of Poverty Measure Using Inverse Optimization Programming Problem

Optimum Value of Poverty Measure Using Inverse Optimization Programming Problem International Journal of Conteporary Matheatical Sciences Vol. 14, 2019, no. 1, 31-42 HIKARI Ltd, www.-hikari.co https://doi.org/10.12988/ijcs.2019.914 Optiu Value of Poverty Measure Using Inverse Optiization

More information

Nonclairvoyant Scheduling to Minimize the Total Flow Time on Single and Parallel Machines

Nonclairvoyant Scheduling to Minimize the Total Flow Time on Single and Parallel Machines Nonclairvoyant Scheduling to Miniize the Total Flow Tie on Single and Parallel Machines LUCA BECCHETTI AND STEFANO LEONARDI University of Roe La Sapienza, Roe, Italy Abstract. Scheduling a sequence of

More information

Curious Bounds for Floor Function Sums

Curious Bounds for Floor Function Sums 1 47 6 11 Journal of Integer Sequences, Vol. 1 (018), Article 18.1.8 Curious Bounds for Floor Function Sus Thotsaporn Thanatipanonda and Elaine Wong 1 Science Division Mahidol University International

More information

A1. Find all ordered pairs (a, b) of positive integers for which 1 a + 1 b = 3

A1. Find all ordered pairs (a, b) of positive integers for which 1 a + 1 b = 3 A. Find all ordered pairs a, b) of positive integers for which a + b = 3 08. Answer. The six ordered pairs are 009, 08), 08, 009), 009 337, 674) = 35043, 674), 009 346, 673) = 3584, 673), 674, 009 337)

More information