Conditional Hardness for Approximate Coloring

Size: px
Start display at page:

Download "Conditional Hardness for Approximate Coloring"

Transcription

1 Condtonal Hardness for Approxmate Colorng Irt Dnur Elchanan Mossel Oded Regev Aprl 30, 2009 Abstract We study the APPROXCOLORING(q, Q) problem: Gven a graph G, decde whether χ(g) q or χ(g) Q. We present hardness results for ths problem for any constants 3 q < Q. For q 4, our result s based on Khot s 2-to-1 label cover, whch s conjectured to be NPhard [Khot02]. For q = 3, we base our hardness result on a certan < shaped varant of hs conjecture. Prevously no hardness result was known for q = 3 and Q 6. At the heart of our proof are tght bounds on generalzed nose-stablty quanttes, whch extend the recent work of Mossel et al. [MOO05] and should have wder applcablty. 1 Introducton The approxmate graph colorng problem, whch we descrbe next, s one of a few classcal optmzaton problems whose approxmablty behavor s stll qute mysterous, despte ncreasngly complex technques developed n the past 15 years. For an undrected graph G = (V, E), let χ(g) be ts chromatc number,.e., the smallest number of colors needed to color the vertces of G wthout monochromatc edges. Then the approxmate graph colorng problem s defned as follows. APPROXCOLORING(q, Q) : Gven a graph G, decde between χ(g) q and χ(g) Q. Ths problem also has a natural search varant, whch can be stated as follows: gven a graph G wth χ(g) q, color G wth less than Q colors. It s easy to see that the search varant s not easer than the orgnal decson varant, and hence for the purpose of showng hardness results t s enough to consder the decson varant. It s easy to solve the problem APPROXCOLORING(2, Q) for any Q 3 n polynomal tme as t amounts to checkng bpartteness. The stuaton wth APPROXCOLORING(3, Q) s much more nterestng, as there s a huge gap between the value of Q for whch an effcent algorthm s known and that for whch a hardness result exsts. Indeed, untl not long ago, the best known polynomaltme algorthm was due to Blum and Karger [9], who solve the problem for Q = Õ(n3/14 ) colors, where n s the number of vertces and the Õ notaton hdes poly-logarthmc factors (as s often A prelmnary verson of ths paper has appeared n the proceedngs of STOC Hebrew Unversty. Emal: dnur@cs.huj.ac.l. Supported by the Israel Scence Foundaton and by the Bnatonal Scence Foundaton. Statstcs, U.C. Berkeley. Emal: mossel@stat.berkeley.edu. Supported by a Mller fellowshp n Computer Scence and Statstcs, a Sloan fellowshp n Mathematcs, the Bnatonal Scence Foundaton, and NSF grants DMS and DMS (CAREER) Department of Computer Scence, Tel-Avv Unversty, Tel-Avv 69978, Israel. Supported by an Alon Fellowshp, by the Bnatonal Scence Foundaton, by the Israel Scence Foundaton, by the European Commsson under the Integrated Project QAP funded by the IST drectorate as Contract Number , and by a European Research Councl (ERC) Startng Grant. 1

2 the case, ther algorthm actually solves the search varant). Ther work contnues a long lne of research [37, 8, 27] and s based on a sem-defnte relaxaton. Very recently, Arora et al. [2] were able to mprove ths to Q = O(n ) colors, and the constant n the exponent can possbly be reduced even further f certan geometrc conjectures are proven. However, there s some ndcaton that ths lne of work s lmted by Q = n δ for some fxed δ > 0, see [17]. In contrast, the strongest known hardness result shows that the problem s NP-hard for Q = 5 [28, 23]. Thus, the problem s open for all 5 < Q < O(n ). In ths paper we prove a hardness result for any constant (.e., ndependent of n) value of Q. As we shall explan later, our hardness result s based on the conjectured NP-hardness of certan nstances of the label cover problem due to Khot [30]. The stuaton wth APPROXCOLORING(q, Q) for small values q 4 s smlar. The best known algorthm, due to Halpern et al. [24], solves APPROXCOLORING(q, Q) for Q = Õ(nα q ) where 0 < α q < 1 s some constant dependng on q. For example, α On the other hand, there are several known NP-hardness results. One of the strongest s due to Khot [29], who mproved on an earler result of Fürer [20] by showng that for any large enough constant q and Q = q log q 25, APPROXCOLORING(q, Q) s NP-hard. Notce that for any fxed q, Khot s result, as well as all other known hardness results, apply only up to some fxed Q. Our result holds for any Q > q 3. Hardness Results. One of the most successful approaches to dervng hardness proofs, whch s also the one we shall take here, s by a reducton from a certan combnatoral problem known as the label-cover problem [3]. The PCP theorem [5, 4] says that ths problem s NP-hard. In the labelcover problem, we are gven an undrected graph and a number R. Each edge s assocated wth a bnary relaton on {1,..., R} and we refer to t as a constrant. The goal s to label the vertces wth values from {1,..., R} such that the number of satsfed constrants s maxmzed, where a constrant s satsfed f the labels on the two ncdent vertces satsfy the relaton assocated wth t. Wthout gong nto the detals of the reducton (these detals are descrbed n Secton 4), we remark that for our reducton to work, the label-cover nstances we use must have constrants of a very specfc form. For example, we mght requre all constrants to be bjectons,.e., a bnary relaton n whch any labellng of one vertex determnes the other, and vce versa. We call ths specal case the 1 1-label-cover. The precse defnton of ths and other specal cases wll appear later. Unfortunately, these specal cases of the label-cover problem are not known to be NP-hard. Nevertheless, n hs semnal work [30] Khot conjectured that such problems are n fact NP-hard, although the tools necessary to prove ths conjecture seem to be beyond our current reach. Ths conjecture has snce been heavly scrutnzed [36, 13, 22, 14], and so far there s no evdence aganst the conjecture. Ths ssue s currently one of the central topcs n theoretcal computer scence. Khot s conjecture s known to mply many strong, and often tght, hardness results. Two examples are the NP-hardness of approxmatng the VERTEXCOVER problem to wthn factors below 2 [32], whch s tght by a smple greedy algorthm, and the NP-hardness of approxmatng the MAXCUT problem to wthn factors larger than roughly [31], whch s tght by the algorthm of Goemans and Wllamson [21]. Our result contnues ths lne of work by showng that (varants of) Khot s conjecture mply strong hardness results for another fundamental problem that of approxmate graph colorng. More specfcally, we present three reductons, each from a dfferent specal case of the label-cover problem. An exact descrpton of the three reductons wll be gven later. For now, we just state nformally one mplcaton of our reductons. Theorem 1.1 (nformal) If a certan specal case of the label-cover problem s NP-hard, then for any Q > 3, APPROXCOLORING(3, Q) s NP-hard. 2

3 Bounds on Blnear Forms At the heart of our hardness results are certan bounds on blnear forms descrbng the correlaton under nose between two functons f, g : [q] n R where [q] := {1,..., q}. Snce we beleve these bounds mght be useful elsewhere, we now descrbe them n some detal. Let T be a symmetrc Markov operator on [q] (equvalently, T s the random walk on a regular undrected weghted graph on vertex set [q] possbly wth self-loops). We study the expectaton E x,y [f(x)g(y)] where x [q] n s chosen unformly and y [q] n s obtaned from x by applyng T to each coordnate ndependently. Usng notaton we ntroduce later, ths expectaton can also be wrtten as f, T n g = E x [f(x) T n g(x)]. (1) We are nterested n the case where T and q are fxed, and n tends to nfnty. Our man techncal result provdes tght bounds on the blnear form f, T n g for bounded functons f, g, n terms of E[f], E[g], and ρ, where ρ s the second largest egenvalue n absolute value of T. To motvate ths result, consder the followng concrete example. Take q = 2 and f : {0, 1} n {0, 1} satsfyng E[f] = 1/2 (.e., f s balanced). Fx some ρ (0, 1), and let T ρ be the operator that flps each bt wth probablty (1 ρ)/2, T ρ = ρ ( ) ( 1 + (1 ρ) 2 We would lke to know how hgh the stablty of a balanced Boolean functon f can be, where the stablty of f (wth parameter ρ) s defned as the probablty that f(x) = f(y) where x s chosen unformly from {0, 1} n and y s obtaned from x by flppng each bt ndependently wth probablty (1 ρ)/2. It s easy to see that the stablty of f can be wrtten as 1 2 Pr [f(x) = f(y)] = 2E x,y[f(x)f(y)] = 2 f, T n x,y ρ f (2) and hence an upper bound on the stablty of a balanced Boolean functon would follow from an upper bound on (1). If the functon f depends on just one coordnate of ts nput, say f(x 1,..., x n ) = x 1, then ts stablty s smply (1 + ρ)/2, and t can be shown that ths s the hghest possble for any balanced functon f. We consder such cases degenerate and nstead study functons that do not depend too strongly on any one coordnate of ther nput (ths wll be made precse soon). An example of such a functon s the majorty functon, whose value s 1 f and only f more than half of ts nput bts are 1 (assume for smplcty n s odd). It can be shown that the stablty of ths functon approaches arcsn(ρ)/π as n goes to nfnty. But s majorty the most stable functon among those who do not depend too strongly on any one coordnate? The results of [33] mply that the answer s essentally yes. In the work presented here we generalze such stablty statements to cases where T s a general reversble Markov operator (and not just the specfc operator defned above) and relax the assumptons on nfluences as dscussed later. Functons wth low nfluences. The noton of the nfluence of a varable on a functon defned n a product space [26] played a major role n recent developments n dscrete mathematcs, see for example [34, 35, 19, 18, 11, 7, 12]. Consder the space [q] n equpped wth the unform measure. Then the nfluence of the th varable on the functon f : [q] n R s defned by ). I (f) := E[Var x [f(x) x 1,..., x 1, x +1,..., x n ]]. 3

4 In recent years, startng wth [7, 11], an effort has been made to study propertes of functons all of whose varables have low nfluences. In addton to a natural mathematcal nterest n functons that do not depend strongly on any one coordnate, the study of such functons s essental for proofs of hardness of approxmaton results, see for example [16, 30, 32, 31]. Man Techncal Result. Our man techncal result s a bound on (1) for bounded functons f, g that have no common nfluental coordnate. The upper and lower bounds are stated n terms of nner products of the form F η, U ρ F ν γ where γ denotes the standard Gaussan measure on R, F µ (s) = 1 s<t s an ndcator functon where t s chosen so that E γ [F µ ] = µ, and U ρ s the Ornsten- Uhlenbeck operator, U ρ G(x) = E y γ [G(ρx + 1 ρ 2 y)]. These nner products can be wrtten as certan double ntegrals, and we menton the easy bound 0 < F η, U ρ F ν γ < mn(η, ν) for all ν, η and ρ strctly between 0 and 1. Theorem 1.2 Let T be some fxed symmetrc Markov operator on a fnte state space [q] whose second largest egenvalue n absolute value s ρ = r(t ) < 1. Then for any ε > 0 there exsts a δ > 0 such that f f, g : [q] n [0, 1] are two functons satsfyng for all, then t holds that mn ( I (f), I (g) ) < δ F E[f], U ρ (1 F 1 E[g] ) γ ε f, T n g F E[f], U ρ F E[g] γ + ε. (3) Stated n the contrapostve, ths theorem says that f for some two functons f, g, (1) devates from a certan range, then there must exst a coordnate that s nfluental n both functons. The fact that we obtan a common nfluental coordnate s crucal n our applcatons, as well as n a recent applcaton of Theorem 1.2 to the characterzaton of ndependent sets n graph powers [15]. We remark that for any T, the bounds n the theorem are essentally tght (see Appendx B). Gong back to our earler example, consder a balanced functon f : {0, 1} n {0, 1} all of whose nfluences are small. Applyng the theorem wth q = 2 and T ρ, and usng (2), gves us an upper bound of essentally 2 F 0.5, U ρ F 0.5 γ on the stablty of f. A straghtforward calculaton shows that ths value equals arcsn(ρ)/π, and hence we obtan as a specal case of our man theorem that asymptotcally, the majorty functon s the most stable among all balanced functons wth low nfluences. As mentoned before, ths specal case s not new to our work. It was orgnally presented as a conjecture n the work of [31] on the computatonal hardness of the MAXCUT problem, and has snce been proven by Mossel et al [33], who refer to t as the majorty s stablest theorem. For the proof, [33] developed a very powerful nvarance prncple. Ths prncple allows one to translate questons on low-nfluence functons n the dscrete settng (such as the above queston on {0, 1} n ) to correspondng questons n other spaces, and n partcular Gaussan space. The advantage of ths s that one can then apply known (and powerful) results n Gaussan space (such as [10]). Our proof of Theorem 1.2 also reles on ths nvarance prncple, and can n fact be seen as an extenson of the technques n [33]. Our theorem mproves on the one from [33] n the followng two aspects: The analyss of [33] only consders a very partcular nose operator known as the Beckner operator. We extend ths to more general nose operators that are gven by an arbtrary symmetrc Markov operator. In the applcaton to hardness of colorng we apply the result to three dfferent operators. We remark that our man theorem can be easly extended to 4

5 reversble Markov operators, wth the statonary dstrbuton takng the place of the unform dstrbuton. Perhaps more mportantly, our Theorem 1.2 allows one to conclude about the exstence of a common nfluental coordnate. A more drect applcaton of [33] only mples the exstence of an nfluental varable n one of the functons (n other words, one would have a max nstead of the mn n the theorem). As mentoned above, ths dfference s crucal for our applcaton as well as to the recent results n [15]. Independent sets n graph powers To demonstrate the usefulness of Theorem 1.2, let us consder a queston n the study of ndependent sets n graph powers. Let G = ([q], E) be a regular, connected, non-bpartte graph on q vertces. Consder the graph G n on vertex set [q] n n whch vertces (x 1,..., x n ) and (y 1,..., y n ) are connected f and only f x s connected to y n G for all (ths s known as the n-fold weak product of G wth tself). Let T G be the symmetrc Markov operator correspondng to one step n a random walk n G. It s easy to verfy that the operator T n G corresponds to one step n Gn. Let f, g : [q] n {0, 1} be two Boolean functons, and thnk of them as beng the ndcator functons of two subsets of [q] n. Then, the blnear form n (1) gves the fracton of edges that are spanned between these two subsets n the graph G n. In partcular, f, T n G f = 0 f and only f f s the ndcator functon of an ndependent set n G n. Usng the lower bound n Theorem 1.2, we obtan that for any µ > 0 there exsts a δ > 0 such that any ndependent set of measure µ (.e., E[f] = µ) must have at least one coordnate wth nfluence at least δ. Less formally, ths says that any reasonably bg ndependent set n graph powers must have some structure (namely, have an nfluental coordnate). Our hardness result for approxmate graph colorng uses Theorem 1.2 n a smlar fashon. We remark that graph powers were studed n a smlar context n [1], where a smlar structure theorem was proved for the restrcted case that the ndependent set has nearly maxmal sze. Moreover, Theorem 1.2 was recently used n [15] to show that every ndependent set n a graph power s contaned (up to o(1)) n a nontrval set descrbed by a constant number of coordnates. 2 Prelmnares 2.1 Functons on the q-ary hypercube Let [q] denote the set {0,..., q 1}. For an element x of [q] n wrte x a for the number of coordnates k of x such that x k = a and x = a 0 x a for the number of nonzero coordnates. In ths paper we are nterested n functons from [q] n to R. We defne an nner product on ths space by f, g = 1 q x f(x)g(x). In our applcatons, we usually take q to be some constant (say, n 3) and n to be large. Defnton 2.1 Let f : [q] n R be a functon. The nfluence of the th varable on f, denoted I (f) s defned by I (f) = E[Var x [f(x) x 1,..., x 1, x +1,..., x n ]] where x 1,..., x n are unformly dstrbuted. Consder a sequence of vectors α 0 = 1, α 1,..., α q 1 R q formng an orthonormal bass of R q. Equvalently, we can thnk of these vectors as functons from [q] to R. These vectors can be used to form an orthonormal bass of the space of functons from [q] n to R, as follows. 5

6 Defnton 2.2 Let α 0 = 1, α 1,..., α q 1 be an orthonormal bass of R q. For x [q] n, wrte α x R qn for α x1 α x2 α xn. Equvalently, we can defne α x as the functon mappng y [q] n to α x1 (y 1 )α x2 (y 2 ) α xn (y n ). Clearly, any functon from [q] n to R can be wrtten as a lnear combnaton of α x for x [q] n. Ths leads to the followng defnton. Defnton 2.3 For a functon f : [q] n R, defne ˆf(α x ) = f, α x and notce that f = x ˆf(α x )α x. The followng standard clam relates the nfluences of a functon to ts decomposton. Notce that the clam holds for any choce of orthonormal bass α 0,..., α q 1 as long as α 0 = 1. Clam 2.4 For any functon f : [q] n R and any {1,..., n}, I (f) = ˆf 2 (α x ). x:x 0 Proof: Let us frst fx the values of x 1,..., x 1, x +1,..., x n. Then [ ] [ Var x [f] = Var x ˆf(α y )α y = Var x y y:y 0 ˆf(α y )α y ], where the last equalty follows from the fact that f y = 0 then α y s a constant functon of x. If y 0, then the expected value of α y wth respect to x s zero. Therefore, 2 [ ] Var x ˆf(α y )α y = E x ˆf(α y )α y = E x ˆf(α y ) ˆf(α z )α y α z. Thus, y:y 0 I (f) = E x as needed. y,z:y 0,z 0 y:y 0 ˆf(α y ) ˆf(α z )α y α z = We now defne the noton of low-level nfluence. y,z:y 0,z 0 y,z:y 0,z 0 ˆf(α y ) ˆf(α z )E x [α y α z ] = y:y 0 ˆf 2 (α y ), Defnton 2.5 Let f : [q] n R be a functon, and let k n. The low-level nfluence of the th varable on f s defned by I k (f) = ˆf 2 (α x ). It s easy to see that for any functon f, I k (f) = x: x k x:x 0, x k ˆf 2 (α x ) x k x ˆf 2 (α x ) = k f 2 2. In partcular, for any functon f obtanng values n [0, 1], I k (f) k. Moreover, let us menton that I k s n fact ndependent of the partcular choce of bass α 0, α 1,..., α q 1 as long as α 0 = 1. Ths follows by notng that I k s the squared length of the projecton of f on the subspace spanned by all α x wth x 0, x k, and that ths subspace can be equvalently defned n terms of tensor products of α 0 and α0. There s a natural equvalence between [q] 2n and [q 2 ] n. As ths equvalence s used often n ths paper, we ntroduce the followng notaton. 6

7 Defnton 2.6 For any x [q] 2n we denote by x the element of [q 2 ] n gven by x = ((x 1, x 2 ),..., (x 2n 1, x 2n )). For any y [q 2 ] n we denote by y the element of [q] 2n gven by y = (y 1,1, y 1,2, y 2,1, y 2,2,..., y n,1, y n,2 ). For a functon f on [q] 2n we denote by f the functon on [q 2 ] n defned by f(y) = f(y). Smlarly, for a functon f on [q 2 ] n we denote by f the functon on [q] 2n defned by f(x) = f(x). Clam 2.7 For any functon f : [q] 2n R, any {1,..., n}, and any k 1, I k (f) I 2k 2 1 (f) + I 2k 2 (f). Proof: Fx some bass α x of [q] 2n as above and let α x be the bass of [q 2 ] n defned by α x (y) = α x (y). Then, t s easy to see that ˆf(α x ) = ˆf(α x ). Hence, I k (f) = x:x (0,0), x k ˆ f 2 (α x ) where we used that x 2 x. x:x 2 1 0, x 2k ˆf 2 (α x ) + x:x 2 0, x 2k ˆf 2 (α x ) = I 2k 2 1 (f) + I 2k 2 (f) For the followng defnton, recall that we say that a Markov operator T s symmetrc f t s reversble wth respect to the unform dstrbuton,.e., f the transton matrx representng T s symmetrc. Defnton 2.8 Let T be a symmetrc Markov operator on [q]. Let 1 = λ 0 λ 1 λ 2 λ q 1 be the egenvalues of T. We defne r(t ) to be the second largest egenvalue n absolute value, that s, r(t ) = max{ λ 1, λ q 1 }. For T as above, we may defne a Markov operator T n on [q] n n the standard way. Note that f T s symmetrc then T n s also symmetrc and r(t n ) = r(t ). If we choose α 0,..., α q 1 to be an orthonormal set of egenvectors for T wth correspondng egenvalues λ 0,..., λ q 1 (so α 0 = 1), we see that and hence T n α x = ( a 0 λ x a a T n f = x ) α x. ( ) a 0 λ x a a ˆf(αx )α x. holds for any functon f : [q] n R. We now descrbe two operators that we use n ths paper. The frst s the Beckner operator, T ρ. For any ρ [ 1 q 1, 1], t s defned by T ρ(x x) = 1 q + (1 1 q )ρ and T ρ(x y) = 1 q (1 ρ) for any x y n [q]. It can be seen that T ρ s a Markov operator as n Defnton 2.8 wth λ 1 = = λ q 1 = ρ and hence r(t ρ ) = ρ. Another useful operator s the averagng operator, A S. For a subset S {1,..., n}, t acts on functons on [q] n by averagng over coordnates n S, namely, A S (f) = E xs [f]. Notce that the functon A S (f) s ndependent of the coordnates n S. 7

8 2.2 Functons n Gaussan space We let γ denote the standard Gaussan measure on R n wth densty (2π) n/2 e x 2 2 /2. We denote by E γ the expected value wth respect to γ and by, γ the nner product on L 2 (R n, γ). Notce that E γ [f] = f, 1 γ where 1 s the constant 1 functon. For ρ [ 1, 1], we denote by U ρ the Ornsten-Uhlenbeck operator, whch acts on L 2 (R, γ) by U ρ f(x) = E y γ [f(ρx + 1 ρ 2 y)]. Snce for x, y γ we have that ρx + 1 ρ 2 y s also dstrbuted accordng to the standard Gaussan dstrbuton, E x γ [U ρ f(x)] = E x γ [f(x)]. Fnally, for 0 < µ < 1, let F µ : R {0, 1} denote the functon F µ (x) = 1 x<t where t s chosen n such a way that E γ [F µ ] = µ. One useful quantty that wll appear later s F η, U ρ F ν γ, whch by defnton can also be wrtten as F η, U ρ F ν γ = Pr x,y γ [x < s and ρx + 1 ρ 2 y < t], where s and t are such that F η (x) = 1 x<s and F ν (x) = 1 x<t. It s not dffcult to see that for any ν, η > 0, and any ρ [ 1, 1], t holds that F η, U ρ F ν γ = F ν, U ρ F η γ (say, snce U ρ s self-adjont) and that F τ, U ρ F τ γ F η, U ρ F ν γ τ, where τ = mn(η, ν). Moreover, for all τ > 0 and ρ > 1 t holds that F τ, U ρ F τ γ > 0. 3 An Inequalty for Nose Operators The man analytc result of the paper, Theorem 3.1, s a generalzaton of the result of [33]. It shows that f the nner product of two functons f and g under some nose operator devates from a certan range then there must exst an ndex such that the low-level nfluence of the th varable s large n both f and g. Ths range depends on the expected value of f and g, and on r(t ). Note n partcular that Theorem 3.1 mples Theorem 1.2. Theorem 3.1 Let q be a fxed nteger and let T be a symmetrc Markov operator on [q] such that ρ = r(t ) < 1. Then for any ε > 0 there exst δ > 0 and k N such that f f, g : [q] n [0, 1] are two functons satsfyng for all, then t holds that and where µ = E[f], ν = E[g]. mn ( I k (f), I k (g) ) < δ f, T n g F µ, U ρ (1 F 1 ν ) γ ε (4) f, T n g F µ, U ρ F ν γ + ε (5) Note that (4) follows from (5). Indeed, apply (5) to 1 g to obtan f, T n (1 g) F µ, U ρ F 1 ν γ + ε 8

9 and then use f, T n (1 g) = f, 1 f, T n g = µ f, T n g = F µ, U ρ 1 γ f, T n g. From now on we focus on provng (5). Followng the approach of [33], the proof conssts of two powerful technques. The frst s an nequalty by Chrster Borell [10] on contnuous Gaussan space. The second s an nvarance prncple shown n [33] that allows us to translate our dscrete queston to the contnuous Gaussan space. Defnton 3.2 (Gaussan analogue of an operator) Let T be an operator as n Defnton 2.8. We defne ts Gaussan analogue as the operator T on L 2 (R q 1, γ) gven by T = U λ1 U λ2 U λq 1. For example, the Gaussan analogue of T ρ s Uρ (q 1). We need the followng powerful theorem by Borell [10]. It says that the functons that maxmze the nner product under the operator U ρ are the ndcator functons of half-spaces. Theorem 3.3 (Borell [10]) Let f, g : R n [0, 1] be two functons and let µ = E γ [f], ν = E γ [g]. Then f, U n ρ g γ F µ, U ρ F ν γ. The above theorem only apples to the Ornsten-Uhlenbeck operator. In the followng corollary we derve a smlar statement for more general operators. The proof follows by wrtng a general operator as a product of the Ornsten-Uhlenbeck operator and some other operator. Corollary 3.4 Let f, g : R (q 1)n [0, 1] be two functons and defne µ = E γ [f], ν = E γ [g]. Let T be an operator as n Defnton 2.8 and let ρ = r(t ). Then f, T n g γ F µ, U ρ F ν γ. Proof: For 1 q 1, let δ = λ /ρ. Note that δ 1 for all. Let S be the operator defned by Then, S = U δ1 U δ2 U δq 1. Uρ (q 1) S = U ρ U δ1 U ρ U δq 1 = U ρδ1 U ρδq 1 = T (ths s often called the sem-group property). It follows that T n = Uρ (q 1)n S n. Snce S n s an averagng operator, the functon S n g obtans values n [0, 1] and satsfes E γ [S n g] = E γ [g]. Thus the clam follows by applyng Theorem 3.3 to the functons f and S n g. Defnton 3.5 (Real analogue of a functon) Let f : [q] n R be a functon wth decomposton f = ˆf(αx )α x. Consder the (q 1)n varables z 1 1,..., z1 q 1,..., zn 1,..., zn q 1 and let Γ x = n =1,x 0 z x. We defne the real analogue of f to be the functon f : R n(q 1) R gven by f = ˆf(αx )Γ x. 9

10 Clam 3.6 For any two functons f, g : [q] n R and operator T on [q] n, f, g = f, g γ f, T n g = f, T n g γ where f, g denote the real analogues of f, g respectvely and T denotes the Gaussan analogue of T. Proof: Both α x and Γ x form an orthonormal set of functons hence both sdes of the frst equalty are ˆf(α x )ĝ(α x ). x For the second clam, notce that for every x, α x s an egenvector of T n and Γ x s an egenvector of T n and both correspond to the egenvalue a 0 λ x a a. Hence, both sdes of the second equalty are ( ) a 0 λ x a a ˆf(αx )ĝ(α x ). x Defnton 3.7 For any functon f wth range R, defne the functon chop(f) as f(x) f f(x) [0, 1] chop(f)(x) = 0 f f(x) < 0 1 f f(x) > 1 The followng theorem s proven n [33]. It shows that under certan condtons, f a functon f obtans values n [0, 1] then f and chop( f) are close. Its proof s non-trval and bulds on the man techncal result of [33], a result that s known as an nvarance prncple. In essence, t shows that the dstrbuton of values obtaned by f and that of values obtaned by f are close. In partcular, snce f never devates from [0, 1], t mples that f rarely devates from [0, 1] and hence f and chop( f) are close. See [33] for more detals. Theorem 3.8 ([33, Theorem 3.20]) There exsts a functon δ MOO (η, ε) such that for any η < 1 and ε > 0 the followng holds. For any functon f : [q] n [0, 1] such that d ˆf(α x ) 2 η d and I (f) < δ MOO (η, ε), t holds that x: x d f chop( f) 2 ε. We are now ready to prove the frst step n the proof of Theorem 3.1. It s here that we use the nvarance prncple and Borell s nequalty. Lemma 3.9 Let q be a fxed nteger and let T be a symmetrc Markov operator on [q] such that ρ = r(t ) < 1. Then for any ε > 0, η < 1, there exsts a δ > 0 such that for any functons f, g : [q] n [0, 1] satsfyng and t holds that d where µ = E[f], ν = E[g]. x: x d max (I (f), I (g)) < δ ˆf(α x ) 2 η d, d x: x d f, T n g F µ, U ρ F ν γ + ε 10 ĝ(α x ) 2 η d,

11 Proof: Let µ = E γ [chop( f)] and ν = E γ [chop( g)]. We note that F µ, U ρ F ν γ s a unformly contnuous functon of µ and ν. Let ε 1 be chosen such that f µ µ ε 1 and ν ν ε 1 then t holds that F µ, U ρ F ν γ F µ, U ρ F ν γ ε/2. Let ε 2 = mn(ε/4, ε 1 ) and let δ = δ MOO (η, ε 2 ) be the value gven by Theorem 3.8. Then, usng the Cauchy-Schwartz nequalty, µ µ = E γ [chop( f) f] = chop( f) f, 1 γ chop( f) f 2 ε 2 ε 1. Smlarly, we have ν ν ε 1. Now, f, T n g = f, T n g γ (Clam 3.6) = chop( f), T n chop( g) γ + chop( f), T n ( g chop( g)) γ + f chop( f), T n g γ chop( f), T n chop( g) γ + 2ε 2 F µ, U ρ F ν γ + 2ε 2 (Corollary 3.4) F µ, U ρ F ν γ + ε/2 + 2ε 2 F µ, U ρ F ν γ + ε where the frst nequalty follows from the Cauchy-Schwartz nequalty together wth the fact that chop( f) and g have L 2 norm at most 1 and that T n s a contracton on L 2. We complete the proof of Theorem 3.1 by provng: Lemma 3.10 Let q be a fxed nteger and let T be a symmetrc Markov operator on [q] such that ρ = r(t ) < 1. Then for any ε > 0, there exsts a δ > 0 and an nteger k such that f f, g : [q] n [0, 1] satsfy mn ( I k (f), I k (g) ) < δ (6) then where µ = E[f], ν = E[g]. f, T n g F µ, U ρ F ν γ + ε (7) Proof: Let f 1 = Tη n f and g 1 = Tη n g where η < 1 s chosen so that ρ j (1 η 2j ) < ε/4 for all j. Then f 1, T n g 1 f, T n g = ˆf(α x )ĝ(α x ) λ x a a (1 η 2 x ) x a 0 ρ x (1 η 2 x ) ˆf(α x )ĝ(α x ) ε/4 x where the last nequalty follows from the Cauchy-Schwartz nequalty. Thus, n order to prove (7) t suffces to prove f 1, T n g 1 F µ, U ρ F ν γ + 3ε/4. (8) Let δ(ε/4, η) be the value gven by Lemma 3.9 pluggng n ε/4 for ε. Let δ = δ(ε/4, η)/2. Let k be chosen so that η 2k < mn(δ, ε/4). Defne C = k/δ and δ = (ε/8c) 2 < δ. Let B f = { : I k (f) δ }, B g = { : I k (g) δ }. 11

12 We note that B f and B g are of sze at most C = k/δ. By (6), we have that whenever B f, I k (g) < δ. Smlarly, for every B g we have I k (f) < δ. In partcular, B f and B g are dsjont. Recall the averagng operator A. We now let f 2 = A Bf (f 1 ) = ˆf(α x )α x η x, g 2 = A Bg (g 1 ) = x:x Bf =0 x:x B g =0 ĝ(α x )α x η x. Clearly, E[f 2 ] = E[f] and E[g 2 ] = E[g], and for all x, f 2 (x), g 2 (x) [0, 1]. It s easy to see that I (f 2 ) = 0 f B f and I (f 2 ) I k (f) + η 2k < 2δ otherwse and smlarly for g 2. Thus, for any, max (I (f 2 ), I (g 2 )) < 2δ. We also see that for any d, x: x d ˆf 2 (α x ) 2 η d and the same for g 2. Thus, we can apply Lemma 3.9 to obtan that f 2, T n g 2 F µ, U ρ F ν γ + ε/4. In order to show (8) and complete the proof, we show that f 1, T n g 1 f 2, T n g 2 ε/2. Ths follows by f 1, T n g 1 f 2, T n g 2 = ˆf(αx )ĝ(α x ) x:x Bf Bg 0 η 2k ˆf(α x )ĝ(α x ) ε/4 + ε/4 + x: x k B f B g B f B g a 0 λ x a a η 2 x + { } ˆf(αx )ĝ(α x ) : x Bf B g 0, x k { } ˆf(αx )ĝ(α x ) : x 0, x k I k ε/4 + δ( B f + B g ) ε/4 + 2C δ = ε/2, (f) where the next-to-last nequalty holds because for each B f B g one of I k (f), I k (g) s at most δ and the other s at most 1. The fnal theorem of ths secton s needed only for the APPROXCOLORING(3, Q) result. Here, the operator T acts on [q 2 ] and s assumed to have an addtonal property. Before proceedng, t s helpful to recall Defnton 2.6. Theorem 3.11 Let q be a fxed nteger and let T be a symmetrc Markov operator on [q 2 ] such that ρ = r(t ) < 1. Suppose moreover, that T has the followng property. Gven (x 1, x 2 ) chosen unformly at random and (y 1, y 2 ) chosen accordng to T appled to (x 1, x 2 ) we have that (x 2, y 2 ) s dstrbuted unformly at random. Then for any ε > 0, there exsts a δ > 0 and an nteger k such that for any functons f, g : [q] 2n [0, 1] satsfyng that for = 1,..., n I k (g) mn ( I k 2 1 (f), I k 2 1 (g)) < δ, mn ( I k 2 1 (f), I k 2 (g)) < δ, and 12 mn ( I k 2 (f), I k 2 1 (g)) < δ

13 t holds that and where µ = E[f], ν = E[g]. f, T n g F µ, U ρ (1 F 1 ν ) γ ε (9) f, T n g F µ, U ρ F ν γ + ε (10) Proof: As n Theorem 3.1, (9) follows from (10) so t s enough to prove (10). Assume frst that n addton to the three condtons above we also have that for all = 1,..., n, mn ( I k 2 (f), I k 2 (g)) < δ. (11) Then t follows that for all, ether both I k 2 1 (f) and I k 2 (g) are smaller than δ. Hence, by Clam 2.7, we know that for all we have I k 2 ( mn I k/2 ) (f), I k/2 (g) < 2δ (f) are smaller than δ or both I k 2 1 (g) and and the result then follows from Lemma However, we do not have ths extra condton and hence we have to deal wth bad coordnates for whch mn(i k 2 (f), I k 2 (g)) δ. Notce that for such t must be the case that both I k 2 1 (f) and I k 2 1 (g) are smaller than δ. Informally, the proof proceeds as follows. We frst defne functons f 1, g 1 that are obtaned from f, g by addng a small amount of nose. We then obtan f 2, g 2 from f 1, g 1 by averagng the coordnates 2 1 for bad. Fnally, we obtan f 3, g 3 from f 2, g 2 by averagng the coordnate 2 for bad. The pont here s to mantan f, T n g f 1, T n g 1 f 2, T n g 2 f 3, T n g 3. The condton n Equaton 11 now apples to f 3, g 3 and we can apply Lemma 3.10, as descrbed above. We now descrbe the proof n more detal. We frst defne f 1 = Tη n f and g 1 = Tη n g where η < 1 s chosen so that ρ j (1 η 2j ) < ε/4 for all j. As n the prevous lemma t s easy to see that and thus t suffces to prove that f 1, T n g 1 f, T n g < ε/4 f 1, T n g 1 F µ, U ρ F ν γ + 3ε/4. Let δ(ε/2, η), k(ε/2, η) be the values gven by Lemma 3.10 wth ε taken to be ε/2. Let δ = δ(ε/2, η)/2. Choose a large enough k so that 128kη k < ε 2 δ and k/2 > k(ε/2, η). We let C = k/δ and δ = ε 2 /128C. Notce that δ < δ and η k < δ. Fnally, let { B = I k 2 (f) δ, I k 2 (g) δ }. We note that B s of sze at most C. We also note that f B then we have I k 2 1 (f) < δ and I k 2 1 (g) < δ. We clam that ths mples that I 2 1(f 1 ) δ + η k < 2δ and smlarly for g. To see that, take any orthonormal bass β 0 = 1, β 1,..., β q 1 of R q and notce that we can wrte f 1 = ˆf(βx )η x β x. x [q] 2n Hence, I 2 1 (f 1 ) = x [q] 2n x ˆf(β x ) 2 η 2 x < δ + η k 13 x [q] 2n x > k ˆf(β x ) 2 δ + η k

14 where we used that the number of nonzero elements n x s at least half of that n x. Next, we defne f 2 = A 2B 1 (f 1 ) and g 2 = A 2B 1 (g 1 ) where A s the averagng operator and 2B 1 denotes the set {2 1 B}. Note that f 2 f = f 2 f B I 2 1 (f 1 ) 2Cδ. and smlarly, Thus g 2 g = g 2 g Cδ. f 1, T n g 1 f 2, T n g 2 f 1, T n g 1 f 1, T n g 2 + f 1, T n g 2 f 2, T n g 2 2 2Cδ = ε/4 where the last nequalty follows from the Cauchy-Schwartz nequalty together wth the fact that f and also T n g Hence, t suffces to prove f 2, T n g 2 F µ, U ρ F ν γ + ε/2. We now defne f 3 = A 2B (f 2 ) and g 3 = A 2B (g 2 ). Equvalently, we have f 3 = A B (f 1 ) and g 3 = A B (g 1 ). We show that f 2, T n g 2 = f 3, T n g 3. Let α x, x [q 2 ] n, be an orthonormal bass of egenvectors of T n. Then f 3, T n g 3 = x,y [q 2 ] n,x B =y B =0 ˆ f 1 (α x )ĝ 1 (α y ) α x, T n α y. (12) Moreover, snce A s a lnear operator and f 1 can be wrtten as x [q 2 ] ˆf1 n (α x )α x and smlarly for g 1, we have f 2, T n g 2 = ˆf1 (α x )ĝ 1 (α y ) A 2B 1 (α x ), T n A 2B 1 (α y ). (13) x,y [q 2 ] n Frst, notce that when x B = 0, A 2B 1 (α x ) = α x snce α x does not depend on coordnates n B. Hence, n order to show that the expressons n (12) and (13) are equal, t suffces to show that A 2B 1 (α x ), T n A 2B 1 (α y ) = 0 unless x B = y B = 0. So assume wthout loss of generalty that B s such that x 0. The above nner product can be equvalently wrtten as E z,z [q 2 ] n[a 2B 1(α x )(z) A 2B 1 (α y )(z )] where z s chosen unformly at random and z s chosen accordng to T n appled to z. Fx some arbtrary values to z 1,..., z 1, z +1,..., z n and z 1,..., z 1, z +1,..., z n and let us show that E z,z [q2 ][A 2B 1 (α x )(z) A 2B 1 (α y )(z )] = 0. Snce B, the two expressons nsde the expectaton do not depend on z,1 and z,1 (where by z,1 we mean the frst coordnate of z ). Moreover, by our assumpton on T, z,2 and z,2 are ndependent. Hence, the above expectaton s equal to E z [q 2 ][A 2B 1 (α x )(z)] E z [q 2 ][A 2B 1 (α y )(z )]. 14

15 Snce x 0, the frst expectaton s zero. Ths establshes that f 2, T n g 2 = f 3, T n g 3. The functons f 3, g 3 satsfy the property that for every = 1,..., n, ether both I k 2 1 (f 3) and I k 2 (f 3) are smaller than δ or both I k 2 1 (g 3) and I k 2 (g 3) are smaller than δ. By Clam 2.7, we get that for = 1,..., n, ether I k/2 (f 3 ) or I k/2 (g 3 ) s smaller 2δ. We can now apply Lemma 3.10 to obtan f 3, T n g 3 F µ, U ρ F ν γ + ε/2. 4 Approxmate Colorng As mentoned n the ntroducton, one of the most successful approaches to dervng hardness proofs, whch s also the one we shall take here, s by a reducton from a combnatoral problem known as the label-cover problem. To recall, n the label-cover problem we are gven an undrected graph together wth a constrant (.e., a bnary relaton on {1,..., R}) for each edge. The goal s to label the vertces wth values from {1,..., R} such that the number of satsfed constrants s maxmzed, where a constrant s satsfed f the labels on the two ncdent vertces satsfy the relaton assocated wth t. It s known that n ths problem (as well as n many of ts varants), t s NP-hard to tell whether there exsts a way to label the vertces such that all constrants are satsfed, or whether any labelng satsfes at most, say, 0.01 fracton of the constrants. Our reducton follows the general paradgm of [6, 25]. Each vertex of the label-cover nstance s replaced wth a block of vertces, often known as a gadget. In our case, the gadget s smply a set of q R vertces, and we thnk of them as correspondng to elements of [q] R. We then add edges between these gadgets n a way that encodes the label-cover constrants. For the reducton to work, we need to have two propertes. Frst, f the label-cover s satsfable, then the resultng graph s q-colorable (ths s known as the completeness part). Ths property would follow mmedately from our constructon. The more dffcult part s to show that f there s no way to satsfy more than 0.01 fracton of the constrants n the label-cover nstance, then the resultng graph has chromatc number at least Q (ths s known as the soundness part). The way ths s shown s by assumng towards contradcton that there exsts a colorng wth less than Q colors, and then decodng t nto a labelng of the label-cover nstance that satsfes more than 0.01 of the constrants. It s ths part that s usually the most dffcult to establsh. In our case, we wll apply Theorem 1.2 to detect nfluental coordnates n each block based on the colorng gven to t. The above outlne hdes one very mportant fact: for our reducton to work, the label-cover nstances we use must have constrants of a very specfc form. For example, we mght requre all constrants to be bjectons,.e., a bnary relaton n whch any labellng of one vertex determnes the other, and vce versa. We call ths specal case 1 1-label-cover. We wll also consder two other restrctons of the label-cover problem, whch we call the 2 2-label-cover and the <-label-cover (read: alpha-label-cover). The precse defntons of these problems wll appear later. As already dscussed n the ntroducton, these specal cases of the label-cover problem are not known to be NP-hard. Nevertheless, Khot s unque games conjecture [30] asserts that such problems are n fact NP-hard. The conjecture has been heavly scrutnzed [36, 13, 22, 14], and so far there s no evdence aganst the conjecture. Our Hardness Results: We now descrbe our hardness results n more detal. In addton to APPROXCOLORING(q, Q), we consder the followng computatonal problem, defned for any ε > 0. 15

16 ALMOST3COLORING ε : Gven a graph G = (V, E), decde between There exsts a set V V, V (1 ε) V such that χ(g V ) 3 where G V s the graph nduced by V. Every ndependent set S V n G has sze S ε V. Observe that these two tems are mutually exclusve for ε < 1/4. We consder three conjectures: the 1 1 conjecture, the 2 2 conjecture, and the < conjecture. Roughly speakng, each conjecture says that n the correspondng label-cover nstances t s NPhard to dstngush between completely satsfable nstances, and nstances that are almost completely unsatsfable. The only excepton s the 1 1 conjecture: t s easy to see that checkng f a 1 1-label-cover s completely satsfable can be done n polynomal tme. Hence the 1 1 conjecture says that t s NP-hard to dstngush between almost completely satsfable and almost completely unsatsfable. Ths drawback of the 1 1 conjecture, often known as mperfect completeness, prevents us from usng t for provng the hardness of the approxmate colorng problem. Instead, we use t to show hardness of the (somewhat harder) problem ALMOST3COLORING. We present three reductons, each from a dfferent specal case of the label-cover problem. These reductons yeld the followng. For any constant ε > 0, the 1 1 conjecture mples the NP-hardness of ALMOST3COLORING ε. For any constant Q > 4, the 2 2 conjecture mples that APPROXCOLORING(4, Q) s NPhard. Ths also holds for APPROXCOLORING(q, Q) for any q 4. For any constant Q > 3, the < conjecture mples that APPROXCOLORING(3, Q) s NP-hard. Ths also holds for APPROXCOLORING(q, Q) for any q 3. We remark that Khot s orgnal conjectures actually refer to slghtly dfferent varants of the label-cover problem. Most notably, hs label-cover nstances are bpartte. However, as we shall show later, Khot s unque-games conjecture mples our 1 1 conjecture, and Khot s two-to-one conjecture mples our 2 2 conjecture. The < conjecture s, to the best of our knowledge, new, and seems to be not weaker than the 2 2 conjecture. Future work: Our constructons can be extended n several ways. Frst, usng smlar technques, one can show hardness of APPROXCOLORING(q, Q) based on the d-to-1 conjecture of Khot for larger values of d (and not only d = 2 as we do here). It would be nterestng to fnd out how q depends on d. Second, by strengthenng the current conjectures to sub-constant values, one can obtan hardness for Q that depends on n, the number of vertces n the graph. Agan, t s nterestng to see how large Q can be. Fnally, let us menton that n all our reductons we n fact show n the soundness case that there are no ndependent sets of relatve sze larger than ε for arbtrarly small constant ε (note that ths s somewhat stronger than showng that there s no Q- colorng). In fact, a more careful analyss can be used to obtan the stronger statement that there are no almost-ndependent sets of relatve sze larger than ε. Organzaton: In Secton 4.1, we descrbe the three conjectures along wth some defntons. We then prove the three reductons mentoned above. The three reductons are very smlar, each combnng a conjecture wth an approprately constructed nose operator. In Secton 4.2 we descrbe the three nose operators, and n Secton 4.3 we spell out the reductons. Then, n Sectons 4.4 and 4.5, we prove the completeness and soundness of the three reductons. 16

17 4.1 Label-cover problems Defnton 4.1 A label-cover nstance s a trple G = ((V, E), R, Ψ) where (V, E) s a graph, R s an nteger, and Ψ = {ψ } e {1,..., R} 2 e E s a set of constrants (relatons), one for each edge. For a gven labelng L : V {1,..., R}, let sat L (G) = Pr [(L(u), L(v)) ψ e], e=(u,v) E sat(g) = max L (sat L(G)). For t, R N let ( R t) denote the collecton of all subsets of {1,..., R} whose sze s at most t. Defnton 4.2 A t-labelng s a functon L : V ( R t) that labels each vertex v V wth a subset of values L(v) {1,..., R} such that L(v) t for all v V. A t-labelng L s sad to satsfy a constrant ψ {1,..., R} 2 over varables u and v ff there are a L(u), b L(v) such that (a, b) ψ. In other words, ff (L(u) L(v)) ψ. In the specal case of t = 1, a 1-labelng s essentally a labelng L : V {1,..., R} (except that some vertces mght get no label). Smlar to the defnton of sat(g), we also defne sat(g) ( nduced-sat ) to be the relatve sze of the largest set of vertces for whch there s a labelng that satsfes all of the nduced edges. sat(g) = max S { S V }. L : S {1,..., R} that satsfes all the constrants nduced by S V Let sat t (G) denote the relatve sze of the largest set of vertces S V for whch there s a t-labelng that satsfes all the constrants nduced by S. { ( ) } S sat t (G) = max R S V L : S that satsfes all the constrants nduced by S V. t We next descrbe three conjectures on whch our reductons are based. The man dfference between the three conjectures s n the type of constrants that are allowed. The three types are defned next, and also llustrated n Fgure 1. Defnton 4.3 (1 1-constrant) A 1 1 constrant s a relaton {(, π())} R =1, where π : {1,..., R} {1,..., R} s any arbtrary permutaton. The constrant s satsfed by (a, b) ff b = π(a). Defnton 4.4 (2 2-constrant) A 2 2 constrant s defned by a par of permutatons π 1, π 2 : {1,..., 2R} {1,..., 2R} and the relaton 2 2 = {(2, 2), (2, 2 1), (2 1, 2), (2 1, 2 1)} R =1. The constrant s satsfed by (a, b) ff (π 1 1 (a), π 1(b)) Defnton 4.5 ( <-constrant) An < constrant s defned by a par of permutatons π 1, π 2 : {1,..., 2R} {1,..., 2R} and the relaton The constrant s satsfed by (a, b) ff (π 1 1 < = {(2 1, 2 1), (2, 2 1), (2 1, 2)} R =1. (a), π 1(b)) <. 2 17

18 Fgure 1: Three types of constrants (top to bottom): 1 1, <, 2 2 Conjecture 4.6 (1 1 Conjecture) For any ε, ζ > 0 and t N there exsts some R N such that gven a label-cover nstance G = (V, E), R, Ψ where all constrants are 1 1-constrants, t s NP-hard to decde between sat(g) 1 ζ sat t (G) < ε It s easy to see that the above problem s n P when ζ = 0. Conjecture 4.7 (2 2 Conjecture) For any ε > 0 and t N there exsts some R N such that gven a label-cover nstance G = (V, E), 2R, Ψ where all constrants are 2 2-constrants, t s NP-hard to decde between sat(g) = 1 sat t (G) < ε The above two conjectures are no stronger than the correspondng conjectures of Khot. Namely, our 1 1 conjecture s not stronger than Khot s (bpartte) unque games conjecture, and our 2 2 conjecture s not stronger than Khot s (bpartte) two-to-one conjecture. The former clam was already proven by Khot and Regev n [32]. The latter clam s proven n a smlar way. For completeness, we nclude both proofs n Appendx A. We also make a thrd conjecture that s used n our reducton to APPROXCOLORING(3, Q). Ths conjecture seems stronger than Khot s conjectures. Conjecture 4.8 ( < Conjecture) For any ε > 0 and t N there exsts some R N such that gven a label-cover nstance G = (V, E), 2R, Ψ where all constrants are <-constrants, t s NP-hard to decde between sat(g) = 1 sat t (G) < ε Remark: The (strange-lookng) <-shaped constrants have already appeared before n [16]. There, t s essentally proven that for all ε, ζ > 0 gven a label-cover nstance G where all constrants are <-constrants, t s NP-hard to dstngush between sat(g) > 1 ζ 18

19 sat t=1 (G) < ε The man dfference between ther theorem and our conjecture s that n our conjecture we consder any constant t, whle n ther case t s 1. Another dfference s that n our conjecture we assume perfect completeness (.e., sat(g) = 1) Nose operators We now defne the nose operators correspondng to the 1 1-constrants, <-constrants, and 2 2-constrants. The nose operator that corresponds to the 1 1-constrants s the smplest, and acts on {0, 1, 2}. For the other two cases, snce the constrants nvolve pars of coordnates, we obtan an operator on {0, 1, 2} 2 and an operator on {0, 1, 2, 3} 2. See Fgure 2 for an llustraton. (a) (b) (c) Fgure 2: Three nose operators (edge weghts not shown) correspondng to: (a) 1 1, (b) <, and (c) 2 2. Lemma 4.9 There exsts a symmetrc Markov operator T on {0, 1, 2} such that r(t ) < 1 and such that f T (x y) > 0 then x y. Proof: Take the operator gven by 0 1/2 1/2 T = 1/2 0 1/2. 1/2 1/2 0 See Fgure 2(a). Lemma 4.10 There exsts a symmetrc Markov operator T on {0, 1, 2, 3} 2 such that r(t ) < 1 and such that f T ((x 1, x 2 ) (y 1, y 2 )) > 0 then {x 1, x 2 } {y 1, y 2 } =. Proof: Our operator has three types of transtons, wth transtons probabltes β 1, β 2, and β 3. 1 The man dea n ther constructon s to take an NP-hard label-cover as gven by the parallel repetton theorem appled to the PCP theorem, and to construct a new <-label-cover wth ( ) R X l varables correspondng to all subsets of sze l of X {1,..., R}, where l = cr for some large constant c. The number of labels s equal to the number of bnary strngs of length l whose Hammng weght s at least l/2r. Constrants are placed between any par of l-tuples for whch () ther ntersecton has sze l 1, and () the unque elements, one from each l-tuple, correspond to an nconsstency n the orgnal label-cover. These constrants check for agreement on ther ntersecton and that not both unque elements are 1, and are therefore essentally <-constrants. 19

20 Wth probablty β 1 we have (x, x) (y, y) where x y. Wth probablty β 2 we have (x, x) (y, z) where x, y, z are all dfferent. Wth probablty β 3 we have (x, y) (z, w) where x, y, z, w are all dfferent. These transtons are llustrated n Fgure 2(c). For T to be a symmetrc Markov operator, we need that β 1, β 2 and β 3 are non-negatve and 3β 1 + 6β 2 = 1, 2β 2 + 2β 3 = 1. It s easy to see that the two equatons above have solutons bounded away from 0 and that the correspondng operator has r(t ) < 1. For example, choose β 1 = 1 12, β 2 = 1 8, and β 3 = 3 8. Lemma 4.11 There exsts a symmetrc Markov operator T on {0, 1, 2} 2 such that r(t ) < 1 and such that f T ((x 1, x 2 ) (y 1, y 2 )) > 0 then x 1 / {y 1, y 2 } and y 1 / {x 1, x 2 }. Moreover, the nose operator T satsfes the followng property. Let (x 1, x 2 ) be chosen accordng to the unform dstrbuton and (y 1, y 2 ) be chosen accordng T appled to (x 1, x 2 ). Then the dstrbuton of (x 2, y 2 ) s unform. Proof: The proof resembles the prevous proof. Agan there are 3 types of transtons. Wth probablty β 1 we have (x, x) (y, y) where x y. Wth probablty β 2 we have (x, x) (y, z) where x, y, z are all dfferent. Wth probablty β 3 we have (x, y) (z, y) where x, y, z are all dfferent. For T to be a symmetrc Markov operator we requre β 1, β 2 and β 3 to be non-negatve and 2β 1 + 2β 2 = 1, β 2 + β 3 = 1. For the unformty property, assume (x 1, x 2 ) s chosen accordng to the unform dstrbuton and (y 1, y 2 ) s chosen accordng T appled to (x 1, x 2 ). It s not dffcult to verfy that each of the nne possble settngs of (x 2, y 2 ) s obtaned wth probablty ether 2β 3 /9 (f x 2 = y 2 ) or β 1 /9 + 2β 2 /9 (otherwse). Therefore, the unformty property amounts to the equaton β 1 + 2β 2 = 2β 3. It s easy to see that β 2 = β 3 = 1 2 and β 1 = 0 s the soluton of all equatons and that the correspondng operator has r(t ) < 1. Ths operator s llustrated n Fgure 2(b). 4.3 The three reductons The basc dea n all three reductons s to take a label-cover nstance and to replace each vertex wth a block of q R vertces, correspondng to the q-ary hypercube [q] R. The ntended way to q- color ths block s by colorng x [q] R accordng to x where s the label gven to ths block. One can thnk of ths colorng as an encodng of the label. We wll essentally prove that any other colorng of ths block that uses relatvely few colors, can be lst-decoded nto at most t labels from {1,..., R}. By properly defnng edges connectng these blocks, we can guarantee that the lsts decoded from two blocks can be used as t-labelngs for the label-cover nstance. In the rest of ths secton, we use the followng notaton. For a vector x = (x 1,..., x n ) and a permutaton π on {1,..., n}, we defne x π = (x π(1),..., x π(n) ). 20

Conditional Hardness for Approximate Coloring

Conditional Hardness for Approximate Coloring Condtonal Hardness for Approxmate Colorng Irt Dnur Elchanan Mossel Oded Regev November 3, 2005 Abstract We study the APPROXIMATE-COLORING(q, Q) problem: Gven a graph G, decde whether χ(g) q or χ(g) Q (where

More information

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016 U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Complete subgraphs in multipartite graphs

Complete subgraphs in multipartite graphs Complete subgraphs n multpartte graphs FLORIAN PFENDER Unverstät Rostock, Insttut für Mathematk D-18057 Rostock, Germany Floran.Pfender@un-rostock.de Abstract Turán s Theorem states that every graph G

More information

NP-Completeness : Proofs

NP-Completeness : Proofs NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

Edge Isoperimetric Inequalities

Edge Isoperimetric Inequalities November 7, 2005 Ross M. Rchardson Edge Isopermetrc Inequaltes 1 Four Questons Recall that n the last lecture we looked at the problem of sopermetrc nequaltes n the hypercube, Q n. Our noton of boundary

More information

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011 Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

BOUNDEDNESS OF THE RIESZ TRANSFORM WITH MATRIX A 2 WEIGHTS

BOUNDEDNESS OF THE RIESZ TRANSFORM WITH MATRIX A 2 WEIGHTS BOUNDEDNESS OF THE IESZ TANSFOM WITH MATIX A WEIGHTS Introducton Let L = L ( n, be the functon space wth norm (ˆ f L = f(x C dx d < For a d d matrx valued functon W : wth W (x postve sem-defnte for all

More information

Maximizing the number of nonnegative subsets

Maximizing the number of nonnegative subsets Maxmzng the number of nonnegatve subsets Noga Alon Hao Huang December 1, 213 Abstract Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what s the maxmum

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

MATH 5707 HOMEWORK 4 SOLUTIONS 2. 2 i 2p i E(X i ) + E(Xi 2 ) ä i=1. i=1

MATH 5707 HOMEWORK 4 SOLUTIONS 2. 2 i 2p i E(X i ) + E(Xi 2 ) ä i=1. i=1 MATH 5707 HOMEWORK 4 SOLUTIONS CİHAN BAHRAN 1. Let v 1,..., v n R m, all lengths v are not larger than 1. Let p 1,..., p n [0, 1] be arbtrary and set w = p 1 v 1 + + p n v n. Then there exst ε 1,..., ε

More information

Affine transformations and convexity

Affine transformations and convexity Affne transformatons and convexty The purpose of ths document s to prove some basc propertes of affne transformatons nvolvng convex sets. Here are a few onlne references for background nformaton: http://math.ucr.edu/

More information

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem. prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove

More information

Notes on Frequency Estimation in Data Streams

Notes on Frequency Estimation in Data Streams Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to

More information

CSCE 790S Background Results

CSCE 790S Background Results CSCE 790S Background Results Stephen A. Fenner September 8, 011 Abstract These results are background to the course CSCE 790S/CSCE 790B, Quantum Computaton and Informaton (Sprng 007 and Fall 011). Each

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Foundations of Arithmetic

Foundations of Arithmetic Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an

More information

Lecture 2: Gram-Schmidt Vectors and the LLL Algorithm

Lecture 2: Gram-Schmidt Vectors and the LLL Algorithm NYU, Fall 2016 Lattces Mn Course Lecture 2: Gram-Schmdt Vectors and the LLL Algorthm Lecturer: Noah Stephens-Davdowtz 2.1 The Shortest Vector Problem In our last lecture, we consdered short solutons to

More information

Random Walks on Digraphs

Random Walks on Digraphs Random Walks on Dgraphs J. J. P. Veerman October 23, 27 Introducton Let V = {, n} be a vertex set and S a non-negatve row-stochastc matrx (.e. rows sum to ). V and S defne a dgraph G = G(V, S) and a drected

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens THE CHINESE REMAINDER THEOREM KEITH CONRAD We should thank the Chnese for ther wonderful remander theorem. Glenn Stevens 1. Introducton The Chnese remander theorem says we can unquely solve any par of

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.65/15.070J Fall 013 Lecture 1 10/1/013 Martngale Concentraton Inequaltes and Applcatons Content. 1. Exponental concentraton for martngales wth bounded ncrements.

More information

Min Cut, Fast Cut, Polynomial Identities

Min Cut, Fast Cut, Polynomial Identities Randomzed Algorthms, Summer 016 Mn Cut, Fast Cut, Polynomal Identtes Instructor: Thomas Kesselhem and Kurt Mehlhorn 1 Mn Cuts n Graphs Lecture (5 pages) Throughout ths secton, G = (V, E) s a mult-graph.

More information

Lecture 4: Universal Hash Functions/Streaming Cont d

Lecture 4: Universal Hash Functions/Streaming Cont d CSE 5: Desgn and Analyss of Algorthms I Sprng 06 Lecture 4: Unversal Hash Functons/Streamng Cont d Lecturer: Shayan Oves Gharan Aprl 6th Scrbe: Jacob Schreber Dsclamer: These notes have not been subjected

More information

Lecture Space-Bounded Derandomization

Lecture Space-Bounded Derandomization Notes on Complexty Theory Last updated: October, 2008 Jonathan Katz Lecture Space-Bounded Derandomzaton 1 Space-Bounded Derandomzaton We now dscuss derandomzaton of space-bounded algorthms. Here non-trval

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2 Salmon: Lectures on partal dfferental equatons 5. Classfcaton of second-order equatons There are general methods for classfyng hgher-order partal dfferental equatons. One s very general (applyng even to

More information

Stanford University CS254: Computational Complexity Notes 7 Luca Trevisan January 29, Notes for Lecture 7

Stanford University CS254: Computational Complexity Notes 7 Luca Trevisan January 29, Notes for Lecture 7 Stanford Unversty CS54: Computatonal Complexty Notes 7 Luca Trevsan January 9, 014 Notes for Lecture 7 1 Approxmate Countng wt an N oracle We complete te proof of te followng result: Teorem 1 For every

More information

Finding Dense Subgraphs in G(n, 1/2)

Finding Dense Subgraphs in G(n, 1/2) Fndng Dense Subgraphs n Gn, 1/ Atsh Das Sarma 1, Amt Deshpande, and Rav Kannan 1 Georga Insttute of Technology,atsh@cc.gatech.edu Mcrosoft Research-Bangalore,amtdesh,annan@mcrosoft.com Abstract. Fndng

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Lecture 4. Instructor: Haipeng Luo

Lecture 4. Instructor: Haipeng Luo Lecture 4 Instructor: Hapeng Luo In the followng lectures, we focus on the expert problem and study more adaptve algorthms. Although Hedge s proven to be worst-case optmal, one may wonder how well t would

More information

COS 521: Advanced Algorithms Game Theory and Linear Programming

COS 521: Advanced Algorithms Game Theory and Linear Programming COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton

More information

arxiv: v1 [quant-ph] 6 Sep 2007

arxiv: v1 [quant-ph] 6 Sep 2007 An Explct Constructon of Quantum Expanders Avraham Ben-Aroya Oded Schwartz Amnon Ta-Shma arxv:0709.0911v1 [quant-ph] 6 Sep 2007 Abstract Quantum expanders are a natural generalzaton of classcal expanders.

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

Lecture 17 : Stochastic Processes II

Lecture 17 : Stochastic Processes II : Stochastc Processes II 1 Contnuous-tme stochastc process So far we have studed dscrete-tme stochastc processes. We studed the concept of Makov chans and martngales, tme seres analyss, and regresson analyss

More information

Calculation of time complexity (3%)

Calculation of time complexity (3%) Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

n ). This is tight for all admissible values of t, k and n. k t + + n t

n ). This is tight for all admissible values of t, k and n. k t + + n t MAXIMIZING THE NUMBER OF NONNEGATIVE SUBSETS NOGA ALON, HAROUT AYDINIAN, AND HAO HUANG Abstract. Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what

More information

Lecture 3. Ax x i a i. i i

Lecture 3. Ax x i a i. i i 18.409 The Behavor of Algorthms n Practce 2/14/2 Lecturer: Dan Spelman Lecture 3 Scrbe: Arvnd Sankar 1 Largest sngular value In order to bound the condton number, we need an upper bound on the largest

More information

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0 MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

a b a In case b 0, a being divisible by b is the same as to say that

a b a In case b 0, a being divisible by b is the same as to say that Secton 6.2 Dvsblty among the ntegers An nteger a ε s dvsble by b ε f there s an nteger c ε such that a = bc. Note that s dvsble by any nteger b, snce = b. On the other hand, a s dvsble by only f a = :

More information

The Second Anti-Mathima on Game Theory

The Second Anti-Mathima on Game Theory The Second Ant-Mathma on Game Theory Ath. Kehagas December 1 2006 1 Introducton In ths note we wll examne the noton of game equlbrum for three types of games 1. 2-player 2-acton zero-sum games 2. 2-player

More information

12 MATH 101A: ALGEBRA I, PART C: MULTILINEAR ALGEBRA. 4. Tensor product

12 MATH 101A: ALGEBRA I, PART C: MULTILINEAR ALGEBRA. 4. Tensor product 12 MATH 101A: ALGEBRA I, PART C: MULTILINEAR ALGEBRA Here s an outlne of what I dd: (1) categorcal defnton (2) constructon (3) lst of basc propertes (4) dstrbutve property (5) rght exactness (6) localzaton

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

The L(2, 1)-Labeling on -Product of Graphs

The L(2, 1)-Labeling on -Product of Graphs Annals of Pure and Appled Mathematcs Vol 0, No, 05, 9-39 ISSN: 79-087X (P, 79-0888(onlne Publshed on 7 Aprl 05 wwwresearchmathscorg Annals of The L(, -Labelng on -Product of Graphs P Pradhan and Kamesh

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Communication Complexity 16:198: February Lecture 4. x ij y ij

Communication Complexity 16:198: February Lecture 4. x ij y ij Communcaton Complexty 16:198:671 09 February 2010 Lecture 4 Lecturer: Troy Lee Scrbe: Rajat Mttal 1 Homework problem : Trbes We wll solve the thrd queston n the homework. The goal s to show that the nondetermnstc

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES

TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES SVANTE JANSON Abstract. We gve explct bounds for the tal probabltes for sums of ndependent geometrc or exponental varables, possbly wth dfferent

More information

5 The Rational Canonical Form

5 The Rational Canonical Form 5 The Ratonal Canoncal Form Here p s a monc rreducble factor of the mnmum polynomal m T and s not necessarly of degree one Let F p denote the feld constructed earler n the course, consstng of all matrces

More information

Report on Image warping

Report on Image warping Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.

More information

MATH 241B FUNCTIONAL ANALYSIS - NOTES EXAMPLES OF C ALGEBRAS

MATH 241B FUNCTIONAL ANALYSIS - NOTES EXAMPLES OF C ALGEBRAS MATH 241B FUNCTIONAL ANALYSIS - NOTES EXAMPLES OF C ALGEBRAS These are nformal notes whch cover some of the materal whch s not n the course book. The man purpose s to gve a number of nontrval examples

More information

Finding Primitive Roots Pseudo-Deterministically

Finding Primitive Roots Pseudo-Deterministically Electronc Colloquum on Computatonal Complexty, Report No 207 (205) Fndng Prmtve Roots Pseudo-Determnstcally Ofer Grossman December 22, 205 Abstract Pseudo-determnstc algorthms are randomzed search algorthms

More information

Lecture 4: Constant Time SVD Approximation

Lecture 4: Constant Time SVD Approximation Spectral Algorthms and Representatons eb. 17, Mar. 3 and 8, 005 Lecture 4: Constant Tme SVD Approxmaton Lecturer: Santosh Vempala Scrbe: Jangzhuo Chen Ths topc conssts of three lectures 0/17, 03/03, 03/08),

More information

FACTORIZATION IN KRULL MONOIDS WITH INFINITE CLASS GROUP

FACTORIZATION IN KRULL MONOIDS WITH INFINITE CLASS GROUP C O L L O Q U I U M M A T H E M A T I C U M VOL. 80 1999 NO. 1 FACTORIZATION IN KRULL MONOIDS WITH INFINITE CLASS GROUP BY FLORIAN K A I N R A T H (GRAZ) Abstract. Let H be a Krull monod wth nfnte class

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

Convergence of random processes

Convergence of random processes DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large

More information

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty Addtonal Codes usng Fnte Dfference Method Benamn Moll 1 HJB Equaton for Consumpton-Savng Problem Wthout Uncertanty Before consderng the case wth stochastc ncome n http://www.prnceton.edu/~moll/ HACTproect/HACT_Numercal_Appendx.pdf,

More information

C/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1

C/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1 C/CS/Phy9 Problem Set 3 Solutons Out: Oct, 8 Suppose you have two qubts n some arbtrary entangled state ψ You apply the teleportaton protocol to each of the qubts separately What s the resultng state obtaned

More information

Affine and Riemannian Connections

Affine and Riemannian Connections Affne and Remannan Connectons Semnar Remannan Geometry Summer Term 2015 Prof Dr Anna Wenhard and Dr Gye-Seon Lee Jakob Ullmann Notaton: X(M) space of smooth vector felds on M D(M) space of smooth functons

More information

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1 Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

Perron Vectors of an Irreducible Nonnegative Interval Matrix

Perron Vectors of an Irreducible Nonnegative Interval Matrix Perron Vectors of an Irreducble Nonnegatve Interval Matrx Jr Rohn August 4 2005 Abstract As s well known an rreducble nonnegatve matrx possesses a unquely determned Perron vector. As the man result of

More information

Graph Reconstruction by Permutations

Graph Reconstruction by Permutations Graph Reconstructon by Permutatons Perre Ille and Wllam Kocay* Insttut de Mathémathques de Lumny CNRS UMR 6206 163 avenue de Lumny, Case 907 13288 Marselle Cedex 9, France e-mal: lle@ml.unv-mrs.fr Computer

More information

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016 CS 29-128: Algorthms and Uncertanty Lecture 17 Date: October 26, 2016 Instructor: Nkhl Bansal Scrbe: Mchael Denns 1 Introducton In ths lecture we wll be lookng nto the secretary problem, and an nterestng

More information

Formulas for the Determinant

Formulas for the Determinant page 224 224 CHAPTER 3 Determnants e t te t e 2t 38 A = e t 2te t e 2t e t te t 2e 2t 39 If 123 A = 345, 456 compute the matrx product A adj(a) What can you conclude about det(a)? For Problems 40 43, use

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Some basic inequalities. Definition. Let V be a vector space over the complex numbers. An inner product is given by a function, V V C

Some basic inequalities. Definition. Let V be a vector space over the complex numbers. An inner product is given by a function, V V C Some basc nequaltes Defnton. Let V be a vector space over the complex numbers. An nner product s gven by a functon, V V C (x, y) x, y satsfyng the followng propertes (for all x V, y V and c C) (1) x +

More information

Homework Assignment 3 Due in class, Thursday October 15

Homework Assignment 3 Due in class, Thursday October 15 Homework Assgnment 3 Due n class, Thursday October 15 SDS 383C Statstcal Modelng I 1 Rdge regresson and Lasso 1. Get the Prostrate cancer data from http://statweb.stanford.edu/~tbs/elemstatlearn/ datasets/prostate.data.

More information

Volume 18 Figure 1. Notation 1. Notation 2. Observation 1. Remark 1. Remark 2. Remark 3. Remark 4. Remark 5. Remark 6. Theorem A [2]. Theorem B [2].

Volume 18 Figure 1. Notation 1. Notation 2. Observation 1. Remark 1. Remark 2. Remark 3. Remark 4. Remark 5. Remark 6. Theorem A [2]. Theorem B [2]. Bulletn of Mathematcal Scences and Applcatons Submtted: 016-04-07 ISSN: 78-9634, Vol. 18, pp 1-10 Revsed: 016-09-08 do:10.1805/www.scpress.com/bmsa.18.1 Accepted: 016-10-13 017 ScPress Ltd., Swtzerland

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Spectral Graph Theory and its Applications September 16, Lecture 5

Spectral Graph Theory and its Applications September 16, Lecture 5 Spectral Graph Theory and ts Applcatons September 16, 2004 Lecturer: Danel A. Spelman Lecture 5 5.1 Introducton In ths lecture, we wll prove the followng theorem: Theorem 5.1.1. Let G be a planar graph

More information

Error Probability for M Signals

Error Probability for M Signals Chapter 3 rror Probablty for M Sgnals In ths chapter we dscuss the error probablty n decdng whch of M sgnals was transmtted over an arbtrary channel. We assume the sgnals are represented by a set of orthonormal

More information

Vapnik-Chervonenkis theory

Vapnik-Chervonenkis theory Vapnk-Chervonenks theory Rs Kondor June 13, 2008 For the purposes of ths lecture, we restrct ourselves to the bnary supervsed batch learnng settng. We assume that we have an nput space X, and an unknown

More information

Lecture 3: Shannon s Theorem

Lecture 3: Shannon s Theorem CSE 533: Error-Correctng Codes (Autumn 006 Lecture 3: Shannon s Theorem October 9, 006 Lecturer: Venkatesan Guruswam Scrbe: Wdad Machmouch 1 Communcaton Model The communcaton model we are usng conssts

More information

Integrals and Invariants of Euler-Lagrange Equations

Integrals and Invariants of Euler-Lagrange Equations Lecture 16 Integrals and Invarants of Euler-Lagrange Equatons ME 256 at the Indan Insttute of Scence, Bengaluru Varatonal Methods and Structural Optmzaton G. K. Ananthasuresh Professor, Mechancal Engneerng,

More information

Appendix for Causal Interaction in Factorial Experiments: Application to Conjoint Analysis

Appendix for Causal Interaction in Factorial Experiments: Application to Conjoint Analysis A Appendx for Causal Interacton n Factoral Experments: Applcaton to Conjont Analyss Mathematcal Appendx: Proofs of Theorems A. Lemmas Below, we descrbe all the lemmas, whch are used to prove the man theorems

More information

Case A. P k = Ni ( 2L i k 1 ) + (# big cells) 10d 2 P k.

Case A. P k = Ni ( 2L i k 1 ) + (# big cells) 10d 2 P k. THE CELLULAR METHOD In ths lecture, we ntroduce the cellular method as an approach to ncdence geometry theorems lke the Szemeréd-Trotter theorem. The method was ntroduced n the paper Combnatoral complexty

More information

Linear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space.

Linear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space. Lnear, affne, and convex sets and hulls In the sequel, unless otherwse specfed, X wll denote a real vector space. Lnes and segments. Gven two ponts x, y X, we defne xy = {x + t(y x) : t R} = {(1 t)x +

More information

20. Mon, Oct. 13 What we have done so far corresponds roughly to Chapters 2 & 3 of Lee. Now we turn to Chapter 4. The first idea is connectedness.

20. Mon, Oct. 13 What we have done so far corresponds roughly to Chapters 2 & 3 of Lee. Now we turn to Chapter 4. The first idea is connectedness. 20. Mon, Oct. 13 What we have done so far corresponds roughly to Chapters 2 & 3 of Lee. Now we turn to Chapter 4. The frst dea s connectedness. Essentally, we want to say that a space cannot be decomposed

More information

arxiv: v1 [math.co] 1 Mar 2014

arxiv: v1 [math.co] 1 Mar 2014 Unon-ntersectng set systems Gyula O.H. Katona and Dánel T. Nagy March 4, 014 arxv:1403.0088v1 [math.co] 1 Mar 014 Abstract Three ntersecton theorems are proved. Frst, we determne the sze of the largest

More information

Stanford University Graph Partitioning and Expanders Handout 3 Luca Trevisan May 8, 2013

Stanford University Graph Partitioning and Expanders Handout 3 Luca Trevisan May 8, 2013 Stanford Unversty Graph Parttonng and Expanders Handout 3 Luca Trevsan May 8, 03 Lecture 3 In whch we analyze the power method to approxmate egenvalues and egenvectors, and we descrbe some more algorthmc

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

CHAPTER III Neural Networks as Associative Memory

CHAPTER III Neural Networks as Associative Memory CHAPTER III Neural Networs as Assocatve Memory Introducton One of the prmary functons of the bran s assocatve memory. We assocate the faces wth names, letters wth sounds, or we can recognze the people

More information

Module 2. Random Processes. Version 2 ECE IIT, Kharagpur

Module 2. Random Processes. Version 2 ECE IIT, Kharagpur Module Random Processes Lesson 6 Functons of Random Varables After readng ths lesson, ou wll learn about cdf of functon of a random varable. Formula for determnng the pdf of a random varable. Let, X be

More information