Dmenson Reducton for Polynomals over Gaussan Space and Applcatons Badh Ghaz Prtsh Kamath Prasad Raghavendra arxv:708.03808v cs.cc Aug 07 August 5, 07 Abstract In ths work we ntroduce a new technque for reducng the dmenson of the ambent space of low-degree polynomals n the Gaussan space whle preservng ther relatve correlaton structure. As applcatons, we address the followng problems: I) Computablty of the Approxmately Optmal Nose Stable functon over Gaussan space. The goal here s to fnd a partton of R n nto k parts, that maxmzes the nose stablty. An ε-optmal partton s one whch s wthn addtve ε of the optmal nose stablty. De, Mossel & Neeman CCC 07) rased the queston of an explct computable) bound on the dmenson n 0 ε) n whch we can fnd an ε-optmal partton. De et al. already provde such an explct bound. Usng our dmenson reducton technque, we are able to obtan mproved explct bounds on the dmenson n 0 ε). II) Decdablty of Approxmate Non-Interactve Smulaton of Jont Dstrbutons. A non-nteractve smulaton problem s specfed by two dstrbutons Px, y) and Qu, v): The goal s to determne f two players, Alce and Bob, that observe sequences X n and Y n respectvely where{x, Y )} n = are drawn..d. from Px, y) can generate pars U and V respectvely wthout communcatng wth each other) wth a ont dstrbuton that s arbtrarly close n total varaton to Qu, v). Even when P and Q are extremely smple, t s open n several cases f P can smulate Q. Ghaz, Kamath & Sudan FOCS 06) formulated a gap problem of decdng whether there exsts a non-nteractve smulaton protocol that comes ε-close to smulatng Q, or does every nonnteractve smulaton protocol reman ε-far from smulatng Q? The man underlyng challenge here s to determne an explct computable) upper bound on the number of samples n 0 ε) that can be drawn from Px, y) to get ε-close to Q f t were possble at all). Whle Ghaz et al. answered the challenge n the specal case where Q s a ont dstrbuton over {0, } {0, }, t remaned open to answer the case where Q s a dstrbuton over larger alphabet, say k k for k >. Recently De, Mossel & Neeman n a follow-up work), address ths challenge for all k. In ths work, we are able to recover ths result as well, wth mproved explct bounds on n 0 ε). Our technque of dmenson reducton for low-degree polynomals s smple and analogous to the Johnson-Lndenstrauss lemma, and could be of ndependent nterest. MIT, Supported n parts by NSF CCF-650733 and CCF-4069. Emal: badh@mt.edu MIT. Supported n parts by NSF CCF-40956, CCF-4069, CCF-8547 and CCF-650733. Emal: prtsh@mt.edu UC Berkeley. Research supported by Okawa Research Grant and NSF CCF-408643. Emal: raghavendra@berkeley.edu
Contents Introducton. Gaussan Isopermetry & Nose Stablty.............................. Non-Interactve Smulaton of Jont Dstrbutons........................ 3.3 NIS from Gaussan Sources & the MNS queston........................ 4.4 NIS from Arbtrary Dscrete Sources............................... 5.5 Dmenson Reducton for Low-Degree Polynomals over Gaussan Space.......... 6.6 Related Work and Other Motvatons............................... 8.7 Comparsons wth recent works of De, Mossel & Neeman................... 8.8 Outlne of Proofs.......................................... 9.9 Organzaton of the Paper..................................... 0 Prelmnares. Probablty Spaces : Dscrete and Gaussan............................ Fourer & Hermte Analyss.....................................3 Vector-valued functons...................................... 3 3 Dmenson Reducton for Low-Degree Multlnear Polynomals 4 4 Reducton from General Polynomals to Low-Degree Polynomals 6 5 Reducton from General Polynomals to Multlnear Polynomals 6 6 Non-Interactve Smulaton from Correlated Gaussan Sources 7 7 Non-Interactve Smulaton from Arbtrary Dscrete Sources 0 8 Acknowledgments 6 A Proofs of Mean and Varance Bounds n Dmenson Reducton 9 A. Product of Inner Products of Normalzed Correlated Gaussan Vectors........... 30 A. Mean & Varance Bounds for Multlnear Monomals..................... 36 A.3 Mean & Varance Bounds for Multlnear Polynomals..................... 39 B Proof of Man Smoothng Lemma 4 C Proof of Mult-lnearzaton Lemma 45 D Regularty Lemma for low-degree functons 48 E Invarance Prncple 50 F Decdablty of Non-Interactve Smulaton 5
Introducton. Gaussan Isopermetry & Nose Stablty Isopermetrc problems over the Gaussan space have become central n varous areas of theoretcal computer scence such as hardness of approxmaton and learnng. In ts smplest and classc form, the central queston n sopermetry s to determne what s the smallest possble surface area for a body of a gven volume. Alternately, sopermetrc problems can be formulated n terms of the noton of Nose stablty. Fx a real number 0,. Suppose f : R n 0, denotes the ndcator functon of a subset say A f ) of the n-dmensonal Gaussan space R n wth the Gaussan measure), then ts nose stablty Stab f) s the probablty that two -correlated Gaussans X, Y both fall n A f. Specfcally, f G n denotes the dstrbuton of -correlated Gaussans n n dmensons, that s, X γ n and Y X) X+ Z) for Z γ n. Then, we can equvalently defne nose stablty as,stab f) = Pr X,Y) G n fx) = fy). More formally, the Ornsten-Uhlenbeck operator U, defned for each 0,, acts on any f : R n R as U f)x) = Z R n f ) X+ Z dγ n Z), The nose stablty s then defned asstab f) def = E X γn fx) U fx). In terms of nose stablty, the smplest sopermetrc problem s to determne, what s the largest possble value of Stab f) for a functon f : R n 0, wth a gven expectaton E f = µ. The semnal sopermetrc theorem of Borell Bor85 shows that ndcator functon of halfspaces are the most nosestable among all functons f : R n 0, wth a gven expectaton. Borell s theorem along wth the nvarance prncple of MOO05, Mos0) has had fundamental applcatons n theoretcal computer scence, e.g., n the hardness of approxmaton for Max-Cut under the Unque Games conecture KKMO07, and n votng theory Mos0. In ths work, we wll be nterested n hgher analogues of Borell s theorem for parttons of the Gaussan space n to more than two subsets, or equvalently nose stablty of functons f takng values over k = {0,..., k }. Towards statng these hgher analogues of Borell s theorem, let s state Borell s theorem n a more general notaton. Let k be the probablty smplex n R k.e. convex hull of the bass vectors {e,...,e k }). The Ornsten-Uhlenbeck operator naturally extends to vector valued functons f : R n R k as U f = U f,..., U f k ) where f = f,..., f k )). The nose stablty of functons f : R n k, s now defned as Stab f) := E X γn fx), U fx) where, denotes the nner product over R k. We can smlarly defne the nose stablty of a functon f : R n k by embeddng k n k,.e., dentfyng coordnate k wth the standard bass vector e k. We can now state Borell s theorem n ths notaton as follows: Borell s Theorem Bor85. For any f : R n, consder the halfspace functon h = h, h ) : R n gven by h X) = { a,x b} and h X) = h X), for sutable a R n, b R such that E f = Eh. Then, Stab f) Stab h). Queston. Maxmum Nose Stablty MNS) Gven a postve nteger k and a tupleα k, what s the maxmum nose stablty of a functon f : R n k satsfyng the constrant that E f = α? The above queston remans open even for k = 3. In the partcular case where α = k,..., k ), the Standard Smplex Conecture posts that the maxmum nose stablty s acheved by a standard smplex partton KKMO07, IM. Even n the specal case when k = 3 and α = 3, 3, 3 ), the answer s stll tantalzngly open. In fact, a suprsng result of HMN6 shows that when the α s are not all equal, the standard smplex partton an approprately shfted verson thereof) does not acheve the maxmum also referred to as the Peace-Sgn Conecture when k = 3.
nose stablty. Ths ndcates that the case k 3 s fundamentally dfferent than the case where k =. The fact that we don t understand optmal parttons for k 3, led De, Mossel & Neeman DMN7a to ask whether the optmal partton s realzed n any fnte dmenson. More formally: Queston. Gven k, 0, ), and α k, let S n α) be the optmal nose stablty of a functon f : R n k, subect to E f = α. Is there an n 0 such that S n α) = S n0 α) for all n n 0? Even the above queston remans open as of now! In ths lght, De, Mossel & Neeman DMN7a ask whether one can obtan an explctly computable n 0 = n 0 k,, ε) such that S n0 α) S n α) ε for all n N, n other words, there exsts a functon f : R n 0 k that comes ε-close to the maxmum achevable nose stablty. Note that the challenge s really about n 0 beng explct, snce some n 0, k, ε) always exsts, as S n α) s a convergng sequence as n. Indeed, De, Mossel and Neeman obtan such an explctly computable functon. To do so, they use and buld on the theory of egenregular polynomals that were prevously studed by DS4, whch n turn uses other tools such as Mallavn calculus. In ths work, we ntroduce fundamentally dfferent technques elaborated on shortly), thereby recoverng the result of DMN7a. In partcular, we show the followng we use R : R k k to denote the roundng operator, as n Defnton.3). Theorem. Dmenson Bound on Approxmately Optmal Nose Stable Functon). Gven parameters k, 0, and ε > 0, there exsts an explctly computable n 0 = n 0, k, ε) such that the followng holds: For any n N, let f : R n k. Then, there exsts a functon f : R n 0 k such that. E f E f ε.. Stab f) Stab f) ε. Moreover, there exsts an explctly computable d 0 = d 0, k, ε) for whch there s a degree-d 0 polynomal g : R n 0 R k, such that, fa) = R g a )). a )) ) The explct n 0 and d 0 are upper bounded as n 0 exp poly k,, ε and d 0 poly k,, ε. Remarks. ) Whle we do obtan an actual explct bound on n 0 and d 0, we skp t n the theorem statement n order to stress on the qualtatve nature of the bound. In contrast, t s mentoned n DMN7a that ther bound on n 0 s not prmtve recursve and has an Ackermann-type growth whch s ntroduced by ther applcaton of the regularty lemma from DS4). ) A subtle pont n our theorem s that the range of f s k and not k. Interestngly however, t follows from a thresholdng lemma n DMN7a, Lemma 5 & 6 that any such f can be modfed to have rangek, whle preservng E f wthout decreasng the nose stablty. The above theorem has an mmedate applcaton of showng that approxmately most-stable votng schemes among all low-nfluental votng schemes) can be computed effcently. We refer the reader to DMN7a for the detals of ths applcaton. In order to prove Theorem., we n fact turn to the more general and seemngly harder problem of non-nteractve smulaton of ont dstrbutons.
. Non-Interactve Smulaton of Jont Dstrbutons Suppose that two players, Alce and Bob, observe the sequence of random varables x,..., x n ) and y,..., y n ) respectvely, where each par x, y ) s ndependently drawn from a source ont dstrbuton µx, y). The fundamental queston here s to understand whch other target ont dstrbutons ν can Alce and Bob smulate, wthout communcatng wth each other? How many samples from µ are needed for the same, or n other words, what s the smulaton rate? Ths setup, referred to as the Non-Interactve Smulaton NIS) of Jont Dstrbutons, has been extensvely studed n Informaton Theory, and more recently n Theoretcal Computer Scence. The hstory of ths problem goes back to the classcal works of Gács and Körner GK73 and Wyner Wyn75. Specfcally, consder the dstrbuton Eq over {0, } {0, } where both margnals are Ber/) and the bts dentcal wth probablty. Gács and Körner studed the specal case of ths problem correspondng to the target dstrbuton ν = Eq. They characterzed the smulaton rate n ths case, showng that t s equal to what s now known as the Gács-Körner common nformaton of µ. On the other hand, Wyner studed the specal case correspondng to the source dstrbuton µ = Eq. He characterzed the smulaton rate n ths case, showng that t s equal to what s now known as Wyner common nformaton of ν. Another partcularly mportant work was by Wtsenhausen Wt75 who studed the case where the target dstrbuton ν = G s the dstrbuton of -correlated Gaussans. In ths case, he showed that the largest correlaton.e., largest value of ) that can be smulated s exactly the well-known maxmal correlaton coeffcent µ) see Defnton.) whch was frst ntroduced by Hrschfeld Hr35 and Gebelen Geb4 and then studed by Rény Rén59. Ths mmedately gves a polynomal tme algorthm to decde f G can be smulated from samples from a gven µ, snce the maxmal correlaton coeffcent µ) s effcently computable. In the same work Wt75, Wtsenhausen also consdered the case where the target dstrbuton ν = DSBS, whch s a par of -correlated bts.e. a par of ± random varables wth correlaton ), and gave an approach to smulate correlated bts by frst smulatng G startng wth samples from µ, and then applyng half-space functons to get outputs n{±}. Startng arccos µ) wth µ, such a approach smulates DSBS where = π. Indeed, ths s morally same as the roundng technque employed n Goemans-Wllamson s approxmaton algorthm for MaxCut GW95 0 years later! We wll consder the modern formulaton of the NIS queston as defned n KA6. Ths formulaton gnores the smulaton rate, and only focuses on whether smulaton s even possble or not, gven nfntely many samples from µ that s, whether the smulaton rate s non-zero or not. Defnton. Non-nteractve Smulaton of Jont Dstrbutons KA6). LetZ Z, µ) andk k, ν) be two ont probablty spaces. We say that the dstrbuton ν can be non-nteractvely { smulated } from dstrbuton µ, f there exsts a sequence of functons {A n) : Z n k }n N and B n) : Z n k such that the ont dstrbuton ν n = A n) x), B n) y)) x,y) µ n over k k s such that lm n d TV ν n, ν) = 0. The noton of non-nteractve smulaton s summarzed n Fgure. Note that even though the defnton tself doesn t gve Alce and Bob access to prvate randomness, they can nevertheless take extra samples and use them as prvate randomness. We wll model the use of prvate randomness, by allowng A n) and B n) to map to the smplex k, nstead of k. We wll then nterpret A n) x) resp. x)) as the probablty of Alce outputtng resp. Bob outputtng ). For convenence, we wll stll B n) usea n) x), B n) y)) x,y) µ n to denote the ont dstrbuton generated overk k. A central queston that was left open followng the work of Wtsenhausen s: gven dstrbutons µ and ν, can ν be non-nteractvely smulated from µ? Can ths be decded algorthmcally? Even when µ and ν are extremely smple, e.g. µ s unform on the trples {0, 0),0, ),, 0)} and ν s the doubly symmetrc bnary souce DSBS 0.49, t s open f µ can smulate ν. Ths problem was formalzed as a natural we wll often refer to such functons as strateges of players Alce and Bob. n N 3
prvate randomness Z n x Alce u k µ n ν? Z n y Bob v k prvate randomness Fgure : Non-Interactve Smulaton, e.g., as studed n KA6 gap-verson of the non-nteractve smulaton problem n a work by a subset of the authors along wth Madhu Sudan GKS6b. Here we state a slghtly more generalzed verson. Problem.3 GAP-NISZ Z, µ), V, k, ε), cf. GKS6b). Gven a ont probablty space Z Z, µ) and another famly of ont probablty spaces V supported over k k, and an error parameter ε > 0, dstngush between the followng cases: ) there exsts N, and functons A : Z N k and B : Z N k, for whch the dstrbuton ν of Ax), By)) x,y) µ N s such that d TV ν, ν) ε for some ν V. ) for all N and all functons A : Z N k and B : Z N k, the dstrbuton ν of Ax), By)) x,y) µ N s such that d TV ν, ν) > ε for all ν V. 3.3 NIS from Gaussan Sources & the MNS queston We now remark on why the NIS queston s a more general queston than the Maxmum Nose Stablty queston. For any dstrbuton ν, defne the agreement probablty of ν supported over k k as agrν) = Pr u,v) ν u = v. Recall that for f : R n k, the stablty can equvalently be defned as Stab f) = E X,Y) G n fx), fy) = k = E X,Y) G n f X), f Y). Bascally, the MNS queston can be nterpretted as askng: what s the maxmum agreement probablty of any dstrbuton ν that can be non-nteractvely smulated from µ = G, wth both margnal dstrbutons gven by α, and wth an addtonal constrant that both Alce and Bob use the same strategy,.e. A = B = f. Thus, to understand the MNS queston, we turn to understandng whch target dstrbutons ν can be non-nteractvely smulated wth the source dstrbuton µ = G ; we wll gnore, for the moment, the restrcton that Alce and Bob need to use the same strategy. Recall that mplct n Wt75, was an approach to non-nteractvely smulate target dstrbutons ν over {0, } {0, } from µ = G usng half-space functons usng only one sample of µ). Combnng Wtsenhausen s approach and Borell s theorem Bor85 gves us an exact characterzaton of all dstrbutons ν over {0, } {0, } that can be smulated from µ = G. Moreover, any dstrbuton ν that can be smulated from G can n fact be smulated usng only one sample from G potentally n addton to prvate randomness). For k >, we do not have such an exact characterzaton of the dstrbutons ν that can be smulated from G. The challenges underlyng here are the same as those underlyng n the Standard Smplex Conecture. Nevertheless, we prove a bound on the number of samples needed to come ε-close to smulatng ν, f t were possble at all, n the form of the followng theorem, 3 the choce of constant s arbtrary. Indeed we could replace t by any constant greater than. 4
Theorem.4 NIS from correlated Gaussan source). Gven parameters k, 0, ) and ε > 0, there exsts an explctly computable n 0 = n 0, k, ε) such that the followng holds: For any N, and any A : R N k and B : R N k, there exst functons à : R n 0 k and B : R n 0 k such that, ) d TV AX), BY)) X,Y) G N, Ãa), Bb)) n a,b) G 0 ε. Moreover, there exsts an explctly computable d 0 = d 0, k, ε) for )) whch there are degree-d 0 polynomals A 0 : R n 0 R k and B 0 : R n 0 R k, such that, Ãa) = R A a 0 and a Bb) = R B b 0 )). b )) ) The explct n 0 and d 0 are upper bounded as n 0 exp poly k,, ε and d 0 poly k,, ε. In fact, the transformaton satsfes a stronger property that there exsts an oblvous randomzed transformaton wth a shared random seed) to go from A to à and from B to B, whch works wth probablty at least ε. Snce the same transformaton s appled on A and B smultaneously wth the same random seed, f A = B, then the transformaton gves à = B as well. It s now easy to see that Theorem. follows smply as a corollary of the above theorem, when appled on functons A = B = f. By an oblvous randomzed transformaton, we mean that to obtan à from A, we only need to know A and a shared random seed M. That s, the transformaton doesn t use the knowledge of B. Smlarly, to obtan B from B, we only need to know B and the same shared random seed M. Ths hnted at n GKS6b as a potental barrer for showng decdablty of GAP-NIS when k. Indeed our transformaton overcomes ths barrer and we elaborate more on ths n Secton.8..4 NIS from Arbtrary Dscrete Sources In pror work GKS6b, t was shown that GAP-NIS for dscrete dstrbutons µ and ν s decdable, n the specal case where k =. Ths was done by ntroducng a framework, whch reduced the problem to only understandng GAP-NIS for the specal case where µ = G. Indeed, the reason why the case of k = was easer was precsely because combnng Wtsenhausen Wt75 and Borell s theorem Bor85, gves an exact characterzaton of the dstrbutons over that can be smulated from G. The lack of understandng of the dstrbutons over k k that can be smulated from G was suggested n GKS6b as a barrer for extendng ther result to k >. Followng up on DMN7a, De, Mossel & Neeman were able to extend ther technques to show the decdablty of GAP-NIS for all k DMN7b. To do so, they follow the same hgh level framework of usng a Regularty Lemma and Invarance Prncple ntroduced n GKS6b. In addton, they buld on the tools developed n DMN7a along wth a new smoothng argument nspred by boostng procedures n learnng theory and potental functon arguments n complexty theory and addtve combnatorcs. In ths work, we are able to recover ths result usng a fundamentally dfferent and more elementary approach, by only usng Theorem.4 along wth the framework ntroduced n GKS6b, thereby showng decdablty of GAP-NIS for all k. The central underlyng theorem to prove decdablty of GAP-NIS s the followng. Theorem.5 NIS from Dscrete Sources). LetZ Z, µ) be a ont probablty space. Gven parameters k and ε > 0, there exsts an explctly computable n 0 = n 0 µ, k, ε) such that the followng holds: Let A : Z N k and B : Z N k. Then there exst functons à : Z n 0 k and B : Z n 0 k such that, ) d TV Ax), By)) x,y) µ N, Ãa), Bb)) a,b µ n 0 ε. In partcular, n 0 s an explct functon upper bounded by exp poly k, ε, 0, log α) )), where α = αµ) s the smallest atom n µ and 0 = µ) s the maxmal correlaton of µ. 5
The decdablty of GAP-NIS follows qute easly from the above theorem. The man dea s, once we know a bound on the number of samples of µ that are needed to get ε-close to ν f t were possble at all), we can brute force over all possble strateges of Alce and Bob. For completeness, we provde a proof of the followng theorem n Appendx F. Theorem.6 Decdablty of GAP-NIS). Gven a ont probablty space Z Z, µ) and a famly of ont probablty spaces V supported overk k, and an error parameter ε > 0, there exsts an algorthm that runs n tme Tµ, k, ε) whch s an explctly computable functon), and decdes GAP-NISZ Z, µ), V, k, ε). The run tme Tµ, k, ε) s upper bounded by exp exp exp poly k, ε, 0, log α) )), where 0 = µ) s the maxmal correlaton of Z Z, µ) and α def = αµ) s the mnmum non-zero probablty n µ..5 Dmenson Reducton for Low-Degree Polynomals over Gaussan Space We now descrbe the man technque of dmenson reducton for low-degree polynomals that we ntroduce n ths work, whch could be of ndependent nterest. Let s start wth Theorem.4, and see how we mght even begn provng t. We are gven two vectorvalued functons 4 A : R n k and B : R n k. We wsh to reduce the dmenson n of the Gaussan over k k. space on whch A and B act, whle preservng the ont dstrbutonax), BY)) X,Y) G n Observe that E X,Y) G na X) B Y) s the probablty of the event Alce outputs and Bob outputs. We succnctly wrte ths expectaton as A, B G n. In order to approxmately preserve the ont dstrbuton for each, ) k k. AX), BY)) X,Y) G n, t suffces to approxmately preserve A, B G n Thus, to prove Theorem.4, we wsh to fnd an explct constant n 0 = n 0, k, ε), along wth functons à : R n 0 k and B : R n 0 k such that Ã, B G n 0 ε A, B. Achevng ths drectly s G n hghly unclear, snce a pror, we have no structural nformaton about A and B! To get around ths, we show that t s possble to frst do a structural transformaton on A and B to make them low-degree multlnear polynomals see Secton. for formal defntons) such transformatons are descrbed n Sectons 4 and 5. Ths however creates a new problem that the transformed A and B no longer map to k. Nevertheless, we show that after the sad transformatons we stll have that the outputs of A and B are close to k n expectedl dstance for now, let s nformally denote ths by dsta, k)). We show that ths ensures that roundng the outputs of A and B to k wll approxmately preserve the correlatons A, B G n. We are now able to revse our obectve as follows: Gven two vector-valued) degree-d polynomals A : R n R k and B : R n R k, does there exst an explctly computable functon D of k, d, and δ, along wth polynomals à : R D R k and B : R D R k that δ-approxmately preserves ) the correlaton A, B for all, ) k k and ) closeness of the outputs of A and B to G n k n expected l dstance, that s, dsta, k ) and dstb, k ). We ntroduce a very smple and natural dmenson-reducton procedure for low-degree multlnear polynomals over Gaussan space. Specfcally, for an..d. sequence of -correlated Gaussans a, b ), a, b ),,a D, b D ), we set ) Ma Ãa) := A a and ) Mb Bb) := B b where M s a randomly sampled N D matrx wth..d. standard Gaussan entres. Our man dmensonreducton theorem for low-degree polynomals s stated as follows, ) 4 recall that we thnk of a vector valued functon A : R n R k as a tuplea,..., A k ), where each A : R n R 6
Theorem.7 Dmenson Reducton Over Gaussan Space). Gven parameters k, d Z 0, 0, ) and δ > 0, there exsts an explctly computable D = Dd, k, δ), such that the followng holds: Let A : R N R k and B : R N R k be degree-d multlnear polynomals. Addtonally, suppose that dsta, k ), dstb, k ) δ. Consder the functons à : R D R k and B : R D R k as defned n Equaton ). Wth probablty at least 3δ over the random choce of M N0, ) N D, the followng wll hold: A, B Ã, B For every, k : G N dstã, k ) δ and dst B, k ) δ. G D δ. In partcular, D s an explct functon upper bounded by exp poly d, log k, log δ ))). It s clear from the constructon of à and B that ths theorem s gvng us an oblvous randomzed transformaton, as also remarked n Theorem.4. The proof of Theorem.7 s obtaned by combnng Theorem 3. and Proposton 3. n Secton 3. Analogy wth the Johnson-Lndenstrauss lemma. We wll now hghlght a few parallels between Theorem.7 and the proof of the Johnson-Lndenstrauss lemma. Suppose we have two unt vectors u, v R n. We wsh to obtan a randomzed transformaton Ψ s : R n R D where s s the random seed), such that, u, v δ Ψ s u), Ψ s v) holds wth probablty δ, over the randomness of seed s; note that here, denotes the nner product over R n and R D respectvely. Indeed, there s such a transformaton, namely, Ψ M u) = M u where M D N0, ) D n. Let FM) = Ψ M u), Ψ M v). Such a transformaton satsfes that, E M FM) = u, v and Var M FM)) = u, v + u v D D, where we use that u and v are unt vectors. Thus, f we choose D = /δ 3, then we can make the varance smaller than δ 3. Thereby, usng Chebyshev s nequalty, we get that wth probablty δ, t holds that Ψ M u), Ψ M v) u, v δ. Thus, we have a oblvous randomzed dmenson reducton that reduced the dmenson of any par of unt vectors to O/δ 3 ), ndependent of n. Note that, nstead of usng Chebyshev s nequalty, we could use a much sharper concentraton bound to show that D = O/ε log/δ)) suffces to preserve the nner product upto an addtve ε, wth probablty δ. However, we descrbed the Chebyshev s nequalty verson as ths s what our proof of Theorem.7 does at a hgh level. The problem we are facng, although morally smlar, s techncally entrely dfferent. We want the reduce the dmenson of the doman of a par of polynomals A : R n R and B : R n R. For the moment, consder the transformaton such that Ψ M A) : R D R s gven by AMa/ D). Smlarly, Ψ M B) = BMb/ D). Our proof of Theorem.7 proceeds along smlar lnes as the above proof of Johnson-Lndenstrauss Lemma, that s, by consderng FM) = E a,b) µ DΨ M A)a) Ψ M B)b), and provng bounds on E M FM) and VarFM)). Ths turns out to be qute delcate! We don t even have E M FM) = E x,y) µ nax) By). What we do show s that, E M FM) E x,y) µ nax) By) o D ) and Var M FM)) o D), that s, both are decreasng functons n D wth some dependence on d, whch s the degree of A and B). Interestngly however, n the case of d =, t turns out that FM) s n fact an unbased estmator. Indeed, ths s not a concdence! We leave t to the nterested reader to fgure out that n the case of d =, our tranformaton s n fact dentcal to the above descrbed Johnson-Lndenstrauss transformaton on the n-dmensonal space of Hermte coeffcents of A and B. 7
Our actual transformaton s slghtly dfferent, namely Ψ M A) = AMa/ a ). Ths s to ensure the second pont n Theorem.7, about preservng the closeness of the output of A to k. The proof gets a lttle more techncal, but ths s ntutvely smlar to the above transformaton snce a s tghtly concentrated around D..6 Related Work and Other Motvatons Informaton Theory. We pont out that several prevous works n nformaton theory and theoretcal computer scence study non-nteractve smulaton type of questons. For nstance, the non-nteractve smulaton of ont dstrbutons queston studed n ths work s a generalzaton of the Non-Interactve Correlaton Dstllaton problem 5 whch was studed by MO04, MOR + 06. Moreover, recent works n the nformaton theory communty KA6, BG5 derve analytcal tools based on hypercontractvty and the so-called strong data processng constant) to prove mpossblty results for NIS. Whle these results provde stronger bounds for some sources, they do not gve the optmal bounds n general. Fnally, the non-nteractve agreement dstllaton problem studed by BM can also be vewed as a partcular case of the NIS setup. Randomness n Computaton. As dscussed n GKS6b, one motvaton for studyng NIS problems stems from the study of the role of randomness n dstrbuted computng. Specfcally, recent works n cryptography AC93, AC98, BS94, CN00, Mau93, RW05, quantum computng Ne99, CDS08, DB4 and communcaton complexty BGI4, CGMS4, GKS6a study how the ablty to solve varous computatonal tasks gets affected by weakenng the source of randomness. In ths context, t s very natural to ask how well can a source of randomness be transformed nto another more structured) one, whch s precsely the setup of non-nteractve smulaton. Tensor Power problems. Another motvaton comes from the fact that NIS belongs to the class of tensor power problems, whch have been very challengng to analyze. In such questons, the goal s to understand how some combnatoral quantty behaves n terms of the dmensonalty of the problem as the dmenson tends to nfnty. A famous nstance of such problems s the Shannon capacty of a graph Sha56, Lov79 where the am s to understand how the ndependence number of the power of a graph behaves n terms of the exponent. The queston of showng the computablty of the Shannon capacty remans open to ths day AL06. Other examples of such open problems whch are more closely related to NIS) arse n the problems of local state transformaton of quantum entanglement Be, DB3, the problem of computng the entangled value of a -prover -round game see for, e.g., KKM + and also the open problems ope) and the problem of computng the amortzed value of parallel repettons of a -prover -round game Raz98, Hol09, Rao, Raz, BHH + 08. Yet another example of a tensor-power problem s the task of computng the amortzed communcaton complexty of a communcaton problem. Braverman-Rao BR showed that ths equals the nformaton complexty of the communcaton problem, however the computablty of nformaton complexty was shown only recently BS5. We hope that the recent progress on the Non-Interactve Smulaton problem would stmulate progress on these other notable tensor-power problems. A concrete queston s whether the technques used for NIS regularty lemma, nvarance prncple, etc.) can be translated to any of the above mentoned setups..7 Comparsons wth recent works of De, Mossel & Neeman Our man theorems Theorem. and Theorem.5 were proved by De, Mossel & Neeman DMN7a, DMN7b only qualtatvely, although wth worse explct bounds on n 0 ). Our work was nspred by DMN7a, DMN7b through several hgh-level deas, such as the use of smoothng and multlnearzaton transformatons although these tranformatons are techncally dfferent n our case, so we state and prove our lemmas from scratch). However, the authors hold the opnon that the key nsght nto why 5 whch consdered the problem of maxmzng agreement on a sngle bt, n varous mult-party settngs. 8
dmenson reducton s possble provded by the works of De Mossel & Neeman and the current work are fundamentally dfferent. The key nsght for dmenson reducton n the work of De, Mossel & Neeman s quotng DMN7a): the fact that a collecton of homogeneous polynomals can be replaced by polynomals n bounded dmensons s a tensor analogue of the fact that for any k vectors n R n, there exst k vectors n R k wth the same matrx of nner products. In our work, the man ntuton for the dmenson reducton s an oblvous dmenson reducton technque, much smlar to the Johnson-Lndenstrauss Lemma, as descrbed n Secton.5. Whle nspred by the works of De, Mossel & Neeman, we beleve that our technque offers a fresh perspectve on why t s possble to obtan explct bounds for the above problems. Moreover, our bound on n 0 ε) n both cases s merely exponental n the parameters of the problem, whereas, the bounds n the works of De et al. are not prmtve recursve and have an Ackermann-type growth..8 Outlne of Proofs Dmenson Reducton for Polynomals. We beng wth descrbng the man deas behnd Theorem.7. For polynomals A : R N R and B : R N R, we apply a second-moment argument to the random varable FM) := A M, B M G D, where A M and B M are the substtutons n Equaton ). Specfcally, we compute bounds on the mean and varance of FM) Lemma 3.3); the key pont beng that these bounds go to 0 as D gets larger. Thus, we can get an explct bound on how large D needs to be n order to make the mean devaton and the varance small. Assumng Lemma 3.3, we smply apply Chebyshev s nequalty n order to upper-bound the probablty that ths random varable sgnfcantly devates from ts mean. Lemma 3.3 s the most techncal and novel part of ths work, and s proved n Appendx A. To prove these mean and varance bounds, we frst analyze the case when A and B are mult-lnear monomals Appendx A.). Then, va a smple applcaton of hypercontractvty, we use the monomal calculatons n order to obtan bounds on the mean and varance for general multlnear polynomals Appendx A.3). NIS from Gaussan Sources. We now turn to the proof of Theorem.4 whch mmedately mples Theorem.). We are gven A : R N k and B : R N k, and we want to construct functons à : R n 0 k and B : R n 0 k such that the ont dstrbuton of Ã, B) s close n total varaton dstance) to that of A, B). For any, k, we consder the quantty E XY A X) B Y) whch s the probablty of the event that Alce outputs and Bob outputs. Across multple steps, we modfy Alce s and Bob s strateges whle approxmately preservng ths quantty for every,. Note that f we preserve ths quantty for every, up to an addtve ε/k, then ths ensures that the ont dstrbuton of Alce and Bob s outputs s preserved up to a total varaton dstance of ε. The frst step s a smoothng operaton Lemma 4.) that transforms A and B nto polynomals A ), B ) : R N R k that are guaranteed to have constant) degree d. In the second step, we use a multlnearzaton operaton Lemma 5.) to convert A ), B ) nto multlnear degree-d polynomals A ), B ) : R Nt R k ths operaton ncreases the number of varables by a multplcatve t factor). Both these operatons preserve the correlaton A, B, and keeps the expected l dstance of A and B from k small. We then apply our man dmenson-reducton procedure Theorem.7) to obtan constant-dmensonal functons A 3), B 3) : R n 0 R k that preserve the structure and correlatons of A ) and B ). At the fnal step, we set à and B to be the roundngs of A 3) and B 3) repsectvely) to the closest functons mappng to k. Our analyss ensures that n each of the above steps, the two correlatons of the two functons as well as ther ndvdual dstances to the probablty smplex are approxmately preserved. NIS from Arbtrary Dscrete Sources. Our proof of Theorem.5 proceeds by a reducton to Theorem.4. The reducton uses the framework already developed n GKS6b) of usng the nvarance prncple 9
Proofs Appendx B Proofs Appendx C Proofs Appendx A Prelmnares: Roundng Lemmas Secton Transformaton to low-degree Secton 4 Transformaton to mult-lnear Secton 5 Dmenson Reducton for low-degree multlnear polynomals Theorem.7) Secton 3 NIS from Dscrete Sources Theorem.5) Secton 7 NIS from Gaussan Sources Theorem.4, and as corollary, Theorem.) Secton 6 Regularty Lemma Appendx D Invarance Prncple Appendx E Decdablty of GAP-NIS Theorem.6) Appendx F Fgure : Organzaton of the paper, where arrows ndcate the dependences of the Sectons/Appendces on each other dashed lnes ndcate the dependences that could be skpped on frst readng; dashed box ndcates an optonal appendx) Appendx E) as obtaned n Mos0, IM and a Regularty Lemma Appendx D) nspred by DSTW0. We also need to use addtonal smoothng and multlnearzaton steps the full detals are n Secton 7). One key pont about Theorem.4 that s crucal for ths applcaton s the oblvous nature of the dmenson reducton. In the framework of GKS6b, we need to apply Theorem.4 on a famly of strateges { A ),..., A T)} and { B ),..., B T)}, where each A ), B ) : R N R k. That s, we want to be able to reduce the dmensonalty of all the A ) s and B ) s whle smultaneously preservng the ont dstrbuton A ), B ) ) for at least a ε) fracton of the pars, ) T T. The oblvous randomzed transformaton n Theorem.4 gves us that the tranformaton done on A ) depends only on the random seed and not on whch B ) we are comparng t aganst. Moreover, ths transformaton works wth hgh probablty, so n expectaton we get that the ont dstrbuton s approxmately preserved for atleast a ε)-fracton of the pars, ) T T..9 Organzaton of the Paper In Secton, we summarze some useful defntons, and prove a couple of smple lemmas that wll be useful n the paper. In Secton 3, we state our man technque of dmenson reducton for polynomals,.e. Theorem.7, wth the key lemmas and proofs n Appendx A. In Sectons 4 and 5 we descrbe the transformatons to make functons low-degree and multlnear, wth proofs deferred to Appendces B and C. In Secton 6, we prove Theorem.4, dervng Theorem. as a corollary. Fnally, n Secton 7, we prove Theorem.5, for whch we need more tools such as the Regularty Lemma and the Invarance Prncple, whch we provde n Appendces D and E. Fnally, for sake of completeness, the proof of Theorem.6 s provded n Appendx F. To ease the task of navgatng the paper, we provde an outlne of the paper n Fgure. 0
Prelmnares. Probablty Spaces : Dscrete and Gaussan We wll mostly use scrpt letter Z to denote a fnte set of sze q, and µ wll usually denote a probablty dstrbuton. We use small letters x, y, etc. to denote elements of Z, and bold small letters x, y, etc. to denote elements n Z n. We use x, y to denote ndvdual coordnates of x, y respectvely. For a probablty space Z, µ), we wll use the followng defntons and notatons, The par Z n, µ n ) denotes the product space Z Z Z endowed wth the product dstrbuton. The support of µ s Suppµ) := {x : µx) > 0}. We assume w.l.o.g. that Suppµ) = Z. αµ) denotes the mnmum non-zero probablty atom n µ. L Z, µ) denotes the space of all functons from Z to R. The nner product on L Z, µ) s denoted by f, g µ := E x µ fx)gx). Thel p -norm by /p fp := E x µ fx) p. Also, f := max µx)>0 fx). For two dstrbutons µ and ν, d TV µ, ν) s the total varaton dstance between µ and ν. Z Z, µ) denotes a ont probablty space. We use µ A and µ B to denote the margnal dstrbutons of µ. The correlaton between functons actng on parts of a ont dstrbuton s defned as follows. Defnton. Correlaton between strateges). Let Z Z, µ) be any ont probablty space. For functons A L Z, µ A ) and B L Z, µ B ), the correlaton between A and B over dstrbuton µ s defned as, A, B µ = E Ax) By). x,y) µ More generally, f we have functons A L Z n, µ n A ) and B L Z n, µ n B ), the correlaton between A and B over dstrbuton µ n s defned as, A, B µ n = E By). x,y) µ nax) Remark. Whle A, B µ n s the correlaton over the ont dstrbuton, the term A, A µ n s the correlaton as defned earler over the margnal space. To make ths dstncton clear, from now on, µ always A refers to the ont dstrbuton onz Z, and we wll use µ A or µ B to ndcate dstrbutons overz. An mportant quantty assocated to any ont dstrbuton s that of the maxmal correlaton coeffcent, whch was frst ntroduced by Hrschfeld Hr35 and Gebelen Geb4 and then studed by Rény Rén59. Defnton. Maxmal correlaton). Gven a ont probablty space Z Z, µ), we defne ts maxmal correlaton Z Z; µ) or smply µ)) as follows, { } f : Z R, E f = Eg = 0 Z Z; µ) = sup f, g µ f,g g : Z R, Var f) = Varg) = Although the above defntons were stated for dstrbutons over fnte sets, they extend naturally to the case wherez = R, equpped wth the Gaussan measuren0, ) also denoted as γ ). To dstngush between dscrete and Gaussan spaces, we wll use captal letters X, Y, etc. to denote elements of R, and
bold letters X, Y, etc. to denote elements n R n. In ths case, we use X, Y to denote ndvdual coordnates of X, Y respectvely. The par R n, γ n ) denotes the product space R n endowed wth the standard n- dmensonal Gaussan measure. Unless explctly mentoned otherwse, all the functons wth doman R n that we consder wll be n L R n, γ n ), whch s the space of l -ntegrable functons wth respect to the γ n measure. Over the space of reals, we wll prmarly consder the ont dstrbuton of -correlated Gaussans R R,G ). Ths s a -dmensonal Gaussan dstrbutons X, Y), where X and Y are margnally dstrbuted accordng to γ, wth EXY =. It s well-known that the maxmal correlaton ofg s.. Fourer & Hermte Analyss Fourer analyss for dscrete product spaces. We recall some background n Fourer analyss that wll be useful to us. Let Z, µ A ) be a fnte probablty space wth Z = q. Let X 0,,X q : Z R be an orthonormal bass for the space L Z, µ A ) wth respect to the nner product.,. µa. Furthermore, we requre that ths bass has the property thatx 0 =,.e., the functon that s dentcally on every element of Z. Forσ = σ,, σ n ) Z n q, defnex σ : Z n R n as follows, X σ x,..., x n ) = X σ x ) n { } It s easly seen that the functons X σ : σ Z n q form an orthonormal bass for the product space L Z n, µ n A ). Thus, every functon A L Z n, µ n A ) has a Fourer expanson gven by Ax) = Âσ)X σ x), σ Z n q where Âσ) s are the Fourer coeffcents of A, whch can be obtaned as Âσ) = A,X σ µa. Although we wll work wth an arbtrary albet fxed) bass, many of the mportant propertes of the Fourer transform are bass-ndependent. For example, Parseval s dentty states that A = σ Z n 0 Âσ). For a ont probablty spacez Z, µ), we letx 0,,X q : Z R be an orthonormal bass for the space L Z, µ A ), and Y 0,,Y q : Z R be an orthonormal bass for the space L Z, µ B ). Although we could choose these bass ndependently, t s helpful to choose the bass such that, X,Y µ = =, where q = µ) here, µ) s the maxmal correlaton of µ as n Defnton.). For σ Z n q, the degree of σ s denoted by σ def = { n : σ = 0}. We say that the degree of a functon 6 A L Z n, µ n A ), denoted by dega), s the largest value of σ such that Âσ) = 0. Hermte Analyss for Gaussan space. Analogous to dscrete spaces, the set of Hermte polynomals {H r : R R : r Z 0 } form an orthonormal bass for functons n L R, γ ) wth respect to the nner product, γ. The Hermte polynomal H r : R R for r Z 0 ) s defned as, H 0 x) = ; H x) = x; H r x) = )r d e x / r / r! dx r e x. Hermte polynomals can also be obtaned va the generatng functon, e xt t = r=0 For any σ = σ,..., σ n ) Z n 0, defne H σ : R n R as H r x) r! t r. H σ X) = n H σ X ). = 6 we wll nterchangeably use the word polynomal to talk about any functon n L A n, µ n ).
It s easly follows that the set { H σ : σ Z n 0} forms an orthonormal bass for L R n, γ n ). Thus, every A L R n, γ n ) has a Hermte expanson gven by AX) = Âσ) H σ X), σ Z n 0 where the Âσ) s are the Hermte coeffcents of A, whch can be obtaned as Âσ) = A, H σ γn. The degree of σ s defned as σ := n σ, and the degree of A s the largest σ for whch Âσ) = 0. Analogous to Boolean functons, we have Parseval s dentty, that s, A = σ Z n Âσ). We say that 0 A L R n, γ n ) s multlnear f Âσ) s non-zero only f σ {0, } for all n..3 Vector-valued functons We wll extensvely work wth vector-valued functons. For any functon A : D R k for any doman D), we wll wrte A = A,, A k ), where A : D R s the -th coordnate of the output of A. That s, A x) = Ax)) for any x D. The defntons of Fourer analyss and Hermte analyss extend naturally to vector-valued functons. For A : R n R k, we use Âσ) to denote the vector  σ),...,  k σ)). In ths settng, A := E X γn AX) = A + + A k = σ Z n 0 Âσ). Also, dega) s defned as max k dega ). Agan, unless explctly mentoned otherwse, all the vector-valued functons wth doman R n that we consder wll be such that the functon n each coordnate s n L R n, γ n ). For k N, and k, let e be the unt vector along coordnate n R k. The smplex k s defned as the convex hull formed by {e } k. Equvalently, k = { v R k : v = } s the set of probablty dstrbutons over k. Whle we consder vector-valued functons mappng to R k, we are prmarly nterested n functons whch map to k. We use the roudng operator, defned as follows, n order to change the range of a functon from R k to k. Defnton.3 Roundng operator). The Roundng operatorr k) : R k k maps anyv R k to ts closest pont n k. In partcular, t s the dentty map on k. We wll drop the superscrpt, as k s fxed throughout ths paper. As for vector-valued functons, we user to denote the -th coordnate ofr. Thus, whle the -th coordnate of A s denoted by A, the -th coordnate of RA) s denoted byr A). Useful lemmas forl -close strateges An mportant relaxaton n our work s to consder strateges that do not map to k, but nstead map to R k. For such strateges to be meanngful, we wll requre that the outputs are usually close to k. In ths case, we wll be roundng them to the smplex k. The followng smple lemmas are gong to be very useful. The frst lemma says that f we modfy the strateges of Alce and Bob such that they reman close n l -dstance, then the correlaton between ther strateges does not change sgnfcantly. Lemma.4 Close strateges n l, have smlar correlatons). Gven any ont probablty space Z Z, µ). Let A, à L Z n, µ n A ) and B, B L Z n, µ n B ) such that A, Ã, B, B. If A à ε and B B ε, then t holds that, Ã, B A, B µ n µ n ε 3
Proof. The proof follows very easly from the Cauchy-Schwarz nequalty. In partcular, Ã, B A, B µ n µ n = à A), B µ n + A, B B) µ n à A), B + A, B B) µ n à A B + B B A ε. µ n... Cauchy-Schwarz nequalty) The second lemma says that f we have two strateges whch are close n l -dstance, and one of them s close to the smplex k, then so s the other. The proof follows by a straghtforward trangle nequalty. Lemma.5. Gven any ont probablty space Z Z, µ). Let A : Z n R k and à : Z n R k such that A, Ã. Then, for the roundng operator R : R k k, t holds that, RÃ) à RA) A + A Ã. Proof. The proof follows very easly from a trangle nequalty. In partcular, RÃ) à RA) à snce RÃx)) closest n k to Ãx)) RA) A + A à Trangle nequalty) 3 Dmenson Reducton for Low-Degree Multlnear Polynomals In ths secton, we present our man technque whch s a dmenson reducton for low-degree multlnear polynomals over Gaussan space, and prove Theorem.7, whch s obtaned mmedately as a combnaton of Theorem 3. and Proposton 3. stated below. Theorem 3.. Gven parameters d Z >0, 0, and δ > 0, there exsts an explctly computable D = Dd, δ), such that the followng holds: Let A : R N R and B : R N R be degree-d multlnear polynomals, such that A, B. For column vectors a,b R D and M R N D, defne the functons A M : R D R and B M : R D R as ) Ma A M a) = A a and ) Mb B M b) = B b Sample M N0, ) N D). Then, wth probablty at least δ over the choce of M, t holds that, A M, B M G D A, B G N < δ. In partcular, one may take D = dod) δ 4. In other words, for a typcal choce of M N0, ) N D), the correlaton between A and B s approxmately preserved f we replace X, Y) G N by Ma/ a, Mb/ b ), where a,b) G D. Intutvely, M can be thought of as a means to stretch D coordnates of G nto effectvely N coordnates of G, whle foolng correlatons between degree-d multlnear polynomals. Before we prove the above theorem, we prove a smple proposton whch shows that f ths dmenson reducton were appled to vector-valued functons whose outputs le close to the smplex k, then wth hgh probablty, even the dmenson-reduced functons wll also have outputs close to the smplex. More formally, 4
Proposton 3.. Let A : R N R k and B : R N R k, such that RA) A, RB) B δ. Let A M : R D R k and B M : R D R k be defned analogously to Theorem 3.. For M N0, ) N D), wth probablty at least δ, t holds that, RA M ) A M δ and RB M ) B M δ. Proof. We frst observe that for any fxeda R D, the dstrbuton of Ma a s dentcal to that of a standard N-varate Gaussan dstrbuton. Thus, we mmedately have that, Alternately, E M E a R A Ma a )) A Ma a ) = E X RAX)) AX) E M RA M ) A M = RA) A δ Thus, usng Markov s nequalty, we get that wth probablty at least δ, RA M ) A M δ. We smlarly argue for B M, and a unon bound completes the proof. To prove Theorem 3., we prmarly use the second moment method.e., Chebyshev s nequalty). In partcular, let FM) be defned as, FM) def = A M, B M G D The most techncal part of ths work s to show suffcently good bounds on the mean and varance of FM) for a random choce of M N0, ) N D), gven by the followng lemma. Lemma 3.3. Bound on Mean & Varance). Gven parameters d and δ, there exsts D := Dd, δ) such that the followng holds: For M N0, ) N D), E FM) A, B M G N δ Mean bound) In partcular, one may take D = dod) δ. Var M FM)) δ Varance bound) The proof of Lemma 3.3 appears n Appendx A. Assumng Lemma 3.3, we can easly prove Theorem 3.. Proof of Theorem 3.. We nvoke Lemma 3.3 wth parameters d and δ /, and we get a choce of D = dod) δ 4. Usng Chebyshev s nequalty and usng the Varance bound n Lemma 3.3, we have that for any η > 0, Pr FM) E M FM) > η δ M η. Usng the trangle nequalty, and the Mean bound n Lemma 3.3, we get Pr FM) A, B G N > δ M FM) EM Pr FM) + E M FM) A, B G N > δ M Pr FM) EM FM) > δ δ M δ. 5
4 Reducton from General Polynomals to Low-Degree Polynomals In ths secton, we state a lemma whch says that functons n L R n, γ n ), and more generally n L Z n, µ n ), can be converted to low-degree polynomals whle approxmately preservng correlatons wth other functons and also not devatng much from the smplex k. Ths technque s consdered qute standard and was also used n GKS6b, DMN7a, DMN7b for the same reason. For completeness, we provde the proof n Appendx B. Lemma 4. Man Smoothng Lemma). Let 0,, δ > 0, k N be any gven constant parameters. There exsts an explct d = d, k, δ) such that the followng holds: Correlated Dscrete Hypercube): Let Z Z, µ) be a ont probablty space, wth Z, Z; µ) =. Let A : Z n R k and B : Z n R k, such that, for any k : VarA ),VarB ). Then, there exst functons A ) : Z n R k and B ) : Z n R k such that statements -4 below hold. Correlated Gaussan): Let A : R n R k and B : R n R k, such that, for any k : VarA ),VarB ). Then, there exst functons A ) : R n R k and B ) : R n R k such that statements -4 below hold.. A ) and B ) have degree at most d.. For any k, t holds that VarA ) ) VarA ) andvarb ) ) VarB ). 3. RA ) ) A ) RA) A + δ and RB ) ) B ) RB) B + δ 4. For every, k, A ), B ) µ n A, B µ δ n k A ), B ) A, B G G n n δ k Correlated Dscrete Hypercube) Correlated Gaussan) In partcular, one may take d = O ) k log k/δ). δ ) 5 Reducton from General Polynomals to Multlnear Polynomals In ths secton, we present a smple technque to convert low-degree non-multlnear) polynomals nto multlnear polynomals, wthout hurtng the correlaton, albet ncreasng the number of varables slghtly. Ths step s of a smlar nature as Lemma 4.. In partcular, note that the condtons,, 3, 5 n the followng lemma are also present n Lemma 4.. Ths dea also appears n DMN7a, DMN7b. Snce the exact statement we desre s slghtly dfferent, we provde a proof for completeness n Appendx C. Lemma 5. Mult-lnearzaton Lemma). Let 0,, δ > 0, d, k Z 0 be any gven constant parameters. There exsts an explct t = tk, d, δ) such that the followng holds: Let A : R n R k and B : R n R k be degree-d polynomals, such that, for any k : VarA ),VarB ). Then, there exst functons A ) : R nt R k and B ) : R nt R k such that the followng hold. A ) and B ) are multlnear wth degree d.. For any k, t holds that VarA ) ) VarA ) andvarb ) ) VarB ). 3. RA ) ) A ) RA) A + δ and RB ) ) B ) RB) B + δ 6