arxiv: v3 [math.na] 9 Oct 2017

Transcription

1 Fas randoized ieraion: diffusion Mone Carlo hrough he lens of nuerical linear algebra Lek-Heng Li 1 and Jonahan Weare 1,2 arxiv: v3 [ah.na] 9 Oc Deparen of Saisics, Universiy of Chicago 2 Jaes Franck Insiue, Universiy of Chicago Absrac We review he basic ouline of he highly successful diffusion Mone Carlo echnique coonly used in conexs ranging fro elecronic srucure calculaions o rare even siulaion and daa assiilaion, and propose a new class of randoized ieraive algorihs based on siilar principles o address a variey of coon asks in nuerical linear algebra. Fro he poin of view of nuerical linear algebra, he ain novely of he Fas Randoized Ieraion schees described in his aricle is ha hey work in eiher linear or consan cos per ieraion (and in oal, under appropriae condiions) and are raher versaile: we will show how hey apply o soluion of linear syses, eigenvalue probles, and arix exponeniaion, in diensions far beyond he presen liis of nuerical linear algebra. While radiional ieraive ehods in nuerical linear algebra were creaed in par o deal wih insances where a arix (of size O(n 2 )) is oo big o sore, he algorihs ha we propose are effecive even in insances where he soluion vecor iself (of size O(n)) ay be oo big o sore or anipulae. In fac, our work is oivaed by recen DMC based quanu Mone Carlo schees ha have been applied o arices as large as We provide basic convergence resuls, discuss he dependence of hese resuls on he diension of he syse, and deonsrae draaic cos savings on a range of es probles. 1 Inroducion Nuerical linear algebra has been he cornersone of scienific copuing fro is earlies days and randoized approaches o solving probles in linear algebra have a hisory alos as long as nuerical linear algebra iself (see e.g. [1, 18, 19, 25, 34, 35, 36, 37, 38, 62]). 1 As he size of arices encounered in ypical applicaions has increased (e.g. as we sough greaer and greaer accuracy in nuerical soluion of parial differenial equaions), so has he aenion paid o he perforance of linear algebra rouines on very large arices boh in ers of eory usage and operaions coun. Today, in applicaions ranging fro nuerical soluion of parial differenial equaions (PDE) o daa analysis, we are frequenly faced wih he need o solve linear algebraic probles a and beyond he boundary of applicabiliy of classical echniques. In response, randoized nuerical linear algebra algorihs are receiving renewed aenion and, over he las decade, have becoe an iensely popular subjec of sudy wihin he applied aheaics and copuer science couniies (see e.g. [14, 20, 21, 22, 24, 28, 44, 46, 54, 55, 61, 64]). The goal of his aricle is o, afer providing a brief inroducion o he highly successful diffusion Mone Carlo (DMC) algorih, sugges a new class of algorihs inspired by DMC for probles in 1 As poined ou in [30] any classical ieraive echniques in nuerical linear algebra are iniaely relaed o Markov chain Mone Carlo (MCMC) schees. 1

2 nuerical linear algebra. DMC is used in applicaions including elecronic srucure calculaions, rare even siulaion, and daa assiilaion, o efficienly approxiae expecaions of he ype appearing in Feynan Kac forulae, i.e., for weighed expecaions of Markov processes ypically associaed wih parabolic parial differenial equaions (see e.g. [16]). While based on principles underlying DMC, he Fas Randoized Ieraion (FRI) schees ha we sudy in his aricle are designed o address arguably he os classical and coon asks in arix copuaions: linear syses, eigenvecor probles, and arix exponeniaion, i.e., solving for v in Av = b, Av = λv, v = exp(a)b (1) for arices A ha igh no have any naural associaion wih a Markov process. FRI schees rely on basic principles siilar o hose a he core of oher randoized ehods ha have appeared recenly in he nuerical linear algebra lieraure bu hey differ subsanially in deail and in he probles hey address. These differences will be rearked on again laer, bu roughly, while any recen randoized linear algebra echniques rely on a single sapling sep, FRI ehods randoize repeaedly and, as a consequence, are ore sensiive o errors in he consruced randoizaions. FRI schees are no, however, he firs o eploy randoizaion wihin ieraive schees (see in paricular [1] and [34]). In fac he sraegy of replacing expensive inegrals or sus (wihou iediae sochasic inerpreaion) appearing in ieraive proocols has a long hisory in a diverse array of fields. For exaple, i was used in schees for he nuerical soluion of hyperbolic syses of parial differenial equaions in [11]. Tha sraegy is represened oday in applicaions ranging fro densiy funcional calculaions in physics and cheisry (see e.g. [3]) o axiu likelihood esiaion in saisics and achine learning (see e.g. [8]). Though relaed in ha hey rely on repeaed randoizaion wihin an ieraive procedure, hese schees differ fro he ehods we consider in ha hey do no use a sochasic represenaion of he soluion vecor iself. In conras o hese and oher randoized ehods ha have been used in linear algebra applicaions, our focus is on probles for which he soluion vecor is exreely large so hey can only be reaed by linear or consan cos algorihs. In fac, he schee ha is our priary focus is ideally suied o probles so large ha he soluion vecor iself is oo large o sore so ha no radiional ieraive ehod (even for sparse arices) is appropriae. This is possible because our schee copues only low diensional projecions of he soluion vecor and no he soluion vecor iself. The full soluion is replaced by a sequence of sparse rando vecors whose expecaions are close o he rue soluion and whose variances are sall. Diffusion Mone Carlo (see e.g. [2, 7, 10, 26, 32, 33, 40, 42, 45]) is a cenral coponen in he quanu Mone Carlo (QMC) approach o copuing he elecronic ground sae energy of he Schrödinger Hailonian operaor 2 Hv = 1 v + U v. (2) 2 We are oivaed in paricular by he work in [7] in which he auhors apply a version of he DMC procedure o a finie (bu huge) diensional projecion of H ono a discree basis respecing an ani-syery propery of he desired eigenfuncion. The approach in [7] and subsequen papers have yielded rearkable resuls in siuaions where he projeced Hailonian is an exreely large arix (e.g , see [59]) and sandard approaches o finie diensional eigenprobles are far fro reasonable (see [4, 5, 6, 12, 13, 59]). The basic DMC approach is also a he core of schees developed for a nuber of applicaions beyond elecronic srucure. In fac, early incarnaions of DMC were used in he siulaion of sall 2 The sybol is used here and below o denoe he usual Laplacian operaor on funcions of R d, u = d i=1 2 x i u. U is a poenial funcion ha acs on v by poinwise uliplicaion. Though his operaor is syeric, he FRI schees we inroduce below are no resriced o syeric eigenprobles. 2

3 probabiliy evens [39, 56] for saisical physics odels. Also in saisical physics, he ransfer arix Mone Carlo (TMMC) ehod was developed o copue he pariion funcions of cerain laice odels by exploiing he observaion ha he pariion funcion can be represened as he doinan eigenvalue of he so-called ransfer arix, a real, posiive, and sparse arix (see [48]). TMMC ay be regarded as an applicaion of DMC o discree eigenprobles. DMC has also becoe a popular ehod for any daa assiilaion probles and he noion of a copression operaion inroduced below is very closely relaed o he resapling sraegies developed for hose probles (see e.g. [31, 41, 15]). One can view he basic DMC (or MCMC for ha aer) procedure as a cobinaion of wo seps: In one sep an inegral operaor (a Green s funcion) is applied o an approxiae soluion consising of a weighed finie su of dela funcions, in anoher sep he resuling funcion (which is no longer a finie ixure of dela funcions) is again approxiaed by a finie ixure of dela funcions. The ore dela funcions allowed in he ixure, he higher he accuracy and cos of he ehod. A key o undersanding he success of hese ehods is he observaion ha no all dela funcions (i.e., a all posiions in space) need appear in he ixure. A siilar observaion holds for he ehods we inroduce: FRI schees need no access all enries in he arix of ineres o yield an accurae soluion. In fac, we prove ha he cos o achieve a fixed level of accuracy wih our ehods can be bounded independenly of he size of he arix, hough in any applicaions one should expec soe dependence on diension. As wih oher randoized schees, when an effecive deerinisic ehod is available i will very likely ouperfor he ehods we propose; our focus is on probles for which saisfacory deerinisic alernaives are no available (e.g. when he size of he inerediae ieraes or final resul are so large as o prohibi any conceivable deerinisic ehods). Moreover, he schees ha we propose are a suppleen and no a replaceen for radiional diensional reducion sraegies (e.g. inelligen choice of basis). Indeed, successful applicaion of DMC wihin pracical QMC applicaions relies heavily on a change of variables based on approxiaions exraced by oher ehods (see he discussion of iporance sapling in [26]). The heoreical resuls ha we provide are soewha aypical of resuls coonly presened in he nuerical linear algebra lieraure. In he conex of linear algebra applicaions, boh DMC and FRI schees are os naurally viewed as randoizaions of sandard ieraive procedures and heir perforance is largely deerined by he srucure of he paricular deerinisic ieraion being randoized. For his reason, as well as o avoid obscuring he essenial issues wih he deails of individual cases, we choose o frae our resuls in ers of he difference beween he ieraes v produced by a general ieraive schee and he ieraes generaed by he corresponding randoized schee V (raher han considering he difference beween V and li v ). In ideal siuaions (see Corollary 1) our bounds are of he for V v := E [ f V f v 2 ] C (3) sup f C n, f 1 where he (in general -dependen) consan C is independen of he diension n of he proble and n conrols he cos per ieraion of he randoized schee (one ieraion of he randoized schee is roughly a facor of n/ less cosly han is deerinisic counerpar and he wo schees are idenical when = n). The nor in (3) easures he roo ean squared deviaion in low diensional projecions of he ieraes. This choice is iporan as described in ore deail in Secions 3 and 4. For ore general applicaions, one can expec he consan C, which incorporaes he sabiliy properies of he randoized ieraion, o depend on diension. In he wors case scenario, he randoized schee is no ore efficien han is deerinisic counerpar (in oher words, reasonable perforance ay require n). Our nuerical siulaions, in which n/ ranges roughly beween 10 7 and 10 14, srongly sugges ha his scenario ay be rare. 3

4 We will begin our developen in Secion 2 wih a descripion of he basic diffusion Mone Carlo procedure. Nex, in Secion 3 we describe how ideas borrowed fro DMC can be applied o general ieraive procedures in nuerical linear algebra. As a prooypical exaple, we describe how randoizaion can be used o draaically decrease he cos of finding he doinan eigenvalue and (projecions of) he doinan eigenvecor. Also in ha secion, we consider he specific case in which he ieraion apping is an ε-perurbaion of he ideniy, relevan o a wide range of applicaions involving evoluionary differenial equaions. In his case a poorly chosen randoizaion schee can resul in an unsable algorih while a well chosen randoizaion can resul in an error ha decreases wih ε (over ε 1 ieraions). Nex, in Secions 4 and 5, we esablish several siple bounds regarding he sabiliy and error of our schees. Finally, in Secion 6 we provide hree copuaional exaples o deonsrae he perforance of our approach. A siple, educaional ipleenaion of Fas Randoized Ieraion applied o our firs copuaional exaple is available online (see [63]). Reark 1. In several places we have included rearks ha clarify or ephasize conceps ha ay oherwise be unclear o readers ore failiar wih classical, deerinisic, nuerical linear algebra ehods. We anicipae ha soe of hese rearks will be useful o his aricle s broader audience as well. 2 Diffusion Mone Carlo wihin quanu Mone Carlo The ground sae energy, λ, of a quanu echanical syse governed by he Hailonian in (2) is he salles eigenvalue (wih corresponding eigenfuncion v ) of he Heriian operaor H. The saring poin for a DMC calculaion is he iaginary-ie Schrödinger equaion 34 v = Hv (4) (for a review of QMC see [26]). One can, in principle, use power ieraion o find λ : beginning fro an iniial guess v 0 (and assuing a gap beween λ and he res of he specru of H), he ieraion λ = 1 ε log e εh e εh v 1 v 1 (x) dx and v = e εh (5) v 1 (x) dx will converge o he pair (λ, v ) where v is he eigenfuncion corresponding o λ. Here he inegral is over x R d. Reark 2. For readers who are ore failiar wih he power ehod in nuerical linear algebra, his ay see a bi odd bu a discree analogue of (5) is jus v = Av 1 / Av 1 1 applied o a posiive definie arix A = exp( εh) C n n where H is Heriian. 5 The sligh deparure fro he usual power ehod is only in (i) noralizing by a 1-nor (or raher, by he su of enries 1 T Av 1 since boh v and A are non-negaive), and (ii) ieraing on exp( εh) insead of on H direcly (he goal in his conex is o find he salles eigenvalue of H no he agniudedoinan eigenvalue of H). The ieraion on he eigenvalue is hen λ = ɛ 1 log Av 1 1 since λ (H) = ɛ 1 log λ (A). 3 The reader failiar wih quanu echanics bu unfailiar wih QMC ay wonder why we begin wih he iaginary ie Schrödinger equaion and no he usual Schrödinger equaion i v = Hv. The reason is ha while he soluions o boh equaions can be expanded in ers of he eigenfuncions of H, for he usual Schrödinger equaion he conribuions o he soluion fro eigenfuncions wih larger eigenvalues do no decay relaive o he ground sae. By approxiaing he soluion o he iaginary ie equaion for large ies we can approxiae he ground sae eigenfuncion of H. 4 In pracical QMC applicaions one solves for ρ = v ṽ where ṽ is an approxiae soluion found in advance by oher ehods. The new funcion ρ is he ground sae eigenfuncion of a Hailonian of he for Hv = 1 v + div(bv) + Ũv. The iplicaions for he discussion in his secion are inor. 2 5 Noe ha he arix H is no he sae as he operaor H on a funcion space, and is only inroduced for he purposes of relaing he expression in (5) o he usual power ehod for arices 4

5 The firs sep in any (deerinisic or sochasic) pracical ipleenaion of (5) is discreizaion of he operaor e εh. Diffusion Mone Carlo ofen uses he second order ie discreizaion e εh K ε = e ε 2 U e ε 2 e ε 2 U. A sandard deerinisic approach would hen proceed by discreizing he operaor K ε in space and replacing e εh in (5) wih he space and ie discreized approxiae operaor. The nuber of spaial discreizaion poins required by such a schee o achieve a fixed accuracy will, in general, grow exponenially in he diension d of x. Diffusion Mone Carlo uses wo randoizaion seps o avoid his explosion in cos as d increases. These randoizaions have he effec of ensuring ha he rando approxiaions V of he ieraes v are always of he for V (x) = N δ (j) X (x) W (j) j=1 where δ y (x) is he Dirac dela funcion cenered a y R d, he W (j) are real, non-negaive nubers wih E [ N j=1 W (j) ] = 1, and, for each j N, X (j) R d. As will be ade clear in a oen, he ineger superscriped in our noaion conrols he nuber of dela funcions, N, included in he above expression for V. The fac ha he funcion V is non-zero a only N values is crucial o he efficiency of diffusion Mone Carlo. Saring wih N 0 = and fro an iniial condiion of he for V0 = 1 δ j=1 X (j) 0 he firs facor of e ε 2 U applied o V0 resuls in 1 j=1 e ε 2 U(X(j) 0 ) δ (j) X 0 which can be assebled in O() operaions. The firs of he randoizaion seps used in DMC relies on he well known relaionship f(x)[e ε 2 δ y ](x) dx = E y [f(b ε )] (6) where f is a es funcion, B s is a sandard Brownian oion evaluaed a ie s 0, and he subscrip on he expecaion is ean o indicae ha B 0 = y (i.e., in he expecaion in (6) B ε is a Gaussian rando variable wih ean y and variance ε). In fac, his represenaion is a special case of he Feynan Kac forula f(x)[e εh [ δ y ](x) dx = E y f(bε )e ε 0 U(Bs) ds]. Represenaion (6) suggess he approxiaion K ε V 0 Ṽ 1 = 1 j=1 e ε 2 ( U(ξ (j) 1 )+U(X(j) 0 ) )δ ξ (j) 1 where, condiioned on he X (j) 0, he ξ(j) 1 are independen and ξ (j) 1 is norally disribued wih ean X (j) 0 and covariance εi (here I is he d d ideniy arix). This firs randoizaion has allowed an approxiaion of K ε V 0 by a disribuion, Ṽ One igh, herefore, aep o define a sequence V V +1 = Ṽ +1 Ṽ +1 (x) dx = where we have recursively defined he weighs W (j) +1 = e ε 2 l=1 e ε 2 1, ha is again suppored on only poins in Rd. ieraively by he recursion ( U(ξ (j) +1 )+U(X(j) ) j=1 W (j) +1 δ ξ (j) +1 ) ( U(ξ (l) +1 )+U(X(l) ) W (j) ) W (l) 5

6 wih W (j) 0 = 1/ for each j. The cos of his randoizaion procedure is O(d) so ha he oal cos of a single ieraion is O(d). A each sep he weighs in he expression for he ieraes V are uliplied by addiional rando facors. These facors are deerined by he poenial U and he posiions of he ξ (j). On he oher hand, he ξ (j), evolve wihou reference o he poenial funcion U (hey are discreely sapled poins fro independen Brownian oions). As a consequence, over any ieraions one can expec exree relaive variaions in he W (j) and, herefore, poor accuracy in V as an approxiaion of he funcions v produced by (5). The second randoizaion eployed by he DMC algorih is he key o conrolling he growh in variance and generalizaions of he idea will be key o designing fas randoized ieraion schees in he nex secion. In order o conrol he variaion in weighs, a sep, DMC randoly reoves poins ξ (j) corresponding o sall weighs W (j) and duplicaes poins corresponding o large weighs. The resuling nuber of poins sored a each ieraion, N, is close o, or exacly,. A sep, a new disribuion Y is generaed fro V so ha E [Y V ] = V by resapling a new collecion of N +1 poins fro he N poins ξ (j) W (j). The resuling poins are labeled X (j) Y and he new disribuion Y = 1 N N+1 j=1 δ X (j) The nex ierae V+1 is hen buil exacly as before bu wih V selec he X (j) generae, for each j, a non-negaive ineger N (j) E [ N (j) { W (l) } l=1] = W (j). wih associaed probabiliies akes he for replaced by Y. All ehods o and hen ses N (j) of he eleens in he collecion {X (j) } N +1 j=1 equal o ξ (j) so ha N +1 = N. For exaple, one popular sraegy in DMC generaes he N (j) independenly wih j=1 N (j) P [ N (j) P [ N (j) wih = W (j) ] (j) (j) = W W, = W (j) ] (j) = W W (j) (7). The above seps define a randoized ieraive algorih o generae approxiaions V of v. The second randoizaion procedure (generaing Y fro V ) will ypically require O() operaions, preserving he overall O(d) per ieraion cos of DMC (as we have described i). The eory requireens of he schee are also O(d). The eigenvalue λ can be approxiaed, for exaple, by 1 ε log ( 1 T T =1 1 N N j=1 e ( ε U(ξ (j) 2 +1 )+U(X(j) ) for T large. Before oving on o ore general probles noice ha he schee jus oulined applies jus as easily o space-ie discreizaions of e εh. For exaple, if we se h = (1 + 2d)ε and denoe by E d h Rd he unifor recangular grid wih resoluion h in each direcion, he operaor e εh can be discreized using e εh K ε,h = e ε 2 U e ε 2 h e ε 2 U where, for any vecor g E d h, h g(x) = 1 ε )) ( g(x) + 1 ) 1 + 2d g(y) y Eh d, y x 2 h 6

7 (here we find i convenien o idenify funcions g : Eh d R and vecors in h). REd The operaor e ε h again has a sochasic represenaion; now he represenaion is in ers of a jup Markov process wih jups fro a poin in Eh d o one of is neares neighbors on he grid (for an ineresing approach o discreizing sochasic differenial equaions aking advanage of a siilar observaion see [9]). Reark 3. The reader should noice ha no only will we be unable o sore he arix K ε,h (which is exponenially large in d) or afford o copue K ε,h v for a general vecor v, bu we will no even be able o sore he ieraes v generaed by he power ehod. Even he sparse arix rouines developed in nuerical linear algebra o deal wih large arices are no reasonable for his proble. In his discree conex, a direc applicaion of he DMC approach (as in [48]) would represen he soluion vecor as a superposiion of sandard basis eleens 6 and replace calculaion of K ε,h v by a rando approxiaion whose cos is (for his paricular proble) free of any direc dependence on he size of K ε,h (hough is cos can depend on srucural properies of K ε,h which ay be relaed o is size), whose expecaion is exacly K ε,h v, and whose variance is sall. The approach in [7] is also an applicaion of hese sae basic DMC seps o a discree proble, hough in ha case he desired eigenvecor has enries of a priori unkown sign, requiring ha he soluion vecor be represened by a superposiion of signed sandard basis eleens. In his aricle we ake a differen approach o adaping DMC o discree probles. Insead of reproducing in he discree seing exacly he seps coprising DMC, consider a slighly odified schee ha ois direc randoizaion of an approxiaion o e ε h, and insead relies solely on a general rando apping Φ very siilar o he ap fro V o Y bu which akes a vecor V R Ed h wih non-negaive enries and V 1 = 1 (i.e., a probabiliy easure on {1, 2,..., Eh d }) and produces a new rando vecor Y wih, or nearly, non-zero coponens and saisfying E [Y V ] = V as above. Saring fro a non-negaive iniial vecor V0 Eh d wih V 0 1 = 1 and wih a os O(d) non-zero enries, V+1 is generaed fro V as follows: Sep 1. Generae Y = Φ (V ) wih approxiaely or exacly non-zero enries. Sep 2. Se V+1 = K ε,hy K ε,h Y. 1 Jus as a ieraion, DMC produces a rando approxiaion of he resul of ieraions of power ieraion for he infinie diensional inegral operaor e εh, he above seps produce a rando approxiaion of he resul of ieraions of he power ieraion for he arix K ε,h. The iproved efficiency of DMC is due o he applicaion of he inegral operaor o a finie su of dela funcions in place of a ore general funcion. Siilarly, he efficiency of he finie diensional ehod in he above wo sep procedure is a consequence of replaceen of a general vecor v in he produc K ε,h v by a sparse approxiaion, Φ (v). For he rando apping Φ (v) we igh, for exaple, adap he popular resapling choice enioned above and choose he enries of Y independenly wih P [ (Y ) j = (V ) j / ] = (V ) j (V ) j, P [ (Y ) j = (V ) j / ] = (V ) j (V ) j (8). Noe ha his rule resuls in a vecor Y hand, when he nuber of non-zero enries in V wih expecaion exacly equal o V. On he oher is large, any of hose enries us be less han 6 The dela funcions represen he indices of v ha we are keeping rack of; δ ξ is ore coonly denoed e ξ in nuerical linear algebra he sandard basis vecor wih 1 in he ξh coordinae and zero elsewhere. 7

8 1/ (because V 1 = 1) and will have soe probabiliy of being se equal o zero in Y. In fac, he nuber of non-zero enries in Y has expecaion and variance bounded by. The deails of he appings Φ, which we call copression appings, will be described laer in Secion 5 where, for exaple, we will find ha he cos of applying he apping Φ will ypically be O(n) when is arguen has n non-zero enries (in his seing n = O(d)). And while he cos of applying K ε,h o an arbirary vecor in R Ed h is Eh d, he cos of applying K ε,h o a vecor wih non-zero enries is only O(d). The oal cos of he schee per ieraion is herefore O(d) in sorage and operaions. These cos requireens are dependen on he paricular spaial discreizaion of e ε ; if we had chosen a discreizaion corresponding o a dense arix K ε,h hen he cos reducion would be uch less exree. Noneheless, as we will see in Secion 3, he schee jus described can be easily generalized and, as we will see in Secions 4 and 6, will ofen resul in ehods ha are significanly faser han heir deerinisic counerpars. Reark 4. Raher han focusing on sapling indices of enries in a vecor v, as is ypical of soe of he lieraure on randoized nuerical linear algebra, we focus on consrucing an accurae sparse represenaion of v. This is priarily a difference of perspecive, bu has consequences for he accuracy of our randoizaions. For exaple, he echniques in [18, 19] and in [20, 21, 22] would correspond, in our noaion and conex, o seing for v R n Φ (v) = v 1 n j=1 v j v j N (j) e j (9) where e j is he jh sandard basis eleen and he rando vecor ( (1) N, N (2),..., N (n) ) Mulinoial(, p1,..., p n ) wih p j = v j / v 1. As for all Mone Carlo ehods, he sparse characerisic of his represenaion is responsible for gains in efficiency. And, when error is easured by he nor in (3), only a rando sparse represenaion can be accurae for general v. Bu rando index selecion yields only one of any possible rando sparse represenaions of v and no one ha is paricularly accurae. In fac, effecive fas randoized ieraion schees of he ype inroduced in his paper canno be based solely on rando index selecion as in (9). In he seing of his secion, if we were o use (9) in place of he rule in (8) he resul would be an unsable schee (he error would becoe unconrollable as ε is decreased). As we will see in Secion 5, uch ore accurae sparse represenaions are possible. Even resricing ourselves o he quanu Mone Carlo conex, here is aple oivaion o generalize he DMC schee. Ofen one wishes o approxiae no he salles eigenvalue of H bu insead he salles eigenvalue corresponding o an anisyeric (in exchange of paricle posiions) eigenfuncion. DMC as described in his secion, canno be applied direcly o copuing his value, a difficuly coonly referred o as he Ferion sign proble. Several auhors have aeped o address his issue wih various odificaions of DMC. In paricular, Alavi and coworkers recenly developed a version of DMC for a paricular spaial disreizaion of he Hailonian (in he configuraion ineracion basis) ha exacly preserves anisyery (unlike he finie difference discreizaion we jus described). Run o convergence, heir ehod provides he sae approxiaion as he so called full CI ehod bu can be applied wih a uch larger basis (e.g. in experiens by Alavi and coworkers repored in [59] up o oal funcions in he expansion of he soluion). Though he generalizaions of DMC represened by he wo sep procedure in he las paragraph and by he developens in he nex secion are oivaed by he schee proposed in [7], hey differ subsanially in heir deails and can be applied o a wider range of probles (including differen discreizaions of H). Finally we reark ha, while we have considered DMC in he paricular conex of copuing he ground sae energy of a Hailonian, he ehod is used for a uch wider variey of asks wih only inor odificaion o is basic srucure. For 8

9 exaple, paricle filers (see e.g. [15]) are an applicaion DMC o on-line daa assiilaion and subsanive differences are osly in he inerpreaion of he operaor o which DMC is applied (and he fac ha one is ypically ineresed in he soluion afer finiely any ieraions). 3 A general fraework Consider he general ieraive procedure, v +1 = M(v ) (10) for v C n. Eigenprobles, linear syses, and arix exponeniaion can each be accoplished by versions of his ieraion. In each of hose seings he cos of evaluaing M(v) is doinaed by a arix-vecor uliplicaion. We assue ha he cos (in ers of floaing poin operaions and sorage) of perforing he required arix-vecor uliplicaion akes i ipossible o carry ou recursion (10) o he desired precision. As in he seps described a he end of he las secion, we will consider he error resuling fro replaceen of (10) by V+1 = M (Φ (V )). (11) where he copression aps Φ : C n C n are independen, inexpensive o evaluae, and enforce sparsiy in he V ieraes (he nuber of non-zero enries in V will be O()) so ha M can be evaluaed a uch less expense. When M is a perurbaion of ideniy and an O(n) schee is appropriae (see Secions 3.2 and 4 below) we will also consider he schee, The copressions Φ V+1 = V + M (Φ (V )) Φ (V ). (12) will saisfy (or very nearly saisfy) he saisical consisency crierion E [Φ (v)] = v and will have o be carefully consruced o avoid insabiliies and yield effecive ehods. For definieness one can iagine ha Φ is defined by a naural exension of (8) [ P (Φ (v)) j = v ] j vj vj = v j, v j v 1 v 1 v 1 [ P (Φ (v)) j = v ] j vj = v (13) j vj v j v 1 v 1 v 1 o accep arguens v C n (V is no longer a non-negaive real nuber). This choice has several drawbacks, no leas of which is is cos, and we do no use i in our nuerical experiens. Alernaive copression schees, including he one used in our nuerical siulaions, are considered in deail in Secion 5. There we will learn ha one can expec ha, for any pair f, v C n, E [ f H Φ (v) f H v 2 ] 2 f v 1 (14) (he superscrip H is used hroughou his aricle o denoe he conjugae ranspose of a vecor wih coplex enries). These errors are inroduced a each ieraion and need o be reoved o obain an accurae esiae. Depending on he seing, we ay rely on averaging over long rajecories, averaging over parallel siulaions (replicas), or dynaical self-averaging (see Secions 3.2 and 4), o reove he noise inroduced by our randoizaion procedure. Because he specific choice of M and he for of averaging used o reove noise can differ subsanially by seing, we will describe he schees wihin he conex of specific (and coon) ieraive procedures The eigenproble revisied Consider, for exaple, a ore general eigenproble han he one we considered in Secion 2. Given K C n n he goal is o deerine λ C and v C n such ha Kv = λ v (15) 9

10 and such ha, for any oher soluion pair (λ, v), λ < λ. In wha follows in his secion we will assue ha his proble has a unique soluion. The sandard ehods of approxiae soluion of (15) are varians of he power ehod, a siple version of which perfors v +1 = Kv Kv 1, λ +1 = uh Kv u H v (16) where u C n is chosen by he user. Under generic condiions, hese converge o he correc (λ, v ) saring fro an appropriae iniial vecor v 0 (see e.g. [17]). The schee in (16) requires O(n 2 ) work per ieraion and a leas O (n) sorage. In his aricle, we are ineresed in siuaions in which hese cos and sorage requireens are unreasonable. Fro O ( n 2) o O (n) For he ieraion in (16) he randoized schee (11) (along wih an approxiaion of λ ) becoes V+1 = KΦ (V ) KΦ (V, Λ +1 = uh KΦ (V ) ) 1 u H V, V = 1 Vs, Λ, = 1 (17) Λ s=1 where V and Λ are rajecory averages esiaing v and λ. In (17), he copressions Φ are independen of one anoher. Using he rules defining Φ in Secion 5, consrucion of Φ (V ) a each sep will require O(n) operaions. Since uliplicaion of he vecor Φ (V ) by a dense arix K requires O(n) operaions, his schee has O(n) cos and O(n) sorage per ieraion requireen. Ieraion (12) on he oher hand replaces (16) wih ( KΦ V+1 = V + (V ) ) KΦ (V Φ (V ), Λ +1 = uh KΦ (V ) ) 1 u H V. (18) By he sae arguens as above, his ieraion will also have cos and sorage requireens of O(n) and O(n) respecively. When K = I + εa for soe arix A and sall paraeer ε > 0, he ieraion in (18) bears srong reseblance o he Robbins Monro sochasic approxiaion algorih [53, 43]. In fac, as we will see in Secion 4, when he apping M is of he for v +εb(v) he convergence of ehods of he for in (11) and (12) is relian on he self-averaging phenoenon also a he hear of sochasic approxiaion. We will also learn ha for M of his for one can expec he error corresponding o (12) o be saller han he error corresponding o (11). Fro O(n) o O() For any probles even O(n) cos and sorage requireens are unaccepable. This is he case, for exaple, when n is so large ha a vecor of lengh n canno be sored. Bu now suppose ha K is sparse wih a os q non-zero enries per colun. Because Φ 1 (V 1 ) has O() non-zero enries, he produc KΦ 1 (V 1 ) (and hence also V ) has a os O(q) enries and requires O(q) operaions o asseble. On he oher hand, if V has a os O(q) non-zero enries, hen applicaion of Φ o V requires only O(q) operaions. Consequenly, as long as V0 has a os O(q) non-zero enries, he oal nuber of floaing poin operaions required by (17) reduces o O (q) per ieraion. This observaion does no hold for ehods of he for (12) which will ypically resul in dense ieraes V and a cos of O(n) even when K is sparse. As we have enioned (and as was rue in Secion 2), in any seings even soring he full soluion vecor is ipossible. Overcoing his ipedien requires a deparure fro he usual perspecive of nuerical linear algebra. Insead of rying o approxiae all enries of v, our goal becoes o copue f = f H v 10 s=1

11 for soe soe vecor (or sall nuber of vecors) f. This change in perspecive is refleced in he for of our copression rule error esiae in (14) and in he for of our convergence resuls in Secion 4 ha easure error in ers of do producs wih es vecors as in (3) above. As discussed in ore deail in Secion 4, he choice of error nor in (3) is essenial o our evenual error esiaes. Indeed, were we o esiae a ore sandard quaniy such as E [ V v 1 ] we would find ha he error decreased proporional o (n )/n requiring ha increase wih n o achieve fixed accuracy. The algorihic consequence of our focus on copuing low diensional projecions of v is siply he reoval in (17) of he equaion defining V and inserion of F which produces an esiae F of f. = f H V and F = 1 Fs (19) Reark 5. While esiaion of f ay see an unusual goal in he conex of classical ieraive schees i is copleely in line wih he goals of any Markov chain Mone Carlo schee which ypically seek only o copue averages wih respec o he invarian easure of a Markov chain and no o copleely characerize ha easure. Schees wih O () sorage and operaions requireens per-ieraion can easily be designed for any general arix. Accoplishing his for a dense arix requires an addiional randoizaion in which coluns of K (or of soe facor of K) are randoly se o zero independenly a each ieraion, e.g. again in he conex of power ieraion, assuing ha V 1 has a os O() non-zero enries, one can use V = Y Y +1 1 wih Y +1 = n j=1 s=1 (Φ (V )) j Φ j,j (K j ) (20) in place of (17), where here K j is used o denoe he jh colun of K and each Φ j,j is an independen copy of Φ j which are assued independen of Φ. The nuber of enries reained in each colun is conrolled by j which can, for exaple, be se o j = K j 1 (V ) j n l=1 K l 1 (V ) l or j = (V ) j a each ieraion and he resuling vecor can hen be copressed so ha i has exacly or approxiaely non-zero enries. Use of (20) in place of (17) will resul in a schee whose cos per ieraion is independen of n if he copressions of he coluns have cos independen of n. This ay be possible wihou inroducing significan error, for exaple, when he enries in he coluns of K can ake only a sall nuber of disinc values. Noice ha one obains he updae in (17) fro (20) by reoving he copression of he coluns. Consequenly, given V variance of V+1 (17)., he condiional generaed by (20) will ypically exceed he condiional variance resuling fro 3.2. Peurbaions of ideniy We now consider he case ha M is a perurbaion of he ideniy, i.e., ha M(v) v = ε b(v) + o(ε) (21) where ε is a sall posiive paraeer. This case is of paricular iporance because, when he goal is o solve a differenial equaion iniial value proble d d y = b(y), y(0) = y 0, (22) 11

12 discree-in-ie approxiaions ake he for (10) wih M of he for in (21). As is he case in several of our nuerical exaples, he soluion o (22) ay represen, for exaple, a seidiscreizaion (a discreizaion in space) of a parial differenial equaion (PDE). Several coon asks in nuerical linear algebra, no necessarily direcly relaed o ODE or PDE can also be addressed by considering (22). For exaple, suppose ha we solve he ordinary differenial equaion (ODE) (22) wih b(y) = Ay r for soe r C n and any n n coplex valued arix A. The soluion o (22) in his case is y() = e A y 0 + A 1 ( I e A) r. Seing r = 0 in he las display we find ha any ehod o approxiae ODE (22) for = 1 can be used o approxiae he produc of a given vecor and he exponenial of he arix A. On he oher hand, if r 0 and all eigenvalues of A have negaive real par hen, for very large, he soluion o (22) converges o A 1 r. In fac, in his case we obain he coninuous ie varian of Jacobi ieraion for he equaion Ax = r. Like Jacobi ieraion, i can be exended o soewha ore general arices. Discreizing (22) in ie wih b(y) = Ay r and a sall ie sep allows reaen of arices wih a wider range of eigenvalues han would be possible wih sandard Jacobi ieraion. Soe iporan eigenprobles are also solved using an M saisfying (21). For exaple, his is he case when he goal is o copue he eigenvalue/vecor pair corresponding o he eigenvalue of larges real par (raher han of larges agniude) of a differenial operaor, e.g. he Schrödinger operaor discussed in Secion 2. While he power ehod applied direcly o a arix A converges o he eigenvecor of A corresponding o he eigenvalue of larges agniude, he angle beween he vecor exp(a)y 0 and he eigenvecor corresponding o he eigenvalue of A wih larges real par converges o zero (assuing y 0 is no orhogonal o ha eigenvecor). If we discreize (22) in ie wih b(v) = Av and renoralize he soluion a each ie sep (o have uni nor) hen he ieraion will converge o he desired eigenvecor (or a ε dependen approxiaion of ha eigenvecor). As we will learn in he nex secion, designing effecive fas randoized ieraion schees for hese probles requires ha he error in he sochasic represenaion M Φ of M decrease sufficienly rapidly wih ε. In paricular, in order for our schees o accuraely approxiae soluions o (22) over inervals of O(1) unis of ie (i.e., over O (1/ε) ieraions of he discree schee), we will need, and will verify in cerain cases, ha E [ f H M (Φ (v)) f H M(v) 2 ] ε. Obaining a bound of his ype will require ha we use a carefully consruced rando copression Φ such as hose described in Secion 5. In fac, when a schee wih O(n) cos per ieraion is accepable, ieraion (11) can be replaced by (12), i.e., by V+1 = V + ε b (Φ (V )) + o(ε) (23) in which case we can expec errors over O ( ε 1) ieraions ha vanish wih ε (raher han erely reaining sable). As we will see in ore deail in he nex secion, he principle of dynaic self-averaging is essenial o he convergence of eiher (11) or (12) when M is a perurbaion of ideniy. The sae principle is invoked in he conexs of, for exaple, uli-scale siulaion (see e.g. [52] and [23] and he any references herein) and sochasic approxiaion (see e.g. [43] and he any references herein). 4 Convergence Many randoized linear algebra schees referenced in he opening paragraph of his aricle rely a heir core on an approxiaion of a produc such as AB, where, for exaple, A and B are n n 12

13 arices, by a produc of he for AΘB where Θ is an n n rando arix wih E [Θ] = I and so ha AΘB can be assebled a uch less expense han AB. For exaple, one igh choose Θ o be a diagonal arix wih only n non-zero enries on he diagonal so ha ΘB has only non-zero rows and AΘB can be assebled in O(n 2 ) operaions insead of O(n 3 ) operaions. Alernaively one igh choose Θ = ξξ T where ξ is a n rando arix wih independen enries, each having ean 0 and variance 1/. Wih his choice one can again consruc AΘB in O(n 2 ) operaions. Typically, his randoizaion is carried ou once in he course of he algorih. The error ade in such an approxiaion can be expeced o be of size O(1/ ) where he prefacor depends (very roughly) on he size of he arices (and oher srucural properies) bu does no depend direcly on n (see e.g. [37, Equaion 30] or [20, Theore 1]). In he schees ha we consider, we apply a siilar randoizaion o speed arix vecor uliplicaion a each ieraion of he algorih (hough our copression rules vary in disribuion fro ieraion o ieraion). As explored below, he consequence is ha any sabiliy propery of he original, deerinisic ieraion responsible for is convergence, will be weakened by he randoizaion and ha effec ay inroduce an addiional n dependence in he cos of he algorih o achieve a fixed accuracy. The copression rule us herefore be carefully consruced o iniize error. Copression rules are discussed in deail in Secion 5. In his secion, we consider he error resuling fro (11) and (12) for an unspecified copression rule saisfying he generic error properies esablished (wih caveas) in Secion 5. Boh because i provides a draaic illusraion of he need o consruc accurae copression rules and because of is iporance in pracical applicaions, we pay paricular aenion o he case in which M is an ε-perurbaion of he ideniy. Our resuls rely on classical echniques in he nuerical analysis of deerinisic and sochasic dynaical syses and, in paricular, are ypical of basic resuls concerning he convergence of sochasic approxiaion (see e.g. [43] for a general inroducion and [47] for resuls in he conex of achine learning) and ineracing paricle ehods (see e.g. [16] for a general inroducion and [57] for resuls in he conex of QMC). They concern he ean squared size of he difference beween he oupu, V, of he randoized schee and he oupu, v, of is deerinisic counerpar and are chosen o efficienly highligh iporan issues such as he role of sabiliy properies of he deerinisic ieraion (10), he dependence of he error on he size of he soluion vecor, n, and he role of dynaic self-averaging. More sophisicaed resuls (such as Cenral Lii Theores and asypoic and non-asypoic exponenial bounds on deviaion probabiliies) are possible following developens in, for exaple, [43] and [16, 57]. In he ineres of reducing he lengh of his aricle we lis he proofs of all of our resuls separaely in a suppleenal docuen. Our noion of error will be iporan. I will no be possible o prove, for exaple ha E [ V v 1 ] reains sall wihou a srong dependence on n. I is no even he case ha E [ Φ (v) v 1 ] is sall when n is large and v 1 = 1. Take, for exaple, he case ha v i = 1/n. In his case any schee ha ses n enries o zero will resul in an error Φ (v) v 1 (n )/n. On he oher hand, we need o choose a easure of error sufficienly sringen so ha our evenual error bounds iply ha our ehods accuraely approxiae observables of he for f H v. For exaple, analogues of all of he resuls below using he error eric (E[ V v 2 2 ])1/2 could be esablished. However, error bounds of his for are no, by heselves, enough o iply diension independen bounds on he error in f H v because hey ignore correlaions beween he coponens of V. Indeed, in general one can only expec ha (E[ f H V f H v ]) 1/2 n(e V v 2 2 ])1/2 when f 1 Reark 6. I is perhaps ore ypical in nuerical linear algebra o sae error bounds in ers of he quaniy one uliaely hopes o approxiae and no in ers of he disance o anoher 13

14 approxiaion of ha quaniy. For exaple, one igh wonder why our resuls are no saed in ers of he oal work required o achieve (say wih high probabiliy) an error of a specified size in an approxiaion of he doinae eigenvalue of a arix. Our choice o consider he difference beween V and v is oivaed by he fac ha he essenial characerisics conribuing o errors due o randoizaion are os naurally described in ers of he ap defining he deerinisic ieraion. More radiional characerizaions of he accuracy of he schees can be inferred fro he bounds provided below and error bounds for he corresponding deerinisic ieraive schees. Moivaed by our saed goal, as described in Secion 3, of esiaing quaniies of he for f H v we easure he size of he (rando) errors produced by our schee using he nor X = E [ f H X 2 ] (24) sup f 1 where X is a rando variable wih values in C n (all rando variables referenced are assued o be funcions on a single probabiliy space which will be lef unspecified). This nor is he (, 2)-nor [27, Secion 7] of he square roo of he second oen arix of X, i.e., X = B,2 = sup Bf 2 f 1 where B H B = E [XX H ]. I is no difficul o see ha he paricular square roo chosen does no affec he value of he nor. I will becoe apparen ha our choice of he nor in (24) is a naural one for our convergence resuls in his and he nex secion. The following alernae characerizaion of will be useful laer. Lea 1. The nor in (24) ay also be expressed as where X = sup G, 1 G, := n is he dual nor 7 of he -nor of G C n n, G = ax Gf n = ax G ij. f 1 i=1,...,n j=1 E [ GX 2 1], (25) i=1 ax j=1,...,n G ij (26) Noe ha if he variable X is no rando hen one can choose f i = X i / X i in (24) and find ha X = X 1. When X is rando we have he upper bound X 2 E [ X 2 1]. If, on he oher hand, X is rando bu has ean zero and independen coponens hen X 2 = E [ X 2 2]. Concerning he relaionship beween hese wo nors ore generally, we rely on he following lea. Lea 2. Le A be any n n Heriian arix wih enries in C. Then sup f H Af race A. f 1 Lea 2, applied o he second oen arix of X, iplies ha X 2 E [ X 2 2]. Suarizing hese relaionships we have E [ X 2 2] X 2 E [ X 2 1]. (27) The nors appearing in (27) are all equivalen. Wha is iporan abou he inequaliies in (27) for our purposes is ha hey are independen of diension. 7 See [27, Proposiion 7.2]. 14

15 Basic condiions. Consisen wih resuls in he nex secion we will assue ha he ypical error fro our copression rule is Φ (v) v γ v 1 (28) for v C n, where γ is a consan ha is independen of and n. We will also assue ha E [ Φ (v) 2 1] Cb v 2 1 (29) for soe consan C b independen of and n (for he copression schee used in Secion 6, (29) is an equaliy wih C b = 1). For all of he copression ehods deailed in Secion 5 (including he one used in our nuerical experiens in Secion 6), he saisical consisency condiion E [Φ (v)] = v (30) is saisfied exacly and we will assue ha i holds exacly in his secion. Modificaion of he resuls of his secion o accoodae a bias E [Φ (v)] v 1 0 is sraighforward. As a resul of he appearance of v 1 in (28), in our evenual error bounds i will be ipossible o avoid dependence on V 1. The growh of hese quaniies is conrollable by increasing, bu he value of required will ofen depend on he n. The nex heore concerns he size of E [ V 2 1]. Afer he saeen and proof of he heore we discuss how he various quaniies appearing here can be expeced o depend on n. In his heore and in he res of our resuls i will be convenien o recognize ha, in any applicaions, he ieraes V and Y = Φ (V ) are confined wihin soe subse of C n. For exaple, he ieraes ay all have a fixed nor or ay have all non-negaive enries. We use he sybol X o idenify his subse (which differs depending on he proble). Unil Theore 6 a he end of his secion, our focus will be on ieraion (11) hough all of our resuls have analogues when (11) is replaced by ieraion (12). Theore 1. Assue ha V is generaed by eiher (11) wih a copression rule saisfying (28) and (30). Suppose ha U is a wice coninuously differeniable funcion fro X o R, saisfying for soe consans α and R, and U(M(v)) α U(v) + R for all v X v 2 1 β U(v) for all v X for soe consan β. Assue furher ha here is a consan σ and a arix G C n n saisfying G, 1, so ha, for z C n, sup v C n z H ( D 2 U(v) ) z σ Gz 2 1 where D 2 U is he arix of second derivaives of U. Then E [ V 2 1 ] βr [ 1 α ( 1 + βγ2 σ 2 1 α ( 1 + βγ2 σ 2 ) ) ] ( ) + βα 1 + βγ2 σ U(V0 ). 2 Firs, he reader should noice ha seing γ = 0 in Theore 1 shows ha he deerinisic ieraion (10) is sable whenever α < 1. However, even for an M corresponding o a sable ieraion, he randoized ieraion (11) ay no be sable (and will, in general, be less sable). If he goal is o esiae, e.g. a fixed poin of M, he user will firs have o choose large enough ha he randoized ieraion is sable. Though i is no explici in he saeen of Theore 1, in general he requireens for sabiliy will depend on n. Consider, for exaple, he case of a linear ieraion, M(v) = Kv. This ieraion is sable if he larges eigenvalue (in agniude) is less han 1. If we choose U(v) = v 2 2 hen we can ake α o be he larges eigenvalue of K H K and R = 0 in he saeen of Theore 1. The 15

16 bound 1 n 2 (and he fac ha i is sharp) suggess ha we will have o ake β = n in Theore 1 (noe ha we can ake σ = 1 in he evenual bound). This scaling suggess ha, o guaranee sabiliy we need o choose n. Forunaely his predicion is ofen (bu no always) pessiisic. For exaple, if K is a arix wih non-negaive real enries and V0 has non-negaive real enries hen he ieraes V will have real, non-negaive enries (i.e., v X iplies v i 0). We can herefore use U(v) = (1 T v) 2 = v 2 1 for v X and find ha we can ake α = K 2 1, R = 0, and β = 1, in he saeen of Theore 1. Wih his choice of U we can again choose σ = 1 so ha n does no appear direcly in he sabiliy bound. We anicipae ha os applicaions will fall soewhere beween hese wo exrees; ainaining sabiliy will require increasing as n is increased bu no in proporion o he increase in n. Having characerized he sabiliy our schees we now ove on o bounding heir error. We have crafed he heore below o address boh siuaions in which one is ineresed in he error afer a finie nuber of ieraions and siuaions ha require error bounds independen of he nuber of ieraions. In general, achieving error bounds independen of he nuber of ieraions requires ha M saisfy sronger sabiliy properies han hose iplied by he condiions in Theore 1. While he requireens in Theore 1 could be odified o iply he appropriae properies for os applicaions, we op insead for a ore direc approach and odify our sabiliy assupions on M o (31) and (32) below. In his heore and below we will ake use he noaion M s o denoe M coposed wih iself s ies. In our proof of he bound in Theore 2 below we divide he error ino wo ers, one of which is a su of individual ers wih vanishing condiional expecaions. Much like sus of independen, ean zero, rando variables wih finie variance, he size (easured by he square roo of he second oen) of heir su can be expeced o grow less han linearly wih he nuber of ieraions (see he proof of Theore 2). This general observaion is called dynaic self-averaging and resuls in an iproved error bound. The iproveen is essenial in he conex of perurbaions of he ideniy and we will enion i again below when we focus on ha case. Theore 2. Suppose ha he ieraes V of (11) reain in X C n. Fix a posiive ineger T. Assue ha here are consans α 0, L 1, and L 2, so ha for every pair of inegers s r T and for every vecor f C n wih f 1 here are arices G and G in C n n saisfying G, 1 and a bounded, easurable C n n valued funcion, A, such ha and sup v,ṽ X f H M r s(v) f H M r s(ṽ) Gv Gṽ 1 L 1 α r s (31) f H M r sup s(v) f H M r s(ṽ) f H A(ṽ)(v ṽ) v,ṽ X G v G ṽ 2 L 2 α r s. (32) 1 Then he error a sep T saisfies he bound [ V v α γ 1 ( ) 1 α 2 1/2 (L 1 + L 2 ) 1 α 2 M + γ 2 1 L 1 α ] 2 1 α M 2 where M 2 = sup r< E [ Vr 2 1]. Condiions (31) and (32) is easily verified for general linear aps M = K wih α = K 1. The condiions are ore difficul o verify for he power ieraion ap M(v) = Kv. Kv 1 A condiion close o (31) holds for all v, ṽ wih v 1 = ṽ 1 = 1 bu he paraeer α in general depends on he proxiiy of v and ṽ o he space spanned by all of he non-doinan eigenvecors 16

17 (see e.g. [60, Theore 1.1]). For large enough we can ensure ha all ieraes V reain a leas soe fixed disance fro he space spanned by he non-doinan eigenvecors bu his will ofen require ha grow wih n. As he following corollary esablishes, when he arix K is real and non-negaive we expec boh arix uliplicaion and power ieraion o have errors independen of diension. Corollary 1. Suppose ha K is a real, enry-wise non-negaive, irreducible, n n arix and ha V0 is real and non-negaive wih a os non-zero enries. Then for boh M(v) = Kv and M(v) = Kv/ Kv 1, he bound on V v in Theore 2 is independen of diension n. Le v L and v R be he unique doinan lef and righ eigenvecors of K wih corresponding eigenvalue λ. If S is he sochasic arix wih enries S ij = λ 1 (v L ) i K ij /(v L ) j and α = sup Sv 1 v 1 =1 1 T v=0 hen α < 1 and he oal error for he randoized ieraion (11) wih M(v) = Kv/ Kv 1 (i.e., for randoized power ieraion) as an approxiaion of v R is bounded by V α 1 v R C 1 + C 2 α V 1 α 0 v R (33) for soe consans C 1 and C 2 ha depend on ax j {(v L ) j }/ in j {(v L ) j }, bu do no oherwise depend on he ieraion index, diension, α, or K. The oal error bound on randoized power ieraion in Corollary 1 is a finie diensional analogue of siilar resuls concerning convergence of DMC and relaed schees (see [16] and he references herein). In fac, he ransforaion fro K o S in Corollary 1 is a finie diensional analogue of a ransforaion ha is essenial o he efficiency of QMC in pracical applicaions (see he discussion of iporance sapling in [26]) and ha was used in [57] o esablish error bounds for a QMC schee by an arguen siilar o he proof of Corollary 1. As discussed in Secion 3, when K is a dense arix, he cos per ieraion (easured in ers of floaing poin operaions) of copuing Φ (V ) is O(n), while he cos of assebling he produc KΦ (V ) is O(n). On he oher hand, when K has a os q non-zero enries per colun, he nuber of non-zero enries in V will be a os k so ha he cos of copuing Φ (V ) is only O(k) and he cos of assebling KΦ (V ) is only O(k). As a consequence of hese observaions and he bound in 33 we see ha wihin any faily of sparse (wih a uniforly bounded nuber of non-zero enries per colun) enry-wise non-negaive arices aong which he paraeer α is uniforly bounded below 1 and he raio ax j {(v L ) j }/ in j {(v L ) j } is uniforly bounded, he oal cos o achieve a fixed accuracy is copleely independen of diension. For ore general probles one can expec he speedup over he sandard deerinisic power ehod o be roughly beween a facor of n and no speedup a all (i is clear ha he randoized schee can be worse han is deerinisic counerpar when ha ehod is a reasonable alernaive). Idenificaion of ore general condiions under which one should expec sublinear scaling for FRI in he paricular conex of power ieraion sees a very ineresing proble, bu is no pursued here Bias Even for a very general ieraion he effec of randoizaion is eviden when one considers he size of he expeced error (raher han he expeced size of he error). When M(v) = Kv and V is generaed by (11), one can easily check ha z = E [V ] saisfies he ieraion z +1 = Kz, i.e., z = v. Even when he apping M is non-linear, he expeced error, E [V ] v, is ofen uch saller han he error, V v, iself. The following is jus one siple resul in his direcion and deonsraes ha one can ofen expec he bias o be O( 1 ) (which should be conrased o an expeced error of O( 1/2 )). The proof is very siilar o he proof of Theore 2 and is oied. 17

18 Theore 3. Under he sae assupions as in Theore 2 and using he sae noaion, he bias a sep T saisfies he bound E [V ] v 1 γ2 L 2 α(1 α ) 1 α M Perurbaions of ideniy. When he goal is o solve ordinary or parial differenial equaions, sronger assupions on he srucure of M are appropriae. We now consider he case in which M is a perurbaion of he ideniy. More precisely we will assue ha M(v) = v + ε b(v). (34) Though we will no wrie i explicily, furher dependence of b on ε is allowed as long as he assupions on b below hold uniforly in ε. In he differenial equaions seing ε can be hough of as a ie discreizaion paraeer as in Secion 2. An addiional condiion. When M is a perurbaion of ideniy, i is reasonable o srenghen our assupions on he error ade a each copression sep. The iproveen ses fro he fac ha he apping M nearly preserves he sparsiy of is arguen. As we will explain in deail in he nex secion, if v S where S = {z C n : {j : z j 0} } and w C n, hen i is reasonable o assue ha, for exaple, Φ (v + w) v w γ p w v + w (35) for soe consan γ p independen of and n. The following Lea illusraes how such a bound on he copression rule can ranslae ino sall copression errors when M is a perurbaion of he ideniy. Lea 3. Suppose ha he ieraes V of (11) reain in X C n and ha he copression rule saisfies (35) and (29). Suppose ha M(v) = v + εb(v) wih b(v) 1 L(1 + v 1 ) for all v X. Then for soe consan γ, Φ (V ) V 2 γ 2 ε E [ ] V E [ ] V We now provide versions of Theores 1 and 2 appropriae when M is a perurbaion of ideniy. The proofs of boh of hese heores are very siilar o he proofs of Theores 1 and 2 and are, a leas in par, oied. Firs we address sabiliy in he perurbaion of ideniy case. Theore 4. Suppose ha he ieraes V of (11) reain in X C n and ha he copression rule saisfies (35), (29), and (30). Suppose ha M(v) = v + εb(v) wih b(v) 1 L(1 + v 1 ) for all v X. Suppose furher ha U saisfies he condiions in he saeen of Theore 1 wih he excepion of he following: Now Then sup E [ [ [ ( V 2 ] exp T 1 βr ε + <T/ε U(M(v)) e εα U(v) + εr. α + β γ2 σ 2 )] ] 1 [ ( )] + β exp T α + β γ2 σ U(V0 ) 2 α + β γ2 σ 2 where γ is he consan appearing in (36) and β and σ, are defined in he saeen of Theore 1. (36) 18

19 Wha is iporan abou he saeen of Theore 4 is ha he bound reains sable as ε decreases despie he fac ha he se being supreized over is increasing. Under he assupions in he heore (which are only reasonable when M is a perurbaion of he ideniy) one can expec ha he ieraes can be bounded over O ( ε 1) ieraions uniforly in ε. The following heore inerpres he resul of Theore 2 when M is a perurbaion of ideniy. One igh expec ha, over O(ε 1 ) ieraions, O ( ε) errors ade during he copression sep would accuulae and lead o an error of O(ε 1/2 ). Indeed, his is exacly wha would happen if he errors ade in he copression sep were syseaic (i.e., if he copression bias was O ( ε)). Forunaely, when he copression rule saisfies he consisency crierion (30) he errors self average and heir effec on he overall error of he schee is reduced. As enioned above, his phenoenon played a role in he srucure of he resul in Theore 2 and is proof, bu is role is ore crucial in Theore 5 which provides unifor in ε bounds on he error of (11) over O(ε 1 ) ieraions. Wihou he reducion in he growh of he error wih provided by self-averaging i would no be possible o achieve an error bound over O ( ε 1) ieraions ha is sable as ε decreases. Theore 5. Suppose ha he ieraes V of (11) reain in X C n and ha he copression rule saisfies (35), (29), and (30). Suppose ha M(v) = v + εb(v) wih b(v) 1 L(1 + v 1 ) for all v X. Fix a real nuber T > 0 and assue ha, for soe real nuber α and soe consans L 1 and L 2 and for every pair of inegers s r T/ε, for every vecor f C n wih f 1 here are arices G and G in C n n saisfying G, 1 and a bounded, easurable C n n valued funcion A so ha and f H M r sup s(v) f H M r s(ṽ) L 1 e εα(r s) (37) v,ṽ X Gv Gṽ 1 f H M r sup s(v) f H M r s(ṽ) f H A(ṽ)(v ṽ) v,ṽ X Gv Gṽ 2 L 2 e εα(r s). (38) 1 Then he error a sep T/ε saisfies he bound V v γ(l 1 + L 2 ) (e 2αT E [ V 0 2 ] 1 e 2αT 1 + 2α where M 2 T = sup r<t/ε E [ V r 2 1]. + γ2 L 2 M T 1 + M 2 T ( e 2αT E [ V ) 1/2 ] 1 e αt + M T 1 + MT 2 α Though he error esablished in he las clai is sable as ε decreases, we have enioned in Secion 3.2 ha when M is a perurbaion of ideniy, by using ieraion (12) insead of (11), one igh be able o obain errors ha vanish as ε decreases (keeping fixed). This is he subjec of Theore 6 below which, like Theore 5 relies crucially on self-averaging of he copression errors. Noe ha ieraion (12) ypically requires O (n) operaions per ieraion and sorage of lengh n vecors. We have he following heore deonsraing he decrease in error wih ε in his seing. Theore 6. Suppose ha he ieraes V of (12) reain in X C n and ha (28) holds. Under he sae assupions on M as in Theore 5, he error a sep T/ε saisfies he bound sup V v T/ε where M 2 T = sup r<t/ε E [ V r 2 1]. εγ (L 1 + L 2 )L 1 ( 1 e 2αT 2α ) 1 2 e αε M T + εγ2 L 2 L 2 1 ( 1 e αt α ) M 2 T ). 19

20 5 Copression rules In his secion we give a deailed descripion of he copression rule used in our nuerical siulaions as well as several ohers, and an analysis of he accuracy of hose schees. Prograed efficienly, and assuing ha v has exacly n nonzero enries, all of he schees we discuss in his secion will require a os O(n) floaing poin operaions including he generaion of as few as one unifor rando variae and O(n + log n) floaing poin coparisons. I is likely ha beer copression schees are possible, for exaple by incorporaion of ideas fro [33]. The reader should noe ha in his secion n represens he nuber of non-zero enries in he inpu vecor v of he copression rule and no he diension associaed wih a paricular proble (which ay be uch larger). In our ipleenaion of (11), when he underlying arix is sparse (so ha an O() work/sorage per ieraion ehod is possible) we sore only he indices and values of he non-zero enries in any vecor (including arix coluns). We begin by discussing he siple choice (Φ (v)) j = { Nj v 1 where each N j is a rando, non-negaive, ineger wih v j v j if v j > 0, 0 if v j = 0, E [N j v] = v j (40) v 1 so ha E [Φ (v)] = v and he consisency condiion (30) is saisfied. Noice ha if we define a collecion of N = n j=1 N j inegers {X (j) } so ha exacly N j eleens of he collecion are equal o j, hen he oupu of a copression schee of his ype can be wrien N Φ (v) = v 1 j=1 v X (j) e X (j) where e j is he jh sandard basis vecor in R n. When he inpu vecor v is real Φ (v) is a finie diensional analogue of he DMC resapling sep described in Secion 2. In he infinie diensional seing he efficiency of DMC is due o he applicaion of an inegral operaor, e εh, o a finie su of dela funcions in place of a ore general funcion. Likewise, he gain in efficiency of an FRI schee over deerinisic ehods is a consequence of replaceen of a general vecor v in he produc Kv by a sparse approxiaion, Φ (v). Though we will deviae soewha fro he for in (13) o arrive a he copression schee used in he nuerical siulaions repored on in Secion 6, essenial eleens of (13) will be reained. Noice ha he consisency condiion (40) leaves subsanial freedo in he specificaion of he join disribuion of he N j. For exaple, one siple choice igh be o selec he vecor of N j fro he ulinoial disribuion wih paraeers and ( v 1, v 2,..., v n )/ v 1. This choice would resul in a copression schee saisfying (28), (29), and (30), as required in Theores 1 and 2 in Secion 4. However, i would no saisfy (35) and would be a paricularly poor choice when M is a perurbaion of he ideniy. In fac, his choice would lead o unsable schees as he size of he perurbaion decreases. An alernaive, uch ore accurae choice ha will lead below (in Lea 5) o a copression schee saisfying (35) is o selec he N j independenly wih ( ) ( ) vj vj P N j = = 1 P N j = = v j vj. (41) v 1 v 1 v 1 v 1 Noe ha his rule randoly rounds v j / v 1 o a nearby ineger and saisfies (40). The copression rule (39) wih (41) has already appeared above in (13). When v has exacly n non-zero enries, he corresponding cos o asseble Φ by his rule is O(n) operaions. However, we have ephasized repeaedly in his aricle ha he cos savings a each ieraion of an FRI schee is enirely do o sparsiy inroduced by our copressions. And he resuls of he las 20 v X (j) (39)

21 secion reveal ha copression schees wih large variance will ypically give rise o FRI schees wih large error. In his regard he copression rule in (39) is clearly subopial. In paricular, for any enry j for which v j / v 1 > 1, he jh coponen of Φ (v) is non-zero wih probabiliy 1 so ha he error (Φ (v)) j v j is no copensaed by an increase in sparsiy. To iprove he schee we can inroduce a rule for exacly preserving sufficienly large enries of v. To ha end, le σ be a peruaion of {1, 2,..., n} so ha he eleens of v σ have decreasing agniude (i.e., v σ is a rearrangeen of he enries of v so ha, for each j, v σj v σj+1 ) and le τv = in {0 l : n } v σ j=l+1 j ( l) v σl+1. (42) All of he copression schees we consider will preserve enries v σ1, v σ2,..., v στ v exacly. In fac, hey will have he basic srucure in Algorih 1. Daa: v C n wih all nonzero enries, N Resul: V = Φ (v) C n wih a os nonzero enries τv = 0; V = 0; r = v 1 /; σ 1 = arg ax i { v i }; while v r do στ v +1 τv = τv + 1; V στ v = v στ v ; v στ v = 0; r = v 1 /( τv ); σ τ v +1 = arg ax i { v i }; end For each j le N j be a non-negaive rando ineger wih E [N j v] = ( τv ) v j / v 1 ; Finally, for j {1, 2,..., n} \ {σ 1, σ 2,..., σ τ v }, se V j = N j v j v 1 v j ( τ v ) (Noe ha v here ay have fewer non-zero enries han i did upon inpu); Algorih 1: A siple copression rule. To jusify preservaion of he τv following lea. larges enries in our copression schees, we need he Lea 4. τ v saisfies n j=τ v +1 v σ j τ v v 1. Noe ha for any copression schee saisfying an error bound of he for (28) for a general vecor v C n, he error resuling fro applicaion of he copression schee afer exac preservaion of he larges τv enries is bounded by γ n τ v j=τv +1 v σ j which, by Lea 4 is iself bounded by τ γ v v 1 21

22 and is always an iproveen over (28). Lea 5 suarizes he properies of he copression schee resuling fro preserving he larges τv enries of an inpu vecor v C n exacly and applying (39) wih (41) wih replaced by τv o he reaining enries. In paricular, Lea 5 iplies ha he copression schee saisfies condiions (28), (29), and (35). Lea 5. Le v, w C n and assue ha v has a os non-zero enries. For Φ Algorih 1 wih (41) defined by Φ (v + w) v w 2 w v + w (43) Concerning he size of he resapled vecor we have he bound E [ Φ (v + w) 2 ] 1 v + w v + w 1 w 1. Finally, if τv+w > 0 hen P [Φ (v + w) = 0] = 0. If τv+w = 0 hen ( { w 1 P [Φ (v) = 0] in, 1 }). v + w 1 e In pracice his copression schee would need o be odified o avoid he possibiliy ha Φ (v) = 0. As Lea 5 deonsraes, he probabiliy of his even is exreely sall. The issue can be avoided by siply sapling Φ (v) unil Φ (v) 0, i.e., saple Φ (v) condiioned on he even {Φ (v) 0}, and uliplying each enry of he resuling vecor by P [Φ (v) 0] which can be copued exacly. A ore significan issue is ha, while Lea 5 does guaranee ha he copression schee jus described saisfies (35), he schee does no guaranee ha he nuber of non-zero enries in Φ (v) does no exceed as required by Lea 3 in he las secion. The resuls of ha secion can be odified accordingly or he copression schee can be odified so ha Φ (v) has no ore han non-zero enries (by randoly selecing addiional enries o se o zero). Insead of pursuing hese odificaions here we ove on o describe he copression schee used o generae he resuls repored in he nex secion. Like he copression schee considered in Lea 5, he copression schee used o generae he resuls in Secion 6 begins wih an applicaion of Algorih 1. To fully specify he schee we need o specify he rule used o generae he N j rando variables for j {σ k : k > τv }. For k = 1, 2,..., τv, define he rando variables U (k) 1 = τv (k 1 + U). (44) where U is a single uniforly chosen rando variable on he inerval (0,1). We hen se N σj = {k : U (k) n } v j=τv σ +1 j I j (45) where we have defined he inervals I τ v +1 = [ 0, v ) στ v and, for i = τ +1 v + 2,..., n, [ i 1 I i = j=τv +1 v σ j, i ) j=τv +1 v σ j. (46) As for he rule in (41), he variables N j generaed according o (45) saisfy E [N j v] = ( τ v ) v j n i=τv +1 v σ i so ha he copression apping Φ resuling fro use of (45) wih Algorih 1 saisfies (30). Fro he definiion of τv, we know ha for j > τv, ( τv ) v j n i=τv +1 v σ i which iplies by (45) ha N j {0, 1}. 22

23 Unlike (41), (45) resuls in N j ha are correlaed and saisfy n j=τv +1 N j = τv exacly (no jus in expecaion). The corresponding copression schee exacly preserves he l 1 -nor of v and resuls in a vecor Φ (v) wih a os non-zero enries. Noe ha his copression schee, like he one considered in Lea 5 only requires knowledge of se {σ 1, σ 2,..., σ τ v } and does no require soring of he enire inpu vecor v. Perhaps he os obvious advanage of his schee over he one ha generaes he N j according o (41) is ha he copression schee using (45) only requires a single rando variae per ieraion (copared o up o n for (41)). Depending on he cos of evaluaing M(V ), his advanage could be subsanial. Noice ha, if we replace he U (k) in (44) by independen rando variables uniforly chosen in (0, 1), hen he N j would be disribued ulinoially, which we have already enioned is a poor choice. Relaive o ulinoial N j, he increased correlaion beween he U (k) defined in (44) resuls in subsanially decreased variance for he N j bu also increased covariance. An unforunae consequence of his increased covariance is ha he analogue of he error bound (43) fro Lea 5 does no hold for N j generaed according o (45). In fac, he rule in (45) is very closely relaed o he syseaic resapling schee used frequenly in he conex of sequenial Mone Carlo (see e.g. [15]) which is well known o fail o converge for cerain sequences of inpu vecors. 8 Noneheless, in unrepored nuerical coparisons we found ha he rule (45) resuled in FRI schees wih significanly lower error han for (41). 6 Nuerical ess In his secion we describe he applicaion of he fraework above o paricular arices arising in (i) he copuaion of he per-spin pariion funcion of he 2D Ising odel, (ii) he specral gap of a diffusion process governing he evoluion of a syse of up o five, 2-diensional paricles (i.e., up o en spaial diensions), and (iii) a free energy landscape for ha process. The corresponding nuerical linear algebra probles are, respecively, (i) copuing he doinan eigenvalue/eigenvecor of arices up o size , (ii) copuing he second larges eigenvalue/eigenvecor of arices up o size , and (iii) solving a linear syse involving exponeniaion of arices up o size Aside fro sparsiy, hese arices have no known readily exploiable srucure for copuaions. All bu he firs es proble involve arices wih enries of any sign. As we learned in Secion 4, we can ofen expec uch beer error scaling wih diension when applying FRI o probles involving arices wih all non-negaive enries. The nuerical resuls in his secion sugges ha draaic speedups are possible even for ore general arices. The reader ay wonder why we consider rando copressions insead of siple hresholding, i.e., a copression rule in which, if σ j is he index of he jh larges (in agniude) of v, v σj is siply se o zero for all j > (he resuling vecor can be noralized o preserve l 1 -nor or no). In he res of his paper we will refer o ehods using such a copression rule as runcaion-by-size (TbS) schees. TbS schees have been considered by any auhors (see e.g. [29, 58, 49, 50]) and are a naural approach. Noe however ha he error (if he copression is no noralized), f σj v σj, j> for he hresholding copression can be as large as f v 1 (1 /n) which only vanishes if is increased faser han n. In conras, he rando copressions above can have vanishing error even when n is infinie. This observaion is key o undersanding he subsanial reducion in error we find for our fas randoized schee over TbS in nuerical resuls presened in his secion. In our firs es exaple he TbS schee converges o a value far fro a high qualiy esiae of he rue 8 If applied o he sae vecor v as increases, he schee does converge 23

24 value (a relaive error of 98% copared o 8% for FRI). In he subsequen exaples TbS ieraion appears o converge (in he ieraion index ) o subsanially differen values for each fixed choice of whereas FRI shows uch ore consisen behavior in. Moreover, in pracice we observe no cos savings per ieraion for TbS over FRI. Finally we coen ha, in order for he FRI approach o yield significan perforance iproveens, one us use an efficien ipleenaion of arix by sparse vecor uliplicaion. In he exaples below we lis he i, j pairs for which he produc K ij v j is nonzero, hen sor he producs according o he i-index and finally, add he producs wih coon i. This is a siple and sub-opial soluion. More deails can be found in he exaple code available in [63] A ransfer arix eigenproble In his exaple we find he doinan eigenvalue λ of he ransfer arix K of he 2-diensional l-spin Ising odel. This eigenvalue is he per-spin pariion funcion of he infinie spin Ising odel, i.e., λ (T, B) = li l ( σ e 1 T (i,j) (i,j ) =1 σ ijσ i j +Bσ ij ) 1/l where σ ij { 1, 1} and he su in he exponen is over pairs of indices on a square 2-diensional, periodic laice wih l sies. The ouer su is over all 2 l possible values of σ, and for larger l, one canno possibly copue i direcly. The arix K is 2 l 2 l. For exaple, in he case l = 3, a a 1 b b 1 a a 1 K = b b 1 b b 1 (47) c c 1 b b 1 c c 1 where a = e (2 B)/T, b = e B/T, c = e (2+B)/T. We herefore also canno hope o apply he power ehod (or is relaives) direcly o K when l is large. In our experiens we se T = 2.2, B = 0.01, and l = 50 so ha n = 2 l > 10 15, We apply boh he FRI and TbS, O(1) schees o copuing λ as well as o copuing he su of all coponens of he corresponding eigenvecor, v (noralized o have su equal o 1), wih index greaer han or equal o 2 49, i.e., f = j n/2 (v ) j. Knowledge of he pariion funcion λ as a funcion of eperaure T and field srengh B allows one o deerine useful quaniies such as he average agneizaion (su of spin values) and o diagnose phase ransiions [29]. Our choice o esiae λ and f is oivaed in par by he fac ha hese quaniies can be approxiaed accuraely by he corresponding values for saller Ising syses. We will copare our resuls o hose for he 24-spin Ising odel which we can solve by sandard power ieraion. For an effecive specialized ehod for his proble see [51]. A siple, educaional ipleenaion of Fas Randoized Ieraion applied o his proble can be found here [63]. In Figure 1 we repor he rajecory averages of he approxiaions Λ and F generaed by he FRI schee (ieraion (17) using Algorih 1) wih = 2 20, 2 21, 2 22, 2 23, and 2 24 and 10 5 oal ieraions. The bes (highes ) approxiaion of λ is and he bes approxiaion of f is The resuls for he 24-spin Ising proble are λ and f a difference of roughly 0.5% and 8% fro he respecive approxiaions generaed by he FRI ehod. In 24

25 λ f =2 20 =2 22 =2 24 =2 21 = ieraion 1e5 1e5 Figure 1: Top. Trajecory averages of he approxiaion, Λ, of he pariion funcion for he 50-spin Ising odel wih B = 0.01 and T = 2.2, wih 95% confidence inervals 8 as copued by he FRI ehod wih = 2 k for k = 20, 21, 22, 23, and 24. The bes (highes ) esiae for λ is a difference of roughly 0.5% fro he value for he 24-spin Ising odel. Boo. Corresponding rajecory averages of he approxiaion, F, of he oal weigh of all coponens of v wih index greaer han or equal o 2 49 wih 95% confidence inervals for he FRI ehod. The bes (highes ) esiae for f is 0.606, a difference of roughly 8% fro he value for he 24-spin odel. Figure 2 we plo he corresponding rajecories of Λ and F. These plos srongly sugges ha he ieraion equilibraes rapidly (relaive o he oal nuber of ieraions). Indeed, we esiae he inegraed auocorrelaion ies 9 of Λ and F o be 20.5 and 274 respecively. This in urn suggess ha one could achieve a draaic speedup by running any parallel and independen copies (replicas) of he siulaion and averaging he resuling esiaes of λ and f hough we have no aken advanage of his here. Figure 3 repors he analogous rajecories (see (48) below) of Λ and F as generaed by ieraion (17) wih he TbS schee (ieraion (17) using runcaion-by-size) and he sae values of. The bes (highes ) TbS approxiaion of λ is and he bes TbS approxiaion of f is 0.014, a difference of alos 2% and 98% respecively. In Figure 4 we plo he sus of he values of he approxiaion, V, of he doinan eigenvecor of he Ising ransfer arix a = 10 5 over 256 inervals of equal size ou of he 2 50 oal indices. The op plo represens V as generaed by he FRI ehod and he iddle plo represens V as generaed by he TbS approach. The TbS ieraion has converged o a vecor wih nearly all of weigh concenraed on very low indices. The 9 According o he cenral lii heore for Markov processes (assuing i holds), for large he variance of he rajecory average of Λ should be σ 2 τ/ where σ 2 is he infinie lii of he variance of Λ and τ is he inegraed auocorrelaion ie of Λ. Roughly, i easures he nuber of ieraions beween independen Λ. 8 We use he er confidence inervals loosely. We plo confidence inervals for he values li E [Λ ] and li E [F ] (i.e., for finie ) and no for λ and f. In oher words, our confidence inervals do no accoun for bias resuling fro a finie choice of. 25

26 λ f e ieraion 1e5 Figure 2: Top. Trajecory of he approxiaion, Λ, of he pariion funcion for he 50-spin Ising odel, for he FRI ehod wih = The approxiae inegraed auocorrelaion ie for Λ is 20.5 ieraions. Boo. Corresponding rajecory of F as copued by he FRI ehod. The approxiae inegraed auocorrelaion ie for F is 274 ieraions. boo plo in Figure 4 represens he doinan eigenvecor for he 24-spin Ising ransfer arix. The qualiaive agreeen wih he realizaion of V as generaed by he FRI ehod is uch sronger han agreeen wih he resul of he TbS ehod. Reark 7. In his proble we copue he doinan eigenvalue λ and a projecion f of he doinan eigenvecor v of he arix K defined in equaion (47) using he FRI in conjuncion wih he power ehod. Using he rajecory averages Λ = 1 Λ and F = 1 F (48) s=1 o esiae λ and f would see srange had he ieraes Λ and F been generaed by he deerinisic power ehod (we have no repored rajecory averages for he deerinisic TbS approach). However, for finie we do no expec Λ or F o converge o λ and f as increases. Raher we expec ha he disribuion of Λ and F will converge o soe disribuion roughly cenered around λ and f respecively. Though in our convergence resuls we have no addressed he ergodiciy of he Markov process V, one would expec ha reasonable funcions of V such as Λ and F saisfy a law of large nubers so ha, for very large, he rajecory averages Λ and F differ fro λ and f only by a syseaic error (i.e., hey converge o he lii of he expecaions of Λ and F respecively) A PDE eigenproble For given funcions b(x) and σ(x) wih values R n and R n R r, he backwards Kologorov operaor s=1 Lf = b Df race ( σσ D 2 f ) (49) is he generaor of he diffusion process dx() = b(x()) d + σ(x()) dw () (50) 26

27 λ f =2 20 =2 21 =2 22 =2 23 = e ieraion 1e4 Figure 3: Top. Trajecory of he approxiaion, Λ, of he pariion funcion for he 50-spin Ising odel, for he TbS ehod wih = The bes (highes ) approxiaion is λ 2.545, a difference of abou 2% fro he value for he 24-spin Ising odel. Boo. Corresponding rajecory of F as copued by he TbS ehod. The bes (highes ) approxiaion is f 0.014, a difference of alos 98% fro he value for he 24-spin odel. where W () is an r-diensional Brownian oion, Df is he vecor of firs order derivaives of f, and D 2 f is he arix of is second order derivaives. The operaor L governs he evoluion of oens of X() in he sense ha d d E [ ] x f(x()) =0 = Lf(x) (he subscrip on he expecaion indicaes ha X 0 = x). Noe ha consan funcions are in he kernel of L. The non-rivial eigenfuncions of L all correspond o negaive eigenvalues. The agniude of he greaes of hese negaive eigenvalues [ ] is he specral gap and characerizes he rae of convergence of expecaions such as E x f(x()) o heir equilibriu (large ) values. In his subsecion we consider esiaion of he larges negaive eigenvalue of L for b = DV wih V (x (1),..., x (l) ) = 1 l l l cos(2πx (i) 1 2 ) cos(2πx(j) 2 ) + 2 cos(π(x (j) 1 x (k) 1 )) cos(π(x(j) 2 x (k) 2 )) j=1 j=1 k=j+1 for x (j) = (x (j) 1, x(j) 2 ) [ 1, 1) [ 1, 1). The diffusion coefficien, σ(x), is fixed as 2. The funcion V is he poenial energy for a periodic syse of l, 2D-paricles, each subjec o boh an exernal force as well as a nonlinear spring coupling he paricles ogeher. (50) is a odel of he dynaics of ha syse of paricles (in a high fricion lii). The equaion Lg = λ g is firs projeced ono a Fourier specral basis, i.e., we assue ha g ( x) = v( α) e iπ αh x α Z 2l N where α = (α (1),..., α (l) ) wih α (j) = (α (j) 1, α(j) 1 ), and he sybol Z2l N is used o indicae ha boh α (j) 1 and α (j) 1 are inegers wih agniude less han N. 27

28 weigh index (noralized) Figure 4: Top. Sus of he values of he approxiaion, V, of he doinan eigenvecor of he 50-spin Ising ransfer arix wih B = 0.01 and T = 2.2, a = 10 5 over 256 inervals of equal size ou of he 2 50 oal indices for he FRI ehod wih = Middle. Corresponding sus for he TbS ehod. Boo. Exac eigenvecor for he 20-spin Ising odel for qualiaive coparison. Suppose ha ˆL is he corresponding specral projecion of L (which, in his case, is real). The arix ˆL can be decoposed ino a su of diagonal (corresponding o he second order er in L) and non-diagonal er (corresponding o firs order er in L), i.e., ˆL = A + D. In his proble he eigenvalues are real and we are rying o find he larges non-zero eigenvalue insead of he eigenvalue wih larges agniude. We us firs ransfor ˆL so ha he larges eigenvalues of ˆL corresponds o he agniude doinan eigenvalues of he ransfored arix. As we enioned in Secion 3.2 his can be accoplished using he arix obained fro a discreein-ie approxiaion of he ODE d d y = ˆLy i.e., by exponeniaing he arix ˆL for very large. For exaple, for sufficienly sall ε > 0, he eigenvalue, µ, of larges agniude, of he arix K = e 1 2 εd (I + εˆl)e 1 2 εd (51) is, o wihin an error of order ε 2, 1 + ελ where λ is he eigenvalue of ˆL of larges real par (in our case he eigenvalues are real and non-posiive). We will apply our ieraion schees o K. By fixing v ( 0) = 0 we can guaranee ha he approxiae soluions all have vanishing inegral over [ 1, 1) 2l, ensuring ha he ieraion converges o an approxiaion of he desired eigenvecor/value pair (insead of o v( 0) = 1, v( α) = 0 if α 0). Reark 8. In his proble, raher han esiaing he doinan eigenvecor of K, our goal is esiae he second larges (in agniude) eigenvalue of K. Given ha we know he larges eigenvalue of K is 1 wih an eigenvecor ha has value one in he coponen corresponding o α = 0 and 28

29 zeros in all oher coponens, we can herefore exacly orhogonalize he ieraes V wih respec o he doinan eigenvalue a each ieraion (by fixing V ( 0) = 0). We ay view his as using FRI in conjuncion wih a siple case of orhogonal ieraion. We copare he FRI and TbS approaches wih N = 51 for he four- and five-paricle syses (l = 4, 5). The corresponding oal coun of real nubers needed o represen he soluion in he five-paricle case is so only he O(1) schee is reasonable. For h we choose a value of Our poenial V is chosen so ha he resuling arix ˆL (and herefore also K) is sparse and is enries are copued by hand. For a ore coplicaed V, he enries of ˆL igh have o be copued nuerically on-he-fly or igh no be copuable a all. Our abiliy o efficienly copue he enries of ˆL will be srongly effeced by he choice of basis. For exaple, if we use a finie difference approxiaion of L hen he enries of ˆL can be copued easily. On he oher hand, if he soluion is reasonably sooh, he finie difference approxiaion will converge uch ore slowly han an approxiaion (like he specral approxiaion) ha ore direcly incorporaes properies of he soluion (regulariy in his case). Figure 5 plos he rajecory averages over 10 5 ieraions for Λ in he l = 4 case generaed by he FRI ehod (ieraion (17) using Algorih 1) along wih corresponding rajecories of Λ as generaed by he TbS approach (ieraion (17) using runcaion-by-size). We presen resuls for boh ehods wih = 1, 2, 3, and Observe ha he resuls fro he FRI ehod appear o have converged on one anoher while he resuls generaed by he TbS approach show no signs of convergence. The bes (highes ) esiae of he eigenvalue generaed by FRI is 2.31 and he bes esiae generaed by TbS is Figure 6 plos he rajecory of Λ in he five paricle (l = 5) case as generaed by he FRI ehod wih = 10 6 along wih is rajecory average (neglecing he firs 500 ieraions) of abou 1.3. Noe ha Λ appears o reach is saisical equilibriu rapidly relaive o he oal ieraions. Again, he rapid equilibraion suggess ha saisical error could be reoved by averaging over any shorer rajecories evolved in parallel A PDE seady sae proble The adjoin L of he operaor defined in (49) wih respec o he sandard inner produc is called he Fokker Planck operaor. The operaor deerines he evoluion of he densiy of he process X() defined in (50) in he sense ha if µ is ha densiy hen µ = L µ. An eleen in he kernel of L (a seady sae soluion of he Fokker Planck equaion) is a densiy lef invarian by X(). For he choice of b and σ given in he previous subsecion, he seady sae soluions are easily seen o be consan uliples of he funcion e V ( x) µ ( x) = e V ( x). In os applicaions, he goal is o copue averages of observables wih respec o µ. For exaple, one igh hope o find (up o an addiive consan) he effecive poenial (or free-energy) experienced by paricle 1, F 1 (x (1) ) = log µ ( x) dx (2) dx (l). For ha purpose, explici knowledge of µ is of lile value since one canno hope o copue inegrals wih respec o a funcion of so any variables (up o in our ess). One insead hopes o find a ore digesible expression for µ. Noice ha if a Fourier expansion µ ( x) = v( j) e iπ αh x α Z 2l N 29

30 TbS ( =10000) TbS ( =20000) TbS ( =30000) TbS ( =40000) FRI ( =10000) FRI ( =20000) FRI ( =30000) FRI ( =40000) λ ieraion 1e5 Figure 5: Trajecory averages of he approxiaion, Λ, of he larges negaive eigenvalue of a backwards Kologorov operaor for a four 2D-paricle (8-diensional) syse, wih 95% confidence inervals for he FRI ehod wih = 1, 2, 3, and The operaor is discreized using a Fourier basis wih 101 odes per diension for a oal of ore han basis eleens (half ha afer aking advanage of he fac ha he desired eigenvecor is real). The sep-size paraeer h is se o Also on his graph, rajecories of Λ for he TbS ehod for he sae values of. was available hen we could copue F 1 (x (1) ) = log v(α (1), 0,..., 0) e iπα(1)t x (1). α (1) Z 2 N As in he previous secion 9 we discreize he Fokker Planck operaor in a Fourier basis resuling in a finie diensional linear roo finding proble (K I) v = 0 where K is now defined jus as in (51) bu wih A = ˆL H + D. We choose o noralize he soluion so ha v( 0) = 1 which hen resuls in a linear syse ( ) K I v = r where r( α) = K α 0, K has he row and colun corresponding o he index 0 reoved, and v has he coponen corresponding o index 0 reoved. Reark 9. Noe ha he linear syse ( K I) v = r is solved for v here using FRI in conjuncion wih Jacobi ieraion. Wih he noralizaion v ( 0) = 1, his is equivalen o using he power ieraion o find he eigenvecor corresponding o he larges eigenvalue of K (which is 1). Recalling ha here K I + ε(ˆl H + D), observe ha we are (when ε is sall) approxiaely copuing li exp(a)v 0 wih A = ˆL H + D, which, since he larges eigenvalue of A is 0, is he desired eigenvecor. We repea ha hough we know ha he doinan eigenvalue of K and we have a forula for µ, he doinan eigenvecor of L, our goal is o copue projecions of µ ha canno be copued by deerinisic eans. 9 Noe ha he arix obained by L 2 -projecion of he adjoin of a differenial operaor wih real coefficiens is he conjugae ranspose of he arix obained by L 2 -projecion of he differenial operaor. 30

31 λ ieraion 1e3 Figure 6: Trajecory of he approxiaion, Λ (solid blue line), of he larges negaive eigenvalue of a backwards Kologorov operaor for he five-paricle syse as copued by he FRI ehod wih = 10 6 over ieraions. The oal diension of he discreized syse is ore han The average value of Λ (ignoring he firs 500 ieraions) is 1.3 and is shown by a solid black line. In Figure 7 we presen approxiaions of he funcion F 1 generaed by he O(1) schee V+1 = Φ (KV ), F +1(α (1) ) = (KV ) (α (1), 0,..., 0), F +1(α (1) ) = (1 ε )F (α (1) ) + ε F +1(α (1) ), for all α (1) Z 2 N wih ε = ( + 1) 1 and where he independen appings Φ are generaed according o Algorih 1. The single paricle free-energy 10 as generaed by he FRI approach is ploed for l = 2, 3, 4, and 5 wih = 10, 200, 10 4, and 10 6 respecively. In he wo, hree, and four paricle siulaions we use 10 5 ieraions. Again we choose N = 51 and h = The high cos per ieraion in he five paricle case resrics our siulaions o ieraions. In he four paricle case, for which we have validaed he FRI soluion by siulaions wih higher values of ( = ), he free energy profile produced by he TbS approach differs fro he FRI resul by as uch as 100%. We ake sligh advanage of he paricle exchange syery and, a each ieraion, replace (KV ) (α (1), 0,..., 0) in he above equaion for F+1 by he average of all l coponens of he for (KV ) (0,..., α (k), 0,..., 0). Noe ha in he expansion of µ, we know ha v( α) is unchanged when we swap he indices α (j) and α (k) corresponding o any wo paricles. This fac could be leveraged o grealy reduce he nuber of basis funcions required o accuraely represen he soluion. We have no exploied his possibiliy. Though i is no accurae, he TbS schee is subsanially ore sable on his proble. We assue ha he relaive sabiliy of he TbS schee is a anifesaion of he fac ha TbS is no 10 Noe ha we only approxiae F 1 up o he addiive consan log e V ( x). In fac, he free energy is ypically only defined up o ha consan because i is no uniquely specified (one can add a consan o V wihou changing µ ). 31

32 acually represening he high wave nuber odes ha are responsible for sabiliy consrains. Noneheless, siulaing higher diensional syses would require odificaions in our approach. In paricular i igh be necessary o idenify a sall nuber of coponens of he soluion ha should always be resolved (never se o zero). For exaple, for his proble one igh choose o resolve soe nuber of basis funcions for each paricle ha are independen of he posiions of he oher paricles. Figure 7: Free energy landscape experienced by a single paricle for he (clockwise fro op lef) wo, hree, four, and five 2D-paricle syses. The surfaces were generaed using he FRI ehod wih = 10, 200, 10 4, and 10 6 respecively and h = The wo-, hree-, and four-paricle siulaions were run for 10 5 ieraions. The five paricle siulaion was subsanially ore expensive per ieraion and was run for only ieraions. The nuber of Fourier odes used o represen he soluion in all siulaions is 101 per diension for a oal of ore han 10 8, 10 12, 10 16, and basis funcions (half ha afer aking advanage of he fac ha he soluion is real). As expeced, he free energy basins deepen as he nuber of paricles grows. In he four paricle case (for which we have high confidence in he esiae produced by FRI) he error fro he TbS approach (he resuls of which we do no plo) is roughly 100% a peaks of he free energy landscape. 7 Discussion We have inroduced a faily of fas, randoized ieraion schees for eigenprobles, linear syses, and arix exponeniaion. Tradiional ieraive ehods for nuerical linear algebra were creaed in par o deal wih insances where he coefficien arix A (of size O(n 2 )) is oo big o sore bu where he operaion x Ax can noneheless be carried ou. The ieraive ehods in his paper are inended for insances in which he uliae goal is o copue f x for soe predeerined vecor f bu he cos of assebling he produc Ax (O(n 2 )) is oo high and even for cases in which he soluion vecor x (of size O(n)) is oo big o sore. We provide basic heoreical resuls jusifying he approach and illusraing in paricular ha he cos of he schees can be independen of diension for soe probles. Generally we expec sublinear scaling wih diension of boh cos 32