arxiv:cond-mat/ v1 [cond-mat.stat-mech] 16 Aug 2004

Transcription

1 Computational omplexity and fundamental limitations to fermioni quantum Monte Carlo simulations arxiv:ond-mat/ v1 [ond-mat.stat-meh] 16 Aug 2004 Matthias Troyer, 1 Uwe-Jens Wiese 2 1 Theoretishe Physik, ETH ürih, CH-8093 ürih, Switzerland and 2 Institut für theoretishe Physik, Universität Bern, Sidlerstrasse 5, CH-3012 Bern, Switzerland Quantum Monte Carlo simulations, while being effiient for bosons, suffer from the negative sign problem when applied to fermions ausing an exponential inrease of the omputing time with the number of partiles. A polynomial time solution to the sign problem is highly desired sine it would provide an unbiased and numerially exat method to simulate orrelated quantum systems. Here we show, that suh a solution is almost ertainly unattainable by proving that the sign problem is NP-hard, implying that a generi solution of the sign problem would also solve all problems in the omplexity lass NP (nondeterministi polynomial) in polynomial time. Half a entury after the seminal paper of Metropolis et al. [1] the Monte Carlo method has widely been established as one of the most important numerial methods and as a key to the simulation of many-body problems. Its main advantage is that it allows phase spae integrals for many-partile problems, suh as thermal averages, to be evaluated in a time that sales only polynomially with the partile number N although the onfiguration spae grows exponentially with N. This enables the aurate simulation of large systems with millions of partiles. Monte Carlo simulations of quantum systems, suh as fermions, bosons, or quantum spins, an be performed after mapping the quantum system to an equivalent lassial system. For fermioni or frustrated models this mapping may yield onfigurations with negative Boltzmann weights, resulting in an exponential growth of the statistial error and hene the simulation time with the number of partiles, defeating the advantage of the Monte Carlo method. A polynomial time solution of this sign problem of negative weights would revolutionize eletroni struture alulations by providing an unbiased and approximation-free method to study orrelated fermioni systems. This would be of invaluable help, for example, in finding the mehanism for high-temperature superondutivity or in determining the properties of dense nulear matter and quark matter. The diffiulties in finding polynomial time solutions to the sign problem are reminisent of the apparent impossibility to find polynomial time algorithms for nondeterministi polynomial (NP)-omplete deision problems, whih ould be solved in polynomial time on a hypothetial non-deterministi mahine, but for whih no polynomial time algorithm is known for deterministi lassial omputers. A hypothetial non-deterministi mahine an always follow both branhes of an if-statement simultaneously, but an never merge the branhes again. It an, equivalently, be viewed as having exponentially many proessors, but without any ommuniation between them. In addition, it must be possible to hek a positive answer to a problem in NP on a lassial omputer in polynomial time. Many important omputational problems in the omplexity lass NP, inluding the traveling salesman problem and the problem of finding ground states of spin glasses have the additional property of being NP-hard, forming the subset of NP-omplete problems, the hardest problems in NP. A problem is alled NP-hard if any problem in NP an be mapped onto it with polynomial omplexity. Solving an NP-hard problem is thus equivalent to solving any problem in NP, and finding a polynomial time solution to any of them would have important onsequenes for all of omputing as well as the seurity of lassial enryption shemes. In that ase all problems in NP ould be solved in polynomial time, and hene NPP. As no polynomial solution to any of the NP-omplete problems was found despite deades of intensive researh, it is generally believed that NP P and no deterministi polynomial time algorithm exists for these problems. The proof of this onjeture remains as one of the unsolved millennium problems of mathematis for whih the Clay Mathematis Institute has offered a prize of one million US$ [3]. In this Letter we will show that the sign problem is NP-hard, implying that unless the NP P onjeture is disproven there exists no generi solution of the sign problem. Before presenting the details of our proof, we will give a short introdution to lassial and quantum Monte Carlo simulations and the origin of the sign problem. In the alulation of the phase spae average of a quantity A, instead of diretly evaluating the sum A 1, ΩA()p() p(), (1) Ω over a high-dimensional spae Ω of onfigurations, a lassial Monte Carlo method hooses a set of M onfigurations { i } from Ω, aording to the distribution p( i ). The average is then approximated by the sample mean A A 1 M M A( i ), (2) i1

2 2 within a statistial error A VarA(2τ A + 1)/M, where VarA is the variane of A and the integrated autoorrelation time τ A is a measure of the autoorrelations of the sequene {A( i )}. In typial statistial physis appliations, p() exp( βe()) is the Boltzmann weight, β 1/k B T is the inverse temperature, and E() is the energy of the onfiguration. Sine the dimension of onfiguration spae Ω grows linearly with the number N of partiles, the omputational effort for the diret integration Eq. (1) sales exponentially with the partile number N. Using the Monte Carlo approah the same average an be estimated to any desired auray in polynomial time, as long as the autoorrelation time τ A does not inrease faster than polynomially with N. In a quantum system with Hamilton operator H, instead of an integral like Eq. (1), an operator expression A 1 Tr[Aexp( βh)], Trexp( βh) (3) needs to be evaluated in order to alulate the thermal average of the observable A (represented by a self-adjoint operator). Monte Carlo tehniques an again be applied to redue the exponential saling of the problem, but only after mapping the quantum model to a lassial one. One approah to this mapping[4] is a Taylor expansion [5]: Trexp( βh) n0 ( β) n TrH n (4) n! n0 ( β)n i 1 H i 2 i 2 H i 3 i n H i 1 n! i 1,...,i n p(i 1,..., i n ) p(), i 1,...,i n n0 where for eah order n in the expansion we insert n sums over omplete sets of basis states { i }. The onfigurations are sequenes (i 1,..., i n ) of n basis states and we define the weight p() by the orresponding produt of matrix elements of H and the term ( β) n /n!. With a similar expansion for Tr[A exp( βh)] we obtain an expression reminisent of lassial problems: A 1 Tr[Aexp( βh)] 1 A()p(). (5) If all the weights p() are positive, standard Monte Carlo methods an be applied, as it is the ase for nonfrustrated quantum magnets and bosoni systems. In fermioni systems [6] negative weights p() < 0 arise from the Pauli exlusion priniple, when along the sequene i 1 i 2 i n i 1 two fermions are exhanged, as shown in Fig. 1. The standard way of dealing with the negative weights of the fermioni system is to sample with respet to i 4 > i 3 > i 2 > FIG. 1: A onfiguration of a fermioni lattie model on a 4- site square. The onfiguration has negative weight, sine two fermions are exhanged in the sequene i 1 i 2 i 3 i 4 i 1. World lines onneting partiles on neighboring slies are drawn as thik lines. the bosoni system by using the absolute values of the weights p() and to assign the sign s() signp() to the quantity being sampled: A A()p() p() (6) A()s() p() / p() s() p() / p() As s. While this allows Monte Carlo simulations to be performed, the errors inrease exponentially with the partile number N and the inverse temperature β. To see this, onsider the mean value of the sign s /, whih is just the ratio of the partition funtions of the fermioni system p() with weights p() and the bosoni system used for sampling with p(). As the partition funtions are exponentials of the orresponding free energies, this ratio is an exponential of the differenes f in the free energy densities: s / exp( βn f). As a onsequene, the relative error s/ s inreases exponentially with inreasing partile number and inverse temperature: s s ( s2 s 2 )/M s 1 s 2 M s eβn f M. (7) Similarly the error for the numerator in Eq. (7) inreases exponentially and the time needed to ahieve a given relative error sales exponentially in N and β. In order to avoid any misoneption about what would onstitute a solution of the sign problem, we start by giving a preise definition: A quantum Monte Carlo simulation to alulate a thermal average A of an observable A in a quan-

3 3 tum system with Hamilton operator H is defined to suffer from a sign problem if there our negative weights p() < 0 in the lassial representation as given by Eq. (5). The related bosoni system of a fermioni quantum system is defined as the system where the weights p() are replaed by their absolute values p(), thus ignoring the minus sign oming from fermion exhanges: A 1 A() p(). (8) An algorithm for the stohasti evaluation of a thermal average suh as Eqns. (5) or (8) is defined to be of polynomial omplexity if the omputational time t(ǫ, N, β) needed to ahieve a relative statistial error ǫ A/ A in the evaluation of the average A sales polynomially with the system size N and inverse temperature β, i.e. if there exist integers n and m and a onstant κ < suh that t(ǫ, N, β) < κǫ 2 N n β m. (9) For a quantum system that suffers from a sign problem for an observable A, and for whih there exists a polynomial omplexity algorithm for the related bosoni system Eq. (8), we define a solution of the sign problem as an algorithm of polynomial omplexity to evaluate the thermal average A. It is important to note that we only worry about the sign problem if the bosoni problem is easy (of polynomial omplexity) but the fermioni problem hard (of exponential omplexity) due to the sign problem. If the bosoni problem is already hard, e.g. for spin glasses [7], the sign problem will not inrease the omplexity of the problem. Also, hanging the representation so that the sum in Eq. (5) ontains only positive terms p() 0 is not suffiient to solve the sign problem if the saling remains exponential, sine then we just map the sign problem to another exponentially hard problem. Only a polynomial omplexity algorithm ounts as a solution of the sign problem. At first sight suh a solution seems feasible sine the sign problem is not an intrinsi property of the quantum model studied but is representation-dependent: it depends on the hoie of basis sets { i }, and in some models it an be solved by a simple loal basis hange [8]. Indeed, when using the eigenbasis in whih the Hamilton operator H is diagonal, there will be no sign problem. This diagonalization of the Hamilton operator is, however, no solution of the sign problem sine its omplexity is exponential in the number of partiles N. We now onstrut a quantum mehanial system for whih the alulation of a thermal average provides the solution for one and thus all of the NP-omplete problems. This system exhibits a sign problem, but the related bosoni problem is easy to solve. Sine, for this model, a solution of the sign problem would provide us with a polynomial time algorithm for an NP-omplete problem, the sign problem is NP-hard. Of ourse, it is expeted that the orresponding thermal averages annot be alulated in polynomial time and the sign problem thus annot be solved. Otherwise we would have found a polynomial time algorithm for the NP-omplete problems and would have shown that NPP. The speifi NP-omplete problem we onsider [7] is to determine whether a state with energy less than or equal to a bound E 0 exists for a lassial three-dimensional Ising spin glass with Hamilton funtion H j,k J jk σ j σ k. (10) Here the spins σ j take the values ±1, and the ouplings J jk between nearest neighbor lattie points j and k are either 0 or ±J. This problem is in the omplexity lass NP sine the non-deterministi mahine an evaluate the energies of all onfigurations in polynomial time and test whether there is one with E() E 0. In addition, the validity of a positive answer (i.e. there is a onfiguration ) an be tested on a deterministi mahine by evaluating the energy of that onfiguration. The evaluation of the partition funtion exp( βe()) is, however, not in NP sine the non-deterministi mahine annot perform the sum in polynomial time. This question whether there is a state with energy E() E 0 an also be answered in a Monte Carlo simulation by alulating the average energy of the spin glass at a large enough inverse temperature β. Sine the energy levels are disrete with spaing J it an easily be shown that by hoosing an inverse temperature βj N ln 2+ln(12N) the thermal average of the energy will be less than E 0 + J/2 if at least one onfiguration with energy E 0 or less exists, and larger than E 0 + J otherwise [9]. In this lassial Monte Carlo simulation, the omplex energy landsape, reated by the frustration in the spin glass (Fig. 2a), exponentially suppresses the tunneling of the Monte Carlo simulation between loal minima at low temperatures. The autoorrelation times and hene the time omplexity of this Monte Carlo approah are exponentially large τ exp(an), as expeted for this NP-omplete problem. We now map this lassial system to a quantum system with a sign problem. We do so by replaing the lassial Ising spins by quantum spins. Instead of the ommon hoie in whih the lassial spin onfigurations are basis states and the spins are represented by diagonal σj z Pauli matries we hoose a representation in whih the spins

4 4 a) b)? i 3 > i 2 > FIG. 2: a) A lassially frustrated spin onfiguration of three antiferromagnetially oupled spins: no onfiguration an simultaneously minimize the energy of all three bonds. b) A onfiguration of a frustrated quantum magnet with negative weights: three antiferromagneti exhange terms with negative weights are present in the sequene i 1 i 2 i 3 i 1. Here up-spins with z-omponent of spin σ z j 1 and down-spins with σ z j 1 are onneted with differently olored world lines. point in the ±x diretion and are represented by σ x j Pauli matries: H j,k J jk σ x j σ x k, (11) Here the random signs of the ouplings are mapped to random signs of the off-diagonal matrix elements whih ause a sign problem (see Fig. 2b). The related bosoni model is the ferromagnet with all ouplings J jk 0 and effiient luster algorithms with polynomial time omplexity are known for this model [10]. Sine the bosoni version is easy to simulate, the sign problem is the origin of the NP-hardness of a quantum Monte Carlo simulation of this model. A generi solution of the sign problem would provide a polynomial time solution to this, and thus to all, NP-omplete problems, and would hene imply that NPP. Sine it is generally believed that NP P, we expet that suh a solution does not exist. Conlusions By onstruting a onrete model we have shown that the sign problem of quantum Monte Carlo simulations is NP-hard. This does not exlude that a speifi sign problem an be solved for a restrited sublass of quantum systems. This was indeed possible using the meron-luster algorithm [11] for some partiular lattie models. Suh a solution must be intimately tied to properties of the physial system and allow an essentially bosoni desription of the quantum problem. A generi approah like the anellation idea [12] might sale polynomially for some ases but will in general sale exponentially. In the ase of fermions or frustrated quantum magnets, solving the sign problem requires a mapping to a bosoni or non-frustrated system whih is, in general, almost ertainly impossible for physial reasons. The origin of the sign problem is, in fat, the distintion between bosoni and fermioni systems. The brute-fore approah of taking the absolute values of the probabilities means trying to sample a frustrated or fermioni system by simulating a non-frustrated or bosoni one. As for large system sizes N and low temperatures the relevant onfigurations for the latter are not the relevant ones for the former, the errors are exponentially large. Given the NP-hardness of the sign problem one promising idea for the simulation of fermioni systems is to use ultra-old atoms in optial latties to onstrut well-ontrolled and tunable implementations of physial systems, suh as the Hubbard model [13], and to use these quantum simulators to study the phase diagrams of orrelated quantum systems. But even these quantum simulators are most likely not a generi solution to the sign problem sine there exist quantum systems with exponentially diverging time sales and it is at present not lear whether a quantum omputer ould solve the NPomplete problems [14]. We like to thank S. Chakravarty, E. Farhi, J. Goldstone, S. Gutmann and G. Ortiz for stimulating disussions and aknowledge finanial support of the Swiss National Siene Foundation. Part of this work was supported by the Kavli Institute for Theoretial Physis and the Aspen Center for Physis. [1] N. Metropolis et al., J. of Chem. Phys. 21, 1087 (1953). [2] S. Cook, in Conferene Reord of Third Annual ACM Symposium on Theory of Computing, 151 (1971). [3] [4] Note that the onlusions drawn in this Letter are independent of the representation. [5] A.W. Sandvik and J. Kurkijärvi, Phys. Rev. B 43, 5950 (1991). [6] The origin of a negative sign in frustrated quantum magnets also arises from the fermioni minus-sign of the superexhange proess. [7] F. Barahona, J. Phys. A 15, 3241 (1982). [8] N. Hatano and M. Suzuki, Phys. Lett. A 163, 246 (1992); T. Nakamura, Phys. Rev. B 57, R3197 (1998). [9] Although Monte Carlo simulations give results for the energy only within statistial errors, these errors an be made arbitrarily small and the question an be deided with arbitrarily high onfidene. Stritly speaking a polynomial time Monte Carlo solution is thus not in the lass P but in the omplexity lass BPP (bounded probability polynomial). [10] H.G. Evertz, Adv. in Physis 52, 1 (2003). [11] S. Chandrasekharan and U.-J. Wiese, Phys. Rev. Lett. 83, 3116 (1999). [12] D. M. Arnow, et al., J. Chem. Phys. 77, 5562 (1982); M. H. Kalos and F. Pederiva, Phys. Rev. Lett. 85, 3547 (2000). [13] M. Greiner et al., Nature 415, 39 (2002); W. Hofstetter et al., Phys. Rev. Lett. 89, (2002).

5 [14] E. Farhi et al., Siene 292, 472 (2001). 5