arxiv:math/ v1 [math.pr] 9 Mar 2006

Transcription

1 The Annals of Applied Probability 2006, Vol. 16, No. 1, 1 14 DOI: / c Institute of Mathematical Statistics, 2006 arxiv:math/ v1 [math.pr] 9 Mar 2006 ON A NONHIERARCHICAL VERSION OF THE GENERALIZED RANDOM ENERGY MODEL 1 By Erwin Bolthausen and Nicola Kistler Universität Zürich We introduce a natural nonhierarchical version of Derrida s generalized random energy model. We prove that, in the thermodynamical limit, the free energy is the same as that of a suitably constructed GREM. 1. Introduction and inition of the model. The generalized random energy model (GREM for short), introduced by Derrida [1], plays an important role in spin glass theory. Originally invented as a simple model which exhibits replica symmetry breaking at various levels, it has become clear that more interesting models, like the celebrated one of Sherrington Kirkpatrick, exhibit GREM-like behavior in the large N limit. Despite the spectacular recent progress in understanding the SK-model (see [4, 5, 7]), many issues have not been clarified at all, the most prominent one being the so-called ultrametricity. [A metric d is called an ultrametric if the strengthened triangle condition holds: d(x, z) max(d(x, y), d(y, z)). Equivalently, two balls are either disjoint or one is contained in the other.] The GREM is of limited use to investigate this because it is hierarchically organized from the start. This favorable situation allows for a complete solution, fully confirming the so-called Parisi theory (we refer the reader to the detailed study [2] where it is also pointed out that, interestingly, the emerging ultrametricity of the Gibbs measure does not necessarily coincide with the starting hierarchical organization). Yet, from the considerations on the GREM, one gets little clue on why many systems should be ultrametric in the limit. [In Talagrand s recent proof of the Parisi formula, ultrametricity plays no apparent rôle, and it seems to be quite delicate to prove ultrametricity by Talagrand s method. This is quite curious as, on the other hand, ultrametricity plays a crucial Received October 2004; revised July Supported in part by a grant from the Schweizerische Nationalfonds, contract no /1. AMS 2000 subject classifications. 60G60, 82B44. Key words and phrases. Spin glasses, disordered systems, ultrametricity. This is an electronic reprint of the original article published by the Institute of Mathematical Statistics in The Annals of Applied Probability, 2006, Vol. 16, No. 1, This reprint differs from the original in pagination and typographic detail. 1

2 2 E. BOLTHAUSEN AND N. KISTLER rôle in the physicists nonrigorous derivation of the free energy, be that using the replica trick or the cavity method.] We present here a simple and, as we think, natural generalization of the GREM which has no built in ultrametric structure. We, however, show that, in the limit, the model is ultrametrically organized. In this paper we address only the free energy. The more delicate investigation of the ultrametricity of the Gibbs distribution will be investigated in a forthcoming paper. Throughout this paper, we fix a number n N, and consider the set I ={1,...,n}, as well as a collection of positive real numbers {a J } J I such that a J =1. J I For convenience, we put a = 0. The relevant subset of I will be only the ones with positive a-value. For A I, we set P A = {J A:a J >0}, P = P I. For n N, we set Σ N = {1,...,2 N }. We also fix positive real numbers γ i, i I, satisfying n γ i =1, i=1 and write Σ i N = Σ γi N where, for notational convenience, we assume that 2 γin is an integer. For N N, we will label the spin configurations σ as σ =(σ 1,...,σ n ), σ i Σ i N, that is, we identify Σ N with Σ 1 N Σn N. For J I, J ={j 1,...,j k }, j 1 < j 2 < < j k, we write Σ N,J = k s=1 Σ js N, and for σ Σ N, we write σ J for the projected configuration (σ j ) j J Σ N,J. Our spin glass Hamiltonian is ined as (1) X σ = J PX J σ J, where X J σ J, J P, σ J Σ N,J are independent centered Gaussian random variables with variance a J N. The X σ are then Gaussian random variables with variance N (Gaussian always means centered Gaussian through this note), but they are correlated. E will denote expectation with respect to these random variables. A special case is when P ={I}, that is, when only a I 0, in which case it has to be one. Then the X σ are independent, that is, one considers simply a set of 2 N independent Gaussian random variables with variance N. This is the standard random energy model.

3 NONHIERARCHICAL GREM 3 The generalized random energy model is a special case, too: It corresponds to the situation wherethe sets in P are nested, meaning that P consists of an increasing sequence of subsets. Without loss of generality, we may assume that in this case (2) P ={J m :1 m k}, J m = {1,...,n m }, where 1 n 1 <n 2 < <n k n. In the GREM case, the natural metric on Σ N coming from the covariance structure d(σ,σ ) = E((X σ X σ ) 2 ) is an ultrametric. In the more general case (1) considered here, this metric is not an ultrametric. To see this, take n=3, P ={{1,2},{1,3},{2,3}}, that is, where (3) X σ =X {1,2} σ 1,σ 2 +X {1,3} σ 1,σ 3 +X {2,3} σ 2,σ 3, with a J =1/3 for J P. Then for a,b,b,c,c Σ N/3, b b, c c, one has d((a,b,c),(a,b,c ))=d((a,b,c ),(a,b,c ))= 2N/3, whereas d((a,b,c),(a,b,c ))= N, contradicting ultrametricity. Any of our models can be coarse-grained in many ways into a GREM. For that consider strictly increasing sequences of subsets of I: = A 0 A 1 A K =I. We do not assume that the A i are in P. We call such a sequence a chain T=(A 0,A 1,...,A K ). We attach weights â Aj to these sets by putting (4) â Aj = B P Aj \P Aj 1 a B. Evidently K j=1 â Aj =1, andifweassign randomvariables X σ (T),according to (1), we arrive after an irrelevant renumbering of I at a GREM of the form (2). In particular, the corresponding metric d is an ultrametric. We write tr( ) for averaging over Σ N (i.e., the coin-tossing expectation if we identify Σ N with {H,T} N ). For a function x:σ N R, set Z N (β,x) = trexp[βx], F N (β,x) = 1 N log(z N(β,x)), and ine the usual finite N partition function, and free energy by Z N (β) = Z N (β,x), F N (β) = F N (β,x), f N (β) = E(F N (β,x)),

4 4 E. BOLTHAUSEN AND N. KISTLER where X is interpreted as random function Σ N R. For any chain T, we attach to our model a GREM (X σ (T)) σ ΣN, as explained above, and then f N (T,β) = E(F N (β,x(t))), f(t,β) = lim N f N(T,β). For agrem,thelimitingfreeenergyisknowntoexist,andcanbeexpressed explicitly, but in a somewhat complicated way (see [1, 3]). Our main result is that our generalization of the GREM does not lead to anything new in N limit, shedding hopefully some modest light on the universality of ultrametricity. (5) Theorem 1. f(β) = lim N f N(β) exists and is also the almost sure limit of F N (β). f(β) is the free energy of a GREM. More precisely, there exists a chain T such that (6) f(t,β) is minimal in the sense that (7) f(β)=f(t,β), β 0. f(β)=min S f(s,β), the minimum being taken over all chains S. The fact that free energy is self-averaging, meaning that f(β) (if the limit exists) is also the almost sure limit of the F N, is a simple consequence of the Gaussian concentration inequality. We write F N as a function of the standardized variables Xσ J J / a J N. As log e a i log e a i max a i a i, a i,a i R, i i i we get that F N (β), regarded as a function of the collection (Xσ J J / a J N), is LipschitzcontinuouswithLipschitzconstant β/ N.Bytheusualconcentration of measure estimates for Gaussian distributions (see, e.g., Proposition 2.18 of [6]), we have ] (8) P[ F N (β) EF N (β) >ǫ] 2exp [ ǫ2 2β 2N.

5 NONHIERARCHICAL GREM 5 Using the Borel Cantelli lemma, one sees that if lim N f N (β) exists, then the F N (β) converge almost surely to this limit, too, and if lim N F N (β) exists almost surely, then the limit is nonrandom and equals lim N f N (β). As for the strategy of the proof, the existence of the limit is established through a quite standard application of the second moment method, akin to that originally exploited by Derrida in his seminal paper [1]; this allows to express the limiting free energy in terms of a variational problem, which we then solve inductively. For the reader s convenience, we briefly describe the mechanism which lies behind Theorem 1 for the Hamiltonian (3), but we allow for general (positive) variances a 12,a 13,a 23, and general γ i. It is best to count the number of configurations σ which reach a certain energy level λn. It is evident that only an exponentially small portion of the total number 2 N of configurations achieve this, roughly formulated (we will be more precise later), #{σ:x σ λn} 2 N e ρ(λ)n, ρ(λ)>0. The free energy is obtained by the Legendre transform of ρ. In order to determine ρ(λ), we count individually for each of the three parts in (3) how many configurations reach respective levels (9) ˆρ(λ 1,λ 2,λ 3 ) 1 N log#{σ:x{1,2} σ 1,σ 2 λ 1 N, X σ {1,3} 1,σ 3 λ 2 N, X σ {2,3} 2,σ 3 λ 3 N}+log2, with λ 1 +λ 2 +λ 3 =λ. Evidently, (10) ρ(λ) = inf =λˆρ(λ 1,λ 2,λ 3 ). λ 1 +λ 2 +λ 3 It turns out that one can get ˆρ by computing expectations inside the logarithm, provided only some naturally ined restrictions on the λ i are satisfied. For small λ, it is easily seen that one has an equipartition property, and that the optimal λ 1,λ 2,λ 3 are proportional to the respective variances, that is, λ 1 =a 12 λ, λ 2 =a 13 λ, λ 3 =a 23 λ, and from that one obtains (11) ρ(λ)=λ 2 /2, which is the same as if the X σ would be uncorrelated. Increasing λ, we, however, encounter restrictions from the structure of the Hamiltonian. First of all, λ 1 has to be such that there are any σ 1,σ 2 with X σ {1,2} 1,σ 2 λ 1 N = a 12 λn.thereare2 (γ 1+γ 2 )N pairs(σ 1,σ 2 ), andasthex σ {1,2} 1,σ 2 areindependent, the restriction is [ 2 (γ 1+γ 2 )N exp λ2 a 12 N 2 ] 1.

6 6 E. BOLTHAUSEN AND N. KISTLER (We are not considering any log-corrections.) This leads to the restriction 2(γ 1 +γ 2 )log2 (12) λ a 12 for the validity of (11), and there are two similar restrictions coming from X {1,3} and X {2,3}. Even if these three restrictions are satisfied, it can be that there are simply totally not enough triples (σ 1,σ 2,σ 3 ) left. A necessary condition forthisiscertainly that theexpectednumberof #{σ:x σ λn}is not exponentially decaying, which is simply the condition that λ 2log2. The somewhat astonishing fact is that these are the only conditions one has to take into considerations for the validity of (11). Now, there are two cases: Case 1. λ 2log2 implies the other ones, that is, (13) γ i +γ j min 1. 1 i<j 3 a ij In that case, we are simply left with the restriction λ 2log2, and the free energy is f(β)= sup (βλ λ 2 /2), λ 2log2 which is the free energy of an REM. In that case the internal structure of the model is irrelevant, at least for the free energy. Case 2. (13) is violated. For initeness, assume that (γ 1 +γ 2 )/a 12 is the smallest one. In that case, (11) is only correct in the region (12). For λ larger, there is no (σ 1,σ 2 ) with X σ {1,2} 1,σ 2 a 12 λn (with probability close to 1), the maximum of the X σ {1,2} 1,σ 2 being at m 12 N (± log-corrections), where m 12 = 2(γ 1 +γ 2 )a 12 log2. Therefore, one has to restrict in (10) to λ s with λ 1 =m 12. The only configurations σ for which X σ λn have to satisfy (14) X {1,2} σ 1,σ 2 m 12 N, but there are now only subexponentially many (σ 1,σ 2 ) left which achieve this feat, and the difference to λn has to be made by the field Y σ1,σ 2 (σ 3 ) = X {1,3} σ 1,σ 3 +X {2,3} σ 2,σ 3, 1 σ 3 2 γ 3N,

7 NONHIERARCHICAL GREM 7 restricting (σ 1,σ 2 ) to the few which satisfy (14). There is an upper limit λ max for λ s such that there are any σ 3 with Y(σ 3 ) (λ m 12 )N. λ max N m 12 N is simply the maximum of 2 γ3n independent Gaussians with variance (a 13 +a 23 )N, that is, λ max m 12 = 2γ 3 (a 13 +a 23 )log2. ThesituationissimilartotheoneintheGREMwiththeonlydifferencethat, for(σ 1,σ 2 ) (σ 1,σ 2 ), thefieldsy σ 1,σ 2 andy σ 1,σ 2 arenotindependent,except when σ 1 σ 1 and σ 2 σ 2. It is, however, fairly evident that, among the (σ 1,σ 2 ) for which X σ {1,2} 1,σ 2 m 12 N there will be no pairs with such a partial overlap, with probability close to 1, and therefore, it is quite natural one can handle the field Y σ1,σ 2 as if it would come from a second level of a two-level GREM. In fact, it turns out that, in the Case 2, the tree of Theorem 1 is {{1,2},{1,2,3}}, and we replace our model with the coarse grained one with Hamiltonian X α 1 +X α 1,α 2, where #α 1 = 2 (γ 1+γ 2 )N, var(x ) = a 12 N, #α 2 =2 γ3n, var(x )=(a 13 +a 23 )N. This way of reasoning works for the general case. There are two issues which might be somewhat surprising. The first is that expressions (9) can always be evaluated by computing expectations inside the logarithm, provided one keeps some fairly trivial restrictions on the λ i. Second, it is not entirely evident why these restrictions finally always lead to tree structures. It is also interesting that the system always chooses from the many GREMs which can be obtained by coarse-grainings the one with minimal free energy. A similar behavior has already been obtained for the GREM itself in [2]. 2. Second moment estimates. We fix some notation: If (a N ) N N and (b N ) N N are two sequences of positive real numbers, we write a N b N if, for all ε>0, there exists N 0 (ε) N such that e εn b N a N e εn b N for N N 0. We also write a N b N if, for some δ>0, one has a N b N e δn, again for large enough N. In that case, we also write a N =Ω(b N ). The same notation are used in the case of sequences of random variables, just meaning that the relations hold almost surely (and therefore N 0 may depend on ω). For A I (not necessarily in P), we set γ(a) = γ i, i A α(a) = J P A a A. WerewriteF N intermsofenergylevels. Foracollection λ=(λ J ) J P,λ J R and A I, we set N N,A (λ) = #{σ Σ N,A :X J σ J λ J N, J P A },

8 8 E. BOLTHAUSEN AND N. KISTLER Clearly, (15) N N (λ) = N N,I (λ). {N N,A (λ)=0} {N N (λ)=0}. We express F N in terms of the N N (λ): F N (β)= 1 N log2 N (βn) P (16) R P dλn N (λ) J P e βλ JN = 1 N log dλn N (λ) ( logn e βλjn log2+o R P N J P We first want to take out the λ for which N N (λ)=0 for large N. As these are integer valued random variables, it is clear that EN N (λ) 1 implies N N (λ) =0 for large enough N, almost surely. It, however, turns out that this condition is not sufficient for our purpose, but remark that, if for some A I, one has EN N,A (λ) 1, then, by (15), one has N N (λ)=0 for large enough N as well. Lemma 2. (a) For any λ R P and A I, we have [ EN N,A (λ) 2 γ(a)n exp ] + (λj )2 N, 2a J P J A where λ + J = max(λ J,0). (b) There exists C >0 such that EN N (λ) C2 N exp [ J P for all λ R P, and all N. (c) Let λ R P. If for some A I one has + (λj )2 >γ(a)log2, 2a J P J A (λ + ] J )2 N 2a J then P(N N (λ) 0) 1 and, in particular, N N (λ)=0 for large enough N, almost surely. Proof. (a) and (b) follow by standard Gaussian tail estimates, and in case (c), by (15), we have which proves (c). P(N N (λ) 0) P(N N,A (λ) 0) EN N,A (λ), ).

9 NONHIERARCHICAL GREM 9 Let { = λ R P : } + (λj )2 γ(a)log2, A I, 2a J P J A + = {λ :λ J 0, J P}. (17) Lemma 3. If λ int, then N N (λ) EN N (λ) exp [ N ( log2 (λ + J )2 /2a J )]. J P Proof. The second relation is Lemma 2(a). For the proof of the first, it suffices to show that λ int implies (18) varn N (λ) (EN N (λ)) 2. In fact, from (18), Chebyshev s inequality and the Borel Cantelli lemma immediately imply (17). We abbreviate P(Xσ J J Nλ J ) by p J (N) (λ is kept fixed through this proof). With this notation, EN N (λ)=2 N J P p J(N): EN N (λ) 2 = P(Xσ J J Nλ J, Xσ J J Nλ J ) σ,σ Σ N J P = P(Xσ J J Nλ J, Xσ J Nλ J ) A I (σ,σ J ) Λ A J P = Λ A (N) p J (N) p J (N) 2, A I J P A J P\P A where Λ A (N) consists of those pairs (σ,σ ) which agree on A and disagree on I\A. For A=, 2 2N Λ (N) 2 2N, and therefore, varn N (λ)= A Λ A (N) p J (N) p J (N) 2 +Ω((EN N (λ)) 2 ). J P A J P\P A Λ A (N) =2 γ(a)n i/ A2 γ in (2 γ in 1)=2 2N 2 γ(a)n +Ω( Λ A (N) ). As by assumption, 2 γ(a)n [ p J (N) exp ] + (λj )2 N, A, 2a J P A J P J A we have, for any A, Λ A (N) p J (N) p J (N) 2 2 2N p J (N) 2, J P A J P\P A J P

10 10 E. BOLTHAUSEN AND N. KISTLER proving varn N (λ) (EN N (λ)) 2. (19) Let ψ(λ,β) = ( ) βλ J λ2 J. 2a J P J Proposition 4. The free energy as ined in (5) exists and is given as (20) f(β)= sup λ + ψ(λ,β). Proof. We show the lower bound for liminf N F N (β) and the upper boundfor limsup N f N (β). By the self-averaging property (8), this proves the statement. We use the integral representation (16). If µ=(µ J ), ν =(ν J ) satisfy µ J < ν J for all J, we write If [µ,ν) +, we have [µ,ν) = {λ:µ J λ J <ν J, J P}. lim inf F 1 N(β) liminf N N N [µ,ν) log dλn N (λ) liminf N J 1 N logn N(ν) ( ) βµ J ν2 J. 2a J [µ,ν) J P dλ J P e βλ JN e βλ JN Asthisholdsforarbitrary[µ,ν) +, liminf N F N (β) sup λ +ψ(λ,β) follows. For the upper bound, let ε be an ε-neighborhood of. From Lemma 2(c), we have P (F N (β) 1N ) log dλn N (λ)e β J λ JN 1, ε and therefore, EF N(β) 1 N Elog dλn N (λ)e β ε By Jensen s inequality and Lemma 2(b), we have 1 lim sup N N Elog dλn N (λ)e β J λ JN ε J λ JN 1.

11 limsup N limsup N NONHIERARCHICAL GREM 11 1 N log 1 N log2n sup λ ε ψ(λ,β). dλen N (λ)e β ε [ ε dλexp N J P J λ JN ) (βλ ] J (λ+ J )2 As ε>0 is arbitrary, limsup N EF N (β) sup λ +ψ(λ,β) follows. 3. The optimization problem. We first discuss the special case of a GREM. Therefore,weassumethatthesetsin P arenested,that is,p ={J 1,...,J m }, where J 1 J m. If A I, put l A = max{l:j l A}. Evidently, follows from λ2 J log2 γ(a) 2a J P J A l A i=1 Therefore, λ + is equivalent with l i=1 λ 2 J i 2a Ji log2 γ(j la ). λ 2 J i 2a Ji log2 γ(j l ), 1 l m, (and, of course, that all components are nonnegative). Therefore, we have proved the following: 2a J Lemma 5. Assume that P is nested as above. Then { l λ 2 } J f(β)=sup ψ(λ,β): i log2 γ(j l ), 1 l m. 2a Ji i=1 This lemma proves that, in our more general situation, for any chain T, the corresponding GREM free energy is an upper bound. Corollary 6. For any chain T, we have f(β) f(t,β), β 0. Proof. For a given chain =A 0 A 1 A 2 A K =I, we consider + T which is obtained by dropping the conditions for the A s which are not in the chain. Then f(β)= sup ψ(λ,β) sup ψ(λ,β). λ + λ + T

12 12 E. BOLTHAUSEN AND N. KISTLER We claim that sup ψ(λ,β)=f(t,β), λ + T which proves the corollary. To see this equation, we write ψ(λ,β)= K j=1j P Aj \P Aj 1 ( ) βλ J λ2 J = 2a J K ψ j (λ j,β), j=1 say, where λ j =(λ J ) J PAj \P Aj 1. Set { } f j (β,t) = sup ψ j (λ j,β): λ2 J =t 2a J P Aj \P J Aj 1 =β 2tâ j t, where â j = J P Aj \P Aj 1 a J, that is, f j (β,s 2 /2â j )=βs s 2 /2â j. We therefore see that { K ( sup ψ(λ,β)=sup βs j s2 ) j l s 2 } j : log2 γ(a l ), 1 l K λ + 2â T j=1 j 2â j=1 j =f(t,β), the last equality by Lemma 5. In order to finish the proof of Theorem 1, it only remains to construct a chain T which satisfies f(β) f(t,β). Then one has also equality by the above corollary. For B I, let α(b) = and for B A, set ρ(b,a) = J P B a J 2log2(γ(A) γ(b)), α(a) α(b) ˆρ(B) = min A:A B,A B ρ(b,a). We construct a strictly increasing sequence of subsets A 0 = A 1 A 2 A K = I and parameters β 0 = 0 < β 1 < β 2 < < β K < by recursion. Assume that A 1 A 2 A k and 0<β 1 <β 2 < <β k are constructed such that the following conditions are satisfied:

13 NONHIERARCHICAL GREM 13 C1(k) β j = ˆρ(A j 1 ), j k. C2(k) For j k and any A A j 1 which satisfies β j =ρ(a j 1,A), one has A A j, that is, A j is maximal with β j =ρ(a j 1,A j ). For k = 0, the conditions are void. If A k = I, then the construction is finished,andwehave K = k. Therefore, assumea k I. Thenweset β k+1 = ˆρ(A k ), and prove first that β k+1 >β k. We claim that, for any A A k, A A k, one has 2log2(γ(A) γ(a k ))>β 2 k(α(a) α(a k )). Indeed, because of 2log2(γ(A k ) γ(a k 1 ))=β 2 k (α(a k) α(a k 1 )), 2log2(γ(A) γ(a k ))<β 2 k (α(a) α(a k)) would contradict condition C1(k) and equality would contradict C2(k). It only remains to construct A k+1 which satisfies C2(k+1). Assume there are two sets A,A A k, A,A A k satisfying (21) ρ(a k,a)=ρ(a k,a )=β k+1. We claim that then also ρ(a k,a A )=β k+1. Remark that and therefore, α(a A ) α(a)+α(a ) α(a A ), γ(a A )=γ(a)+γ(a ) γ(a A ), 2log2(γ(A A ) γ(a k )) β 2 k+1(α(a A ) α(a k )) 2log2[γ(A)+γ(A ) γ(a A ) γ(a k )] β 2 k+1[α(a)+α(a ) α(a A ) α(a k )] =β 2 k+1 [α(a A ) α(a k )] 2log2[γ(A A ) γ(a k )] 0, the equality by (21), and the last inequality by the inition of β k+1. From the inition of β k+1, we therefore conclude that 2log2(γ(A A ) γ(a k ))=β 2 k+1(α(a A ) α(a k )). We therefore find a unique maximal set A k+1 A k which satisfies ρ(a k,a k+1 ) = β k+1, and so we have constructed β k+1 > β k, A k+1 A k, A k+1 A k such that C1(k +1) and C2(k+1) are satisfied. The construction terminates after a finite number of steps. We claim now that, with T = (,A 1,...,A K 1,I), we have (22) f(β) f(β,t).

14 14 E. BOLTHAUSEN AND N. KISTLER Clearly, if β > 0 is small enough, the maximum in (20) is attained in λ (1) J (β) = a J β for all J, and therefore, f(β)= β2 2 for small β. This remains valid as long as (β 2 /2)α(A) γ(a) for all A, that is, for β β 1. For β k <β β k+1, we choose λ (k+1) (β) ined by { λ (k+1) J (β) aj β = m, for J P Am \P Am 1, 1 m k, (23) a J β, for J / P Ak. This choice (23) satisfies the side conditions in the range of β we are considering, and hence, (24) ψ(λ (k+1) (β),β) f(β). We show now that f(β,t)=ψ(λ (k+1) (β),β) for β k β β k+1. An elementary computation gives ψ(λ (k+1) (β),β)=β =β k i=1 k i=1 β i [α(a i ) α(a i 1 )] γ(a k )log2+ β2 2 (1 α(a k)) β i â(a i ) γ(a k )log2+ β2 2 K i=k+1 â(a i ), where â(a i ) is ined by (4). This is exactly the free energy of the corresponding GREM as given in [1]. [It is, in fact, elementary to check that λ (k+1) (β) is the maximizing vector λ for the GREM corresponding to the above chain when β k β β k+1.] We have therefore proved Theorem 1. Remark 7. We have, in fact, proved that f(β)=β k i=1 for β k β β k+1. β i [α(a i ) α(a i 1 )] γ(a k )log2+ β2 2 (1 α(a k)) Acknowledgment. We wish to thank the referee for careful reading and valuable comments. REFERENCES [1] Derrida, B. (1985). A generalization of the random energy model that includes correlations between the energies. J. Phys. Lett [2] Bovier, A. and Kurkova, I. (2004). Derrida s generalized random energy models. I, II. Ann. Inst. H. Poincaré Probab. Statist MR

15 NONHIERARCHICAL GREM 15 [3] Capocaccia, D., Cassandro, M. and Picco, P.(1987). On the existence of thermodynamics for the generalized random energy model. J. Statist. Phys MR [4] Guerra, F. (2003). Broken replica symmetry bounds in the mean field spin glass model. Comm. Math. Phys MR [5] Guerra, F. and Toninelli, F. L. (2002). The thermodynamic limit in mean field spin glass models. Comm. Math. Phys MR [6] Ledoux, M. (2002). The Concentration of Measure Phenomenon. Amer. Math. Soc., Providence, RI. MR MR [7] Talagrand, M. (2006). The Parisi formula. Ann. of Math Institut für Mathematik Universität Zürich Winterthurerstrasee 190 CH-8057 Zürich Switzerland nkistler@amath.unizh.ch eb@math.unizh.ch