arxiv: v1 [math.pr] 14 Jul 2016

Transcription

1 PHASE TRANSITIONS IN EDGE-WEIGHTED EXPONENTIAL RANDOM GRAPHS MEI YIN Jly 15, 2016 arxiv: v1 [math.pr] 14 Jl 2016 Abstract. The exponential family of random graphs represents an important and challenging class of network models. Despite their flexibility, conventionally sed exponential random graphs have one shortcoming. They cannot directly model weighted networks as the nderlying probability space consists of simple graphs only. Since many sbstantively important networks are weighted, this limitation is especially problematic. We extend the existing exponential framework by proposing a generic common distribtion for the edge weights and rigorosly analyze the associated phase transitions and critical phenomena. We then apply these general reslts to get concrete answers in exponential random graph models where the edge weights are niformly distribted. 1. Introdction Exponential random graphs are among the most widespread models for real-world networks as they are able to captre a broad variety of common network tendencies by representing a complex global strctre throgh a set of tractable local featres. These rather general models are exponential families of probability distribtions over graphs, in which dependence between the random edges is defined throgh certain finite sbgraphs, in imitation of the se of potential energy to provide dependence between particle states in a grand canonical ensemble of statistical physics. They are particlarly sefl when one wants to constrct models that resemble observed networks as closely as possible, bt withot going into details of the specific process nderlying network formation. For history and a review of developments, see e.g. Fienberg [14] [15], Frank and Strass [16], Häggström and Jonasson [17], Newman [27], and Wasserman and Fast [33]. Many of the investigations into exponential random graphs employ the elegant theory of graph limits as developed by Lovász and coathors V.T. Sós, B. Szegedy, C. Borgs, J. Chayes, K. Vesztergombi,...) [8] [9] [10] [23] [24]. Bilding on earlier work of Aldos [1] and Hoover [18], the graph limit theory connects seqences of graphs to a nified graphon space eqipped with a ct metric. Thogh the theory itself is tailored to dense graphs, serios attempts have been made at formlating parallel reslts for sparse graphs [2] [4] [6] [7] [11]. Since networks are often very large in size, a pressing objective in stdying exponential models is to nderstand their asymptotic tendencies. From the point of view of extremal combinatorics and statistical mechanics, emphasis has been made on the variational principle of the limiting normalization constant, concentration of the limiting probability distribtion, phase transitions and asymptotic strctres. See e.g. Aristoff and Zh [3], Chatterjee and Diaconis [12], Kenyon et al. [20], Kenyon and Yin [21], Lbetzky and Zhao [25] [26], Radin and Sadn [28] [29], and Radin and Yin [30]. Despite their flexibility, conventionally sed exponential random graphs admittedly have one shortcoming. They cannot directly model weighted networks as the nderlying probability

2 Mei Yin space consists of simple graphs only, i.e., edges are either present or absent. Since many sbstantively important networks are weighted, this limitation is especially problematic. The need to extend the existing exponential framework is ths jstified, and several generalizations have been proposed [22] [31] [34]. An alternative interpretation for simple graphs is sch that the edge weights are iid and satisfy a Bernolli distribtion. This work will instead assme that the iid edge weights follow a generic common distribtion and rigorosly analyze the associated phase transitions and critical phenomena. The rest of this paper is organized as follows. In Section 2 we provide basics of graph limit theory and introdce key featres of edge-weighted exponential random graphs. In Section 3 we smmarize some important general reslts, inclding a variational principle for the limiting normalization constant Theorems 3.1 and 3.2) and an associated concentration of measre Theorem 3.3) indicating that almost all large graphs lie near the maximizing set. Theorems 3.4 and 3.5 then give simplified versions of these theorems in the attractive region of the parameter space where the parameters β 2,..., β k are all non-negative. In Section 4 we specialize to exponential models where the edge weights are niformly distribted and show in Theorem 4.1 the existence of a first order phase transition crve ending in a second order critical point. Lastly, in Section 5 we investigate the asymptotic phase strctre of a directed model where a large deviation principle is missing. 2. Edge-weighted exponential random graphs Let G n G n be an edge-weighted ndirected labeled graph on n vertices, where the edge weights x ij between vertex i and vertex j are iid real random variables having a common distribtion µ. Any sch graph G n, irrespective of the nmber of vertices, may be represented as an element h Gn of a single abstract space W that consists of all symmetric measrable fnctions hx, y) from [0, 1] 2 into R referred to as graph limits or graphons ), by setting h Gn x, y) as the edge weight between vertices nx and ny of G n. For a finite simple graph H with vertex set V H) = [k] = {1,..., k} and edge set EH) and a simple graph G n on n vertices, there is a notion of density of graph homomorphisms, denoted by th, G n ), which indicates the probability that a random vertex map V H) V G n ) is edge-preserving, th, G n ) = homh, G n). 2.1) V G n ) V H) For a graphon h W, define the graphon homomorphism density th, h) = hx i, x j )dx 1 dx k. 2.2) [0,1] k {i,j} EH) Then th, G n ) = th, h Gn ) by constrction, and we take 2.2) as the definition of graph homomorphism density th, G n ) for an edge-weighted graph G n. This graphon interpretation enables s to captre the notion of convergence in terms of sbgraph densities by an explicit ct distance on W: d f, h) = sp fx, y) hx, y)) dx dy 2.3) S,T [0,1] S T for f, h W. The common distribtion µ for the edge weights yields probability measre P n and the associated expectation E n on G n, and frther indces probability measre Q n on the space W nder the graphon representation. 2

3 Phase transitions in edge-weighted exponential random graphs A non-trivial complication is that the topology indced by the ct metric is well defined only p to measre preserving transformations of [0, 1] and p to sets of Lebesge measre zero), which may be thoght of vertex relabeling in the context of finite graphs. To tackle this isse, an eqivalence relation is introdced in W. We say that f h if fx, y) = h σ x, y) := hσx, σy) for some measre preserving bijection σ of [0, 1]. Let h referred to as a redced graphon ) denote the eqivalence class of h in W, d ). Since d is invariant nder σ, one can then define on the reslting qotient space W the natral distance δ by δ f, h) = inf σ1,σ 2 d f σ1, h σ2 ), where the infimm ranges over all measre preserving bijections σ 1 and σ 2, making W, δ ) into a metric space. With some abse of notation we also refer to δ as the ct distance. After identifying graphs that are the same after vertex relabeling, the probability measre P n yields probability measre P n and the associated expectation Ẽn which coincides with E n ). Correspondingly, the probability measre Q n indces probability measre Q n on the space W nder the measre preserving transformations. By a k-parameter family of exponential random graphs we mean a family of probability measres P β n on G n defined by, for G n G n, P β ng n ) = exp n 2 β 1 th 1, G n ) + + β k th k, G n ) ψ β n )) P n G n ), 2.4) where β = β 1,..., β k ) are k real parameters, H 1,..., H k are pre-chosen finite simple graphs and we take H 1 to be a single edge), th i, G n ) is the density of graph homomorphisms, P n is the probability measre indced by the common distribtion µ for the edge weights, and ψ β n is the normalization constant, ψ β n = 1 n 2 log E n exp n 2 β 1 th 1, G n ) + + β k th k, G n )) )). 2.5) We say that a phase transition occrs when the limiting normalization constant ψ β := lim n ψβ n has a singlar point, as it is the generating fnction for the limiting expectations of other random variables, lim n Eβ nth i, G n ) = lim n ) β i ψ β n = β i ψ β, 2.6) lim n n2 Cov β n th i, G n ), th j, G n )) = lim ψ n n β = 2 ψ β i β j β i β. β 2.7) j The exchange of limits in 2.6) and 2.7) is nontrivial, bt may be jstified sing similar techniqes as in Yang and Lee [35]. Since homomorphism densities th i, G n ) are preserved nder vertex relabeling, the probability measre P β n and the associated expectation Ẽβ n which coincides with E β n) may likewise be defined. Definition 2.1. A phase is a connected region of the parameter space {β}, maximal for the condition that the limiting normalization constant ψ β is analytic. There is a jth-order transition at a bondary point of a phase if at least one jth-order partial derivative of ψ β is discontinos there, while all lower order derivatives are continos. More generally, we may consider exponential models where the terms in the exponent defining the probability measre contain fnctions on the graph space other than homomorphism densities. Let T : W R be a bonded continos fnction. Let the probability measre P T n and the normalization constant ψn T be defined as in 2.4) and 2.5), that is, ) P T n G n ) = exp n 2 T h Gn ) ψn T ) P n G n ), 2.8) 3 2

4 Mei Yin ψn T = 1 ) n 2 log E n exp n 2 T h Gn ), 2.9) Then the probability measre P T n and the associated expectation ẼT n which coincides with E T n ) may be defined in a similar manner. We will assme that the common distribtion µ on the edge weights has finite spport, which implies that the graphon space W nder consideration is a finite sbset of R. These L graphons generalize graphons that take vales in [0, 1] only and are better sited for generic edge-weighted graphs instead of jst simple graphs. The finite spport assmption also assres that the moment generating fnction M) = e x µdx) is finite for all and the conjgate rate fnction of Cramér, I : R R, where Ix) = sp x log M)) 2.10) R is nicely defined. The domain of the fnction I can be extended to W in the sal manner: I h) = Ihx, y))dxdy, 2.11) [0,1] 2 where h is any representative element of the eqivalence class h. It was shown in [13] that I is well defined on W and is lower semi-continos nder the ct metric δ. The space W, δ ) enjoys many other important properties that are essential for the stdy of exponential random graph models. It is a compact space and homomorphism densities th, ) are continos fnctions on it. In fact, homomorphism densities characterize convergence nder the ct metric: a seqence of graphs converges if and only if its homomorphism densities converge for all finite simple graphs, and the limiting homomorphism densities then describe the reslting graphon. 3. Statement of reslts The normalization constant plays a central role in statistical mechanics becase it encodes essential information abot the strctre of the probability measre; even the existence of its limit bears important conseqences. In the case of exponential random graphs, the comptational tools crrently sed by practitioners to compte this constant become nreliable for large networks [5] [32]. This problem however can be circmvented if we know a priori that the limit of the normalization constant exists. One can then choose a scaled down network model with a smaller nmber of vertices and se the exact vale of the normalization constant in the scaled down model as an approximation to the normalization constant in the larger model, and a compter program that can evalate the exact vale of the normalization constant for moderate sized networks wold serve the prpose [19]. The following Theorem 3.1 is a generalization of the corresponding reslt Theorem 3.1) in Chatterjee and Diaconis [12], where they assmed that the edge weights x ij between vertices i and j are iid real random variables satisfying a special common distribtion Bernolli having vales 1 and 0 each with probability 1/2. For the sake of completeness and to motivate frther discssions in Theorem 3.2, we present the proof details below. Theorem 3.1. Let T : W R be a bonded continos fnction. Let ψ T n and I be defined as before see 2.9), 2.10) and 2.11)). Then the limiting normalization constant ψ T := lim n ψt n exists, and is given by ψ T = sp T h) 1 ) h W 2 I h). 3.1) 4

5 Phase transitions in edge-weighted exponential random graphs Proof. For each Borel set à W and each n, define à n = { h à : h = h Gn for some G n G n }. 3.2) Fix ɛ > 0. Since T is a bonded fnction, there is a finite set R sch that the intervals {c, c + ɛ) : c R} cover the range of T. Since T is a continos fnction, for each c R, the set Ũc consisting of redced graphons h with c < T h) < c + ɛ is an open set, and the set H c consisting of redced graphons h with c T h) c + ɛ is a closed set. Let Ũ c n and H c n be respectively defined as in 3.2). The large deviation principle, Theorem 1.2 of [13], implies that: log lim sp Q n H c n ) 1 n n 2 inf h H c 2 I h), 3.3) and that lim inf n log Q n Ũ n c ) n 2 W that is inherited from the corre- where Q n denotes the family of probability measres on sponding probability measres P n on G n. We first consider lim sp ψn T. This shows that 1 inf h Ũc 2 I h), 3.4) expn 2 ψn T ) expn 2 c + ɛ)) Q n H c n ) R sp expn 2 c + ɛ)) Q n H c n ). 3.5) c R c R Each h H c satisfies T h) c. Conseqently, Sbstitting this in 3.6) gives ) lim sp ψn T 1 sp c + ɛ inf n c R h H c 2 I h). 3.6) sp T h) 1 h H c 2 I h)) sp c 1 h H c 2 I h)) 1 = c inf h H c 2 I h). 3.7) lim sp n Next we consider lim inf ψ T n. Therefore for each c R, Each h Ũc satisfies T h) < c + ɛ. Therefore ψn T ɛ + sp sp T h) 1 h H c 2 I h)) 3.8) c R = ɛ + sp T h) 1 h W 2 I h)). expn 2 ψn T ) sp expn 2 c) Q n Ũ c n ). 3.9) c R 1 lim inf n ψt n c inf h Ũc 2 I h). 3.10) sp T h) 1 2 I h)) sp c + ɛ 1 2 I h)) 1 = c + ɛ inf h Ũc h Ũc h Ũc 2 I h). 3.11) 5

6 Mei Yin Together with 3.10), this shows that lim inf n ψt n ɛ + sp sp T h) 1 2 I h)) 3.12) h Ũc Since ɛ is arbitrary, this completes the proof. c R = ɛ + sp T h) 1 h W 2 I h)). When T is not continos, we lose control of the openness and closedness of the sets in W, and hence can not resort to the large deviation principle of [13] to find an explicit characterization of the limiting normalization constant ψ T, bt we can still conclde that this important limit exists nder mild conditions. Theorem 3.2. Let T : W R be a bonded fnction. Let I and ψ T n be defined as before see 2.9), 2.10) and 2.11)). Then the limiting normalization constant ψ T exists. Proof. Since T is a bonded fnction, there is a finite set R sch that the intervals {c, c + ɛ) : c R} cover the range of T. Similarly as in the proof of Theorem 3.1, we have and This implies that expn 2 ψn T ) R sp expn 2 c + ɛ)) Q n Ũ c n ), 3.13) c R expn 2 ψn T ) sp expn 2 c) Q n Ũ c n ). 3.14) c R lim sp ψ T log R n lim inf n n ψt n n 2 + ɛ. 3.15) Since ɛ is arbitrary, this completes the proof. Remark. The bondedness condition on T can be relaxed even frther. log R )/n 2 ) 0 is sfficient. Let H be the sbset of W where ψ T is maximized. By the compactness of W, the continity of T and the lower semi-continity of I, H is a nonempty compact set. The set H encodes important information abot the exponential model 2.8) and helps to predict the behavior of a typical random graph sampled from this model. The following Theorem 3.3 states that in the Gn large n limit, the qotient image h of a random graph G n drawn from 2.8) mst lie close to H with probability 1. Especially, if H is a singleton set, the theorem gives a law of large nmbers for G n ; while if H is not a singleton set, the theorem points to the existence of a first order phase transition. Theorem 3.3. Let H be defined as in the above paragraph. Let P T n 2.8) be the probability measre on G n. Then lim δ h Gn, H) = 0 almost srely. 3.16) n Proof. The proof of this theorem follows a similar line of reasoning as in the proof of the corresponding reslt Theorem 3.2) in Chatterjee and Diaconis [12]. The key observation is that the distance between the graph and the maximizing set decays exponentially as the nmber of vertices of the graph grows. For any η > 0 there exist C, γ > 0 sch that for all n large enogh, P T n δ h Gn, H) > η) Ce n2γ. 3.17) 6

7 Phase transitions in edge-weighted exponential random graphs This is stronger than ordinary convergence in probability, which only shows that the probability decays to zero bt does not give the speed. Utilizing the fast exponential decay rate, we can then resort to probability estimates in the prodct space. By Borel-Cantelli, P T n δ h Gn, H) > η) < implies that P T n δ h Gn, H) > η infinitely often) = ) n=1 The conclsion hence follows. When the bonded continos fnction T on W is given by the sm of graph homomorphism densities T = k i=1 β ith i, ), the statement of Theorems 3.1 and 3.3 may be simplified in the attractive region of the parameter space where the parameters β 2,..., β k are all non-negative, as seen in the following Theorems 3.4 and 3.5. Theorem 3.4. Consider a general k-parameter exponential random graph model 2.4). Sppose β 2,..., β k are non-negative. Then the limiting normalization constant ψ β exists, and is given by ψ β = sp β 1 eh1) + + β k ehk) 12 ) I), 3.19) where eh i ) is the nmber of edges in H i, I is the Cramér fnction 2.10) 2.11), and the spremm is taken over all in the domain of I, i.e., where I <. Proof. The proof of this theorem follows a similar line of reasoning as in the proof of the corresponding reslt Theorem 4.1) in Chatterjee and Diaconis [12], where the exact form of I for the Bernolli distribtion was given. The crcial step is recognizing that I is convex. So thogh the exact form of I is not always obtainable for a generic common distribtion µ, the log of the moment generating fnction M) is convex and I, being the Legendre transform of a convex fnction, mst also be convex. Theorem 3.5. Let G n be an exponential random graph drawn from 2.4). Sppose β 2,..., β k are non-negative. Then G n behaves like an Erdős-Rényi graph Gn, ) in the large n limit, where is picked randomly from the set U of maximizers of 3.19). Proof. The assertions in this theorem are direct conseqences of Theorems 3.3 and An application: Uniformly distribted edge weights Consider the set G n of all edge-weighted ndirected labeled graphs on n vertices, where the edge weights x ij between vertex i and vertex j are iid real random variables niformly distribted on 0, 1). The common distribtion for the edge weights yields probability measre P n and the associated expectation E n on G n. Give the set of sch graphs the probability P β ng n ) = exp n 2 β 1 th 1, G n ) + β 2 th 2, G n ) ψ β n )) P n G n ), 4.1) where β = β 1, β 2 ) are 2 real parameters, H 1 is a single edge, H 2 is a finite simple graph with p 2 edges, and ψ β n is the normalization constant, ψ β n = 1 n 2 log E n exp n 2 β 1 th 1, G n ) + β 2 th 2, G n )) )). 4.2) The associated expectation E β n may be defined accordingly, and a phase transition occrs when the limiting normalization constant ψ β = lim n ψβ n has a singlar point. 7

8 Mei Yin r 1 ) ma 1 )) 4 mb 1 )) c, 2 c ) Figre 1. The V-shaped region with phase transition crve rβ 1 ) inside) in the β 1, β 2 ) plane. Graph drawn for p = 2. Theorem 4.1. For any allowed H 2, the limiting normalization constant ψ β is analytic at all β 1, β 2 ) in the pper half-plane β 2 0) except on a certain decreasing crve β 2 = rβ 1 ) which incldes the endpoint β1 c, βc 2 ). The derivatives β 1 ψ β and β 2 ψ β have jmp) discontinities across the crve, except at the end point where, however, all the second derivatives 2 ψ β, β β 1 β 2 ψ β and 2 ψ β β2 2 diverge. Corollary 4.2. For any allowed H 2, the parameter space {β 1, β 2 ) : β 2 0} consists of a single phase with a first order phase transition across the indicated crve β 2 = rβ 1 ) and a second order phase transition at the critical point β c 1, βc 2 ). Proof. The moment generating fnction for the niform 0, 1) distribtion is given by M) = e 1)/. The associated Cramér fnction I is finite on 0, 1), ) I) = sp log e 1, 4.3) R bt does not admit a closed-form expression. As shown in Theorem 3.4, the limiting normalization constant ψ β exists and is given by ψ β = sp β 1 + β 2 p 12 ) I). 4.4) 0 1 A significant part of compting phase bondaries for the 2-parameter exponential model is then a detailed analysis of the calcls problem 4.4). However, as straightforward as it sonds, since 8

9 Phase transitions in edge-weighted exponential random graphs l') 10 * l) Figre 2. Otside the V-shaped region, l) has a niqe local maximizer hence global maximizer). Graph drawn for β 1 = 5, β 2 = 3.5, and p = 2. the exact form of I is not obtainable, getting a clear pictre of the asymptotic phase strctre is not that easy and varios tricks need to be employed. Consider the maximization problem for l; β 1, β 2 ) = β 1 +β 2 p 1 2I) on the interval [0, 1], where < β 1 < and 0 β 2 < are parameters. The location of maximizers of l) on the interval [0, 1] is closely related to properties of its derivatives l ) and l ), l ) = β 1 + pβ 2 p I ), 4.5) l ) = pp 1)β 2 p I ). Following the dality principle for the Legendre transform between I) and log M) [36], we first analyze properties of l ) on the interval [0, 1]. Recall that I) + log e 1 where and are implicitly related. Taking derivatives, we have = =, 4.6) ) log e 1, 4.7) Consider the fnction I ) m) = ) log e 1 = 1. I ) 2pp 1) p 2 4.8) 9

10 Mei Yin p 0 n 0 ) 0 m 0 ) Table 1. Critical vales for m) and n) as a fnction of p. on [0, 1]. By 4.7), analyzing properties of m) translates to analyzing properties of the fnction ) n) = 2pp 1) log e 1 ) ) log e 1 p 2 4.9) e 2 e 2 ) + 2) + 1 e ) p 2 1) + 1 = 2pp 1) e 1) 2 2 e 1) over R, where m)n) = 1 and and satisfy the dal relationship. We recognize that lim n) = 0, 4.10) ) pp 1) 1 p 1 lim n) =, lim n) = 0, which implies that n) achieves a finite global maximm. We claim that the global maximm can only be attained at 0 0. This wold frther imply that there is a finite global minimm for m), and it can only be attained at First sppose p = 2. Then n 0 ) = 0 easily implies that 0 = 0. Now sppose p > 2. Then since n 0 ) = 0, we have e 2 e 2 ) + 2) + 1 ) ) 2 e 1) + 1 e 2 e 2 + 2) + 1 e 1) e = p 2) 1) 0 e 1) 2 2 < ) This says that 0 is on the portion of R where e 2 e 2 + 2) + 1 ) / e 1) 2 2) is decreasing, i.e., 0 > 0. As goes from 0 to, the left hand side of 4.11) first decreases from 0 then increases to 0 and is always negative, whereas the right hand side of 4.11) monotonically increases from p 2)/144 to 0 and approaches 0 at a rate faster than the left hand side, and so there exists a 0 which makes both sides eqal. Or nmerical comptations show that n 0 ) = 0 is niqely defined, and n) increases from to 0 and decreases from 0 to. See Table 1 for some of these critical vales. The above analysis shows that for β 2 m 0 ), l ) 0 over the entire interval [0, 1]; while for β 2 > m 0 ), l ) takes on both positive and negative vales, and we denote the transition points by 1 and 2 1 < 0 < 2 ). Properties of l ) on [0, 1] entails properties of l ) over the same interval. For β 2 m 0 ), l ) is monotonically decreasing. For β 2 > m 0 ), l ) is decreasing from 0 to 1, increasing from 1 to 2, and then decreasing again from 2 to 1. The analytic properties of l ) and l ) help s investigate properties of l) on the interval [0, 1]. Being the Legendre transform of a smooth fnction, I) is a smooth fnction, and grows 10

11 Phase transitions in edge-weighted exponential random graphs l') 10 * l) Figre 3. Otside the V-shaped region, l) has a niqe local maximizer hence global maximizer). Graph drawn for β 1 = 2.5, β 2 = 4, and p = 2. nbonded when approaches 0 or 1. By the dality principle for the Legendre transform, I ) = where and are linked throgh 4.7), so I 0) = and I 1) =. This says that l) is a smooth fnction, l0) = l1) =, l 0) = and l 1) =, so l) can not be maximized at 0 or 1. For β 2 m 0 ), l ) crosses the -axis only once, going from positive to negative. Ths l) has a niqe local maximizer hence global maximizer). For β 2 > m 0 ), the sitation is more complicated. If l 1 ) 0 resp. l 2 ) 0), l) has a niqe local maximizer hence global maximizer) at a point > 2 resp. < 1 ). See Figres 2 and 3. If l 1 ) < 0 < l 2 ), then l) has two local maximizers 1 and 2, with 1 < 1 < 0 < 2 < 2. Let f) = I ) 2p 1) 1 2 I ) 4.12) so that l 1 ) = β 1 + f 1 ) and l 2 ) = β 1 + f 2 ). Again by the dality principle for the Legendre transform, analyzing properties of the fnction f) on [0, 1] translates to analyzing properties of the fnction g) = e 1 ) e 1) + 1 ) 2p 1) e 2 e 2 + 2) + 1) ) over R, where f) = g) and and satisfy the dal relationship. We recognize that lim g) =, 4.14) lim g) = 3 0 p 1, lim g) =, which implies that g) achieves a finite global minimm. We claim that the global minimm can only be attained at the same niqe 0 that makes n ) = 0. This can be checked by 11

12 Mei Yin p 0 g 0 ) 0 f 0 ) Table 2. Critical vales for f) and g) as a fnction of p. identifying the condition for g ) = 0. For p = 2, g 0 ) = 0 easily implies that 0 = 0. For p > 2, since g 0 ) = 0, we have e ) 1) + 1 e 2 e 2 ) + 2) + 1 e 2 e 2 ) + 2) + 1 e ) 1) + 1 e 1) 0 e 1) e 1) e 1) e 2 e 2 ) 2 + 2) + 1 = p 1) e 1) 2 2, 4.15) 0 which yields the same soltion as 4.11) after a simple transformation. Ths g) decreases from to 0 and increases from 0 to. This frther implies that there is a finite global minimm for f) attained at 0, and f) decreases from 0 to 0 and increases from 0 to 1. Both 0 and 0 coincide with the critical vales listed in Table 1. See Table 2. We conclde that l 1 ) 0 for β 1 f 0 ) and β 2 = m 0 ). The only possible region in the β 1, β 2 ) plane where l 1 ) < 0 < l 2 ) is bonded by β 1 < f 0 ) := β1 c and β 2 > m 0 ) := β2 c. We examine the behavior of l 1 ) and l 2 ) more closely when β 1 and β 2 are chosen from this region. Recall that 1 < 0 < 2. By monotonicity of f) on the intervals 0, 0 ) and 0, 1), there exist continos fnctions aβ 1 ) and bβ 1 ) of β 1, sch that l 1 ) < 0 for 1 > aβ 1 ) and l 2 ) > 0 for 2 > bβ 1 ). As β 1, aβ 1 ) 0 and bβ 1 ) 1. aβ 1 ) is an increasing fnction of β 1, whereas bβ 1 ) is a decreasing fnction, and they satisfy faβ 1 )) = fbβ 1 )) = β 1. The restrictions on 1 and 2 yield restrictions on β 2, and we have l 1 ) < 0 for β 2 < maβ 1 )) and l 2 ) > 0 for β 2 > mbβ 1 )). As β 1, maβ 1 )) and mbβ 1 )). maβ 1 )) and mbβ 1 )) are both decreasing fnctions of β 1, and they satisfy l 1 ) = 0 when β 2 = maβ 1 )) and l 2 ) = 0 when β 2 = mbβ 1 )). As l 2 ) > l 1 ) for every β 1, β 2 ), the crve mbβ 1 )) mst lie below the crve maβ 1 )), and together they generate the bonding crves of the V -shaped region in the β 1, β 2 ) plane with corner point β1 c, βc 2 ) where two local maximizers exist for l). See Figres 1, 4 and 5. Fix an arbitrary β 1 < β1 c, we examine the effect of varying β 2 on the graph of l ). It is clear that l ) shifts pward as β 2 increases and downward as β 2 decreases. As a reslt, as β 2 gets large, the positive area bonded by the crve l ) increases, whereas the negative area decreases. By the fndamental theorem of calcls, the difference between the positive and negative areas is the difference between l 2 ) and l 1 ), which goes from negative l 2 ) = 0, 1 is the global maximizer) to positive l 1 ) = 0, 2 is the global maximizer) as β 2 goes from mbβ 1 )) to maβ 1 )). Ths there mst be a niqe β 2 : mbβ 1 )) < β 2 < maβ 1 )) sch that 1 and 2 are both global maximizers, and we denote this β 2 by rβ 1 ). See Figres 1 and 6. The parameter vales of β 1, rβ 1 )) are exactly the ones for which positive and negative areas bonded by l ) eqal each other. An increase in β 1 indces an pward shift of l ), and may 12 0

13 Phase transitions in edge-weighted exponential random graphs l') 10 1 * 2 * l) Figre 4. Along the lower bonding crve mbβ 1 )) of the V-shaped region, l ) has two zeros 1 and 2, bt only 1 is the global maximizer for l). Graph drawn for β 1 = 5.7, β 2 = 5, and p = 2. be balanced by a decrease in β 2. Similarly, a decrease in β 1 indces a downward shift of l ), and may be balanced by an increase in β 2. This jstifies that rβ 1 ) is monotonically decreasing in β 1. The rest of the proof follows as in the proof of the corresponding reslt Theorem 2.1) in Radin and Yin [30], where some probability estimates were sed. A jmp) discontinity in the first derivatives of ψ β across the crve β 2 = rβ 1 ) indicates a discontinity in the expected local densities 2.6), while the divergence of the second derivatives of ψ β at the critical point β1 c, βc 2 ) implies that the covariances of the local densities go to zero more slowly than 1/n2 2.7). We omit the proof details. Remark. The maximization problem 4.4) is solved at a niqe vale off the phase transition crve β 2 = rβ 1 ), and at two vales 1 and 2 along the crve. As β 1 resp. β 2 ), 1 0 and 2 1. The jmp from 1 to 2 is qite noticeable even for small parameter vales of β. For example, taking p = 2, β 1 = 5, and β 2 = 5, nmerical comptations yield that and with l 1 ) l 2 ) Proposition 4.3. The Cramér fnction I) 4.3) for the niform distribtion on 0, 1) is symmetric abot the line = 1 2. Proof. Recall that I) is the Legendre transform of the log moment generating fnction log M) for the niform 0, 1) distribtion. Take 0 < < 1 2. Thogh the exact form of I is not obtainable, following the dality principle, we have I) = 1 log e 1 1 1, 4.16) I1 ) = 2 1 ) log e 2 1 2, 13

14 Mei Yin * l') 1 * l) Figre 5. Along the pper bonding crve maβ 1 )) of the V-shaped region, l ) has two zeros 1 and 2, bt only 2 is the global maximizer for l). Graph drawn for β 1 = 4.3, β 2 = 5, and p = 2. where 1 and 2 are both finite and niqely defined, and satisfy I ) = 1 and I 1 ) = 2. We show that I) = I1 ) when 2 = 1. The calclation is straightforward: This verifies or claim. I1 ) = 1 1 ) log e = 1 log e1 1 1 = I). 4.17) Corollary 4.4. Take H 1 a single edge and H 2 a finite simple graph with p 2 edges. The associated phase transition crve β 2 = rβ 1 ) lies above the straight line β 2 = β 1 when p 3, and is exactly portion of the straight line β 2 = β 1 β 1 3) when p = 2. Proof. From the proof of Theorem 4.1, there are two global maximizers 1 and 2 for l) along the phase transition crve β 2 = rβ 1 ), with and 0 < 1 < 0 < 2 < 1. Frthermore, the y-coordinate β2 c of the critical point βc 1, βc 2 ) is always positive. On the straight line β 1 + β 2 = 0, we rewrite l) = β 1 p ) 1 2 I). First sppose p = 2. Since I) and 2 are both symmetric abot the line = 1 2, two global maximizers 1 and 2 exist for l). Next consider the generic case p > 2. Analytical calclations give that p < 1 ) 1 ) p for 0 < < 1 2. Since I) is symmetric, this says that for β 1 < 0 resp. β 2 > 0), the global maximizer of l) satisfies 1 2. This implies the desired reslt. 5. Frther discssion Bt what if the common distribtion µ on the edge weights does not have finite spport? Unfortnately, we do not have a generic large deviation principle in this case. As an example, we will examine the asymptotic phase strctre for a completely solvable exponential model and hope the analysis wold provide some inspiration. Let G n G n be an edge-weighted directed labeled graph on n vertices, where the edge weights x ij from vertex i to vertex j are iid real random variables whose common distribtion µ is standard Gassian. As in the ndirected case, 14

15 Phase transitions in edge-weighted exponential random graphs l') * 2 * l) Figre 6. Along the phase transition crve rβ 1 ), l) has two local maximizers 1 and 2, and both are global maximizers for l). Graph drawn for β 1 = 5, β 2 = 5, and p = 2. the common distribtion for the edge weights yields probability measre P n and the associated expectation E n on G n. Give the set of sch graphs the probability )) P β ng n ) = exp n 2 β 1 eg n ) + β 2 sg n ) ψn β P n G n ), 5.1) where β = β 1, β 2 ) are 2 real parameters, H 1 is a directed edge, H 2 is a directed 2-star, eg n ) and sg n ) are respectively the directed edge and 2-star homomorphism densities of G n, eg n ) = 1 n 2 x ij, sg n ) = 1 n 3 x ij x ik, 5.2) 1 i,j n and ψ β n is the normalization constant, 1 i,j,k n ψ β n = 1 n 2 log E n exp n 2 β 1 eg n ) + β 2 sg n )) )). 5.3) The associated expectation E β n may be defined accordingly, and a phase transition occrs when the limiting normalization constant ψ β = lim n ψβ n has a singlar point. Plgging the formlas for eg n ) and sg n ) into 5.3) and sing the iid property of the edge weights, we have 2 ψn β = 1 n 2 log E n exp β 1 n n i=1 j=1 x ij = 1 exp n log E β 1 Y + β )) 2 n Y 2, + β 2 n n n i=1 j=1 x ij 5.4) where Y = n j=1 x 1j satisfies a Gassian distribtion with mean 0 and variance n, and E is the associated expectation. We compte, for β 2 < 1 2, E exp β 1 Y + β 2 n Y 2 )) = e β 1y+ β 2 n y 2 1 e y2 nβ n dy = e 21 2β 2), 5.5) 2πn 1 2β2 15

16 Mei Yin which implies that ψ β = β β 2 ). 5.6) This is a smooth fnction in terms of the parameters β 1 and β 2, and so ψ β does not admit a phase transition. Acknowledgements This work originated at the Special Session on Topics in Probability at the 2016 AMS Western Spring Sectional Meeting, organized by Tom Alberts and Arjn Krishnan. Mei Yin s research was partially spported by NSF grant DMS She thanks Sean O Rorke and Lingjiong Zh for helpfl conversations. References [1] Aldos, D.: Representations for partially exchangeable arrays of random variables. J. Mltivariate Anal. 11, ) [2] Aldos, D., Lyons, R.: Processes on nimodlar random networks. Electron. J. Probab. 12, ) [3] Aristoff, D., Zh, L.: Asymptotic strctre and singlarities in constrained directed graphs. Stochastic Process. Appl. 125, ) [4] Benjamini, I., Schramm, O.: Recrrence of distribtional limits of finite planar graphs. Electron. J. Probab. 6, ) [5] Bhamidi, S., Bresler, G., Sly, A.: Mixing time of exponential random graphs. Ann. Appl. Probab. 21, ) [6] Borgs, C., Chayes, J., Cohn, H., Zhao, Y.: An L p theory of sparse graph convergence I. Limits, sparse random graph models, and power law distribtions. arxiv: ) [7] Borgs, C., Chayes, J., Cohn, H., Zhao, Y.: An L p theory of sparse graph convergence II. LD convergence, qotients, and right convergence. arxiv: ) [8] Borgs, C., Chayes, J., Lovász, L., Sós, V.T., Vesztergombi, K.: Conting graph homomorphisms. In: Klazar, M., Kratochvil, J., Loebl, M., Thomas, R., Valtr, P. eds.) Topics in Discrete Mathematics, Volme 26, pp Springer, Berlin 2006) [9] Borgs, C., Chayes, J.T., Lovász, L., Sós, V.T., Vesztergombi, K.: Convergent seqences of dense graphs I. Sbgraph freqencies, metric properties and testing. Adv. Math. 219, ) [10] Borgs, C., Chayes, J.T., Lovász, L., Sós, V.T., Vesztergombi, K.: Convergent seqences of dense graphs II. Mltiway cts and statistical physics. Ann. of Math. 176, ) [11] Chatterjee, S., Dembo, A.: Nonlinear large deviations. Adv. Math. 299, ) [12] Chatterjee, S., Diaconis, P.: Estimating and nderstanding exponential random graph models. Ann. Statist. 41, ) [13] Chatterjee, S., Varadhan, S.R.S.: Large deviations for random matrices. Commn. Stoch. Anal. 6, ) [14] Fienberg, S.E.: Introdction to papers on the modeling and analysis of network data. Ann. Appl. Statist. 4, ) [15] Fienberg, S.E.: Introdction to papers on the modeling and analysis of network data-ii. Ann. Appl. Statist. 4, ) [16] Frank, O., Strass, D.: Markov graphs. J. Amer. Statist. Assoc. 81, ) [17] Häggström, O., Jonasson, J.: Phase transition in the random triangle model. J. Appl. Probab. 36, ) [18] Hoover, D.: Row-colmn exchangeability and a generalized model for probability. In: Koch, G., Spizzichino, F. eds.) Exchangeability in Probability and Statistics, pp North-Holland, Amsterdam 1982) [19] Hnter, D.R., Handcock, M.S., Btts, C.T., Goodrea, S.M., Morris, M.: ergm: A package to fit, simlate and diagnose exponential-family models for networks. J. Statist. Softw. 24, ) [20] Kenyon, R., Radin, C., Ren, K., Sadn, L.: Mltipodal strctre and phase transitions in large constrained graphs. arxiv: ) 16

17 Phase transitions in edge-weighted exponential random graphs [21] Kenyon, R., Yin, M.: On the asymptotics of constrained exponential random graphs. arxiv: ) [22] Krivitsky, P.N.: Exponential-family random graph models for valed networks. Electron. J. Stat. 6, ) [23] Lovász, L.: Large Networks and Graph Limits. American Mathematical Society, Providence 2012) [24] Lovász, L., Szegedy B.: Limits of dense graph seqences. J. Combin. Theory Ser. B 96, ) [25] Lbetzky, E., Zhao, Y.: On the variational problem for pper tails in sparse random graphs. arxiv: ) [26] Lbetzky, E., Zhao, Y.: On replica symmetry of large deviations in random graphs. Random Strctres Algorithms 47, ) [27] Newman, M.: Networks: An Introdction. Oxford University Press, New York 2010) [28] Radin, C., Sadn, L.: Phase transitions in a complex network. J. Phys. A 46, ) [29] Radin, C., Sadn, L.: Singlarities in the entropy of asymptotically large simple graphs. J. Stat. Phys. 158, ) [30] Radin, C., Yin, M.: Phase transitions in exponential random graphs. Ann. Appl. Probab. 23, ) [31] Robins, G.L., Pattison, P.E., Wasserman, S.: Logit models and logistic regressions for social networks: III. Valed relations. Psychometrika 64, ) [32] Snijders, T.A.B., Pattison, P., Robins, G.L., Handcock, M.: New specifications for exponential random graph models. Sociol. Methodol. 36, ) [33] Wasserman, S., Fast, K.: Social Network Analysis: Methods and Applications. Cambridge University Press, Cambridge 2010) [34] Wilson, J.D., Denny, M.J., Bhamidi, S., Cranmer, S., Desmarais, B.: Stochastic weighted graphs: Flexible model specification and simlation. arxiv: ) [35] Yang, C.N., Lee, T.D.: Statistical theory of eqations of state and phase transitions. Phys. Rev. 87, ) [36] Zia, R.K.P., Redish, E.F., McKay, S.: Making sense of the Legendre transform. Amer. J. Phys. 77, ) Department of Mathematics, University of Denver, Denver, CO 80208, USA address: mei.yin@d.ed 17