arxiv: v1 [math.pr] 17 Dec 2007

Transcription

1 GRAPH LIMITS AND EXCHANGEABLE RANDOM GRAPHS arxiv: v1 [math.pr] 17 Dec 2007 PERSI DIACONIS AND SVANTE JANSON Abstract. We evelo a clear connection between efinetti s theorem for exchangeable arrays (work of Alous Hoover Kallenberg) an the emerging area of grah limits (work of Lovász an many coauthors). Along the way, we translate the grah theory into more classical robability. 1. Introuction DeFinetti s rofoun contributions are now woven into many arts of robability, statistics an hilosohy. Here we show how eveloments from efinetti s work on artial exchangeability have a irect link to the recent eveloment of a limiting theory for large grahs. This introuction first recalls the theory of exchangeable arrays (Section 1.1). Then, the subject of grah limits is outline (Section 1.2). Finally, the link between these ieas, which forms the bulk of this aer, is outline (Section 1.3) Exchangeability, artial exchangeability an exchangeable arrays. Let {X i }, 1 i <, be a sequence of binary ranom variables. They are exchangeable if P(X 1 = e 1,...,X n = e n ) = P(X 1 = e σ(1),...,x n = e σ(n) ) for all n, ermutations σ S n an all e i {0,1}. The celebrate reresentation theorem says Theorem 1.1 (efinetti). If {X i }, 1 i <, is a binary exchangeable sequence, then: (i) With robability 1, X = lim 1 n (X 1 + +X n ) exists. (ii) If µ(a) = P{X A}, then for all n an e i, 1 i n, for s = e 1 + +e n. P(X 1 = e 1,...,X n = e n ) = 1 0 x s (1 x) n s µ(x) (1.1) It is natural to refine an exten efinetti s theorem to allow more general observables(x i withvalues inapolishsace) anothernotions ofsymmetry (artial exchangeability). A efinitive treatment of these eveloments is Date: December 10,

2 2 PERSI DIACONIS AND SVANTE JANSON given in Kallenberg [15]. Of interest here is the extension of efinetti s theorem to two-imensional arrays. Definition. Let {X ij }, 1 i,j <, be binary ranom variables. They are searately exchangeable if P(X ij = e ij, 1 i,j n) = P(X ij = e σ(i)τ(j), 1 i,j n) (1.2) for all n, all ermutations σ,τ S n an all e ij {0,1}. They are (jointly) exchangeable if (1.2) hols in the secial case τ = σ. Equivalently, thearray{x ij }isjointlyexchangeableifthearray{x σ(i)σ(j) } has the same istribution as {X ij } for every ermutation σ of N, an similarly for searate exchangeability. The question of two-imensional versions of efinetti s theorem uner (searate) exchangeability arose from the statistical roblems of two-way analysis of variance. Early workers execte a version of(1.1) with erhas a two-imensional integral. The robabilist Davi Alous [1] an the logician Douglas Hoover [14] foun that the answer is more comlicate. Define a ranom binary array {X ij } as follows: Let U i,v j, 1 i,j <, be ineenent an uniform in [0,1]. Let W(x,y) be a function from [0,1] 2 to [0,1]. Let X ij be 1 or 0 as a W(U i,v j )-coin comes u heas or tails. Let P W bethe robability istribution of {X ij }, 1 i,j <. Thefamily {X ij } is searately exchangeable because of the symmetry of the construction. The Alous Hoover theorem says that any searately exchangeable binary array is a mixture of such P W : Theorem 1.2 (Alous Hoover). Let X = {X ij }, 1 i,j <, be a searately exchangeable binary array. Then, there is a robability µ such that P{X A} = P W (A)µ(W). There is a similar result for jointly exchangeable arrays. The uniqueness of µ resiste unerstaning; if Ŵ is obtaine from W by a measure-reserving change of each variable, clearly the associate rocess { X ij } has the same joint istribution as {X ij }. Using moel theory, Hoover [14] was able to show that this was the only source of non-uniqueness. A robabilist s roof was finally foun by Kallenberg, see [15, Sect. 7.6] for etails an references. These results hol for higher imensional arrays with X ij taking values in a Polish sace with minor change [15, Cha. 7]. The escrition above has not mentione several elegant results of the theory. In articular, Kallenberg s sreaable version of the theory relaces invariance uner a grou by invariance uner subsequences. A variety of tail fiels may be introuce to allow characterizing when W takes values in {0,1} [10, Sect. 4]. Much more general notions of artial exchangeability are stue in [11].

3 GRAPH LIMITS AND EXCHANGEABLE RANDOM GRAPHS Grah limits. Large grahs, both ranom an eterministic, aboun in alications. They arise from the internet, social networks, gene regulation, ecology an in mathematics. It is natural to seek an aroximation theory: What oes it mean for a sequence of grahs to converge? When can a large comlex grah be aroximate by a small grah? In a sequence of aers [6, 7, 8, 9, 13, 16, 17, 18, 21, 20, 22, 19], Laszlo Lovász with coauthors (liste here in orer of frequency) V. T. Sós, B. Szegey, C. Borgs, J. Chayes, K. Vesztergombi, A. Schrijver, M. Freeman have eveloe a beautiful, unifying limit theory. This shes light on toics such as grah homomorhisms, Szemerei s regularity lemma, quasi-ranom grahs, grah testing an extremal grah theory. Their theory has been eveloe for ense grahs (number of eges comarable with the square of number of vertices) but arallel theories for sarse grahs are beginning to emerge [4]. Roughly, a growing sequence of finitegrahs G n converges if, for any fixe grah F, the roortion of coies of F in G n converges. Section 2 below has recise efinitions. Examle 1.3. Define a robability istribution on grahs on n-vertices as follows. Fli a θ-coin for each vertex(iviing vertices into boys an girls ). Connect two boys with robability. Connect two girls with robability. Connect a boy an a girl with robability. Thus, if = = 0, = 1, we have a ranom biartite grah. If = = 1, = 0, we have two isjoint comlete grahs. If = =, we have the Erös Renyi moel. As n grows, these moels generate a sequence of ranom grahs which converge almost surely to a limiting object escribe below. More substantial examles involving ranom threshol grahs are in [12]. If a sequence of grahs converges, what oes it converge to? For exchangeable ranom grahs (efine below), there is a limiting object which may be thought of as a robability measure on infinite ranom grahs. Suose W(x,y) = W(y,x) is a function from [0,1] 2 [0,1]. Choose {U i }, 1 i <, ineenent uniformly istribute ranom variables on [0,1]. Form an infinite ranom grah by utting an ege from i to j with robability W(U i,u j ). This measure on grahs (or alternatively W) is the limiting object. For the boys an girls examle above, W may be icture as θ 0 θ 1 The theory eveloe shows that various roerties of G n can be well aroximate by calculations with the limiting object. There is an elegant

4 4 PERSI DIACONIS AND SVANTE JANSON characterization of these continuous grah roerties with alications to algorithms for grah testing (Does this grah contain an Eulerian cycle?) or arameter estimation (What is an aroximation to the size of the maximum cut?). Thereisaractical way tofinusefularoximationstoalargegrah by grahs of fixe size [6]. This aer also contains a useful review of the current state of the theory with roofs an references. We have sketche the theory for unweighte grahs. There are generalizations to grahs with weights on vertices an eges, to biartite, irecte an hyergrahs. The sketch leaves out many nice eveloments. For examle, the useful cut metric between grahs [19] an connections to statistical hysics [9] Overview of the resent aer. There is an aarent similarity between the measure P W of the Alous Hoover theorem an the limiting object W from grah limits. Roughly, working with symmetric W gives the grah limit theory; working with general W gives irecte grahs. The main results of this aer make these connections recise. Basic efinitions are in Section 2 which introuces a robabilist s version of grah convergence equivalent to the efinition using grah homomorhisms. Section 3 uses the well-establishe theory of weak convergence of a sequence of robability measures on a metric sace to get roerties of grah convergence. Section 4 carries things over to infinite grahs. The main results aear in Section 5. This introuces exchangeable ranom grahs an gives a one-to-one corresonence between infinite exchangeable ranom grahs an istributions on the sace of roer grah limits (Theorem 5.3), which secializes to a one-to-one corresonence between roer grah limits an extreme oints in the set of istributions of exchangeable ranom grahs (Corollary 5.4). A useful characterization of the extreme oints of the set of exchangeable ranom grahs is in Theorem 5.5. These results are translate to the equivalence between roer grah limits an the Alous Hoover theory in Section 6. The non-uniqueness of the reresenting W, for exchangeable ranom grahs an for grah limits, is iscusse in Section 7. The equivalence involves symmetric W(x, y) an a single ermutation σ taking W(U i,u j ) to W(U σ(i),u σ(j) ). The original Alous Hoover theorem, witherhasnon-symmetricw(x,y)anw(u i,v j )tow(u σ(i),v τ(j) )translates to a limit theorem for biartite grahs. This is eveloe in Section 8. The thir case of the Alous Hoover theory for two-imensional arrays, erhas non-symmetric W(x, y) an a single ermutation σ, corresons to irecte grahs; this is sketche in Section 9. The extensions to weighte grahs are covere by allowing X ij to take general values in the Alous Hoover theory. The extension to hyergrahs follows from the Alous Hoover theory for higher-imensional arrays. (The etails of these extensions are left to the reaer.)

5 GRAPH LIMITS AND EXCHANGEABLE RANDOM GRAPHS 5 Desite these arallels, the theories have much to contribute to each other. The algorithmic, grah testing, Szemerei artitioning ersective is new to exchangeability theory. Inee, the boys an girls ranom grah was introuce to stuy the sychology of vision in Diaconis Freeman (1981). As far as we know, its grah theoretic roerties have not been stuie. The various eveloments aroun shell-fiels in exchangeability, which characterize zero/one W(x, y), have yet to be translate into grah-theoretic terms. Acknowlegements. This lecture is an extene version of a talk resente by PD at the 100th anniversary of efinetti s birth in Rome, We thank the organizers. This work was artially fune by the French ANR s Chaire excellence grant to PD. SJ thanks Christian Borgs an Jennifer Chayes for insiration from lectures an iscussions uring the Oberwolfach meeting Combinatorics, Probability an Comuting, hel in November, Parts of the research were comlete uring a visit by SJ to the Université e Nice - Sohia Antiolis in January Definitions an basic roerties All grahs will be simle. Infinite grahs will be imortant in later sections, but will always be clearly state to be infinite; otherwise, grahs will be finite. We enote the vertex an ege sets of a grah G by V(G) an E(G), an the numbers of vertices an eges by v(g) := V(G) an e(g) := E(G). We consier both labelle an unlabelle grahs; the labels will be the integers 1,...,n, where n is the number of vertices in the grah. A labelle grah is thus a grah with vertex set [n] := {1,...,n} for some n 1; we let L n enote the set of the 2 (n 2) labelle grahs on [n] an let L := n=1 L n. An unlabelle grah can be regare as a labelle grah where we ignore the labels; formally, we efine U n, the set of unlabelle grahs of orer n, as the quotient set L n / = of labelle grahs moulo isomorhisms. We let U := n=1 U n = L/ =, the set of all unlabelle grahs. Note that we can, an often will, regar a labelle grah as an unlabelle grah. If G is an (unlabelle) grah an v 1,...,v k is a sequence of vertices in G, then G(v 1,...,v k ) enotes the labelle grah with vertex set [k] where we ut an ege between i an j if v i an v j are ajacent in G. We allow the ossibility that v i = v j for some i an j. (In this case, there is no ege ij because there are no loos in G.) We let G[k], for k 1, be the ranom grah G(v 1,...,v k ) obtaine by samling v 1,...,v k uniformly at ranom among the vertices of G, with relacement. In other wors, v 1,...,v k are ineenent uniformly istribute ranom vertices of G. For k v(g), we further let G[k] be the ranom grah G(v 1,...,v k ) where we samle v 1,...,v k uniformly at ranom without relacement; the

6 6 PERSI DIACONIS AND SVANTE JANSON sequence v 1,...,v k is thus a uniformly istribute ranom sequence of k istinct vertices. Thegrahlimittheoryin[19]ansubsequentaersisbaseonthestuy of the functional t(f,g) which is efine for two grahs F an G as the roortion of all maings V(F) V(G) that are grah homomorhisms F G, i.e., ma ajacent vertices to ajacent vertices. In robabilistic terms, t(f,g) is the robability that a uniform ranom maing V(F) V(G) is a grah homomorhism. Using the notation introuce above, we can, equivalently, write this as, assuming that F is labelle an k = v(f), t(f,g) := P ( F G[k] ). (2.1) Note that both F an G[k] are grahs on [k], so the relation F G[k] is well-efine as containment of labelle grahs on the same vertex set, i.e. as E(F) E(G[k]). Although the relation F G[k] may een on the labelling of F, the robability in (2.1) oes not, by symmetry, so t(f,g) is really well efine by (2.1) for unlabelle F an G. With F, G an k as in (2.1), we further efine, again following [19] (an the notation of [8]) but stating the efinitions in ifferent but equivalent forms, an t inj (F,G) := P ( F G[k] ) (2.2) t in (F,G) := P ( F = G[k] ), (2.3) rovief angare(unlabelle)grahswithv(f) v(g). Ifv(F) > v(g) we set t inj (F,G) := t in (F,G) := 0. Since the robability that a ranom samle v 1,...,v k of vertices in G contains some reeate vertex is k 2 /(2v(G)), it follows that [19] t(f,g) tinj (F,G) v(f) 2 2v(G). (2.4) Hence, when consiering asymtotics with v(g), it oes not matter whether we use t or t inj. Moreover, if F L k, then, as ointe out in [8] an [19], t inj (F,G) = t in (F,G) (2.5) an, by inclusion-exclusion, t in (F,G) = F L k, F F F L k, F F ( 1) e(f ) e(f) t inj (F,G). (2.6) Hence, the two families {t inj (F, )} F U an {t in (F, )} F U of grah functionals contain the same information an can relace each other. The basic efinition of Lovász an Szegey[19] an Borgs, Chayes, Lovász, Sós an Vesztergombi [8] is that a sequence (G n ) of grahs converges if

7 GRAPH LIMITS AND EXCHANGEABLE RANDOM GRAPHS 7 t(f,g n ) converges for every grah F. We can exress this by consiering the ma τ : U [0,1] U efine by τ(g) := (t(f,g)) F U [0,1] U. (2.7) Then (G n ) converges if an only if τ(g n ) converges in [0,1] U, equie with the usual rouct toology. Note that [0,1] U is a comact metric sace; as is well known, a metric can be efine by, for examle, ( (x F ),(y F ) ) := 2 i x Fi y Fi, (2.8) i=0 where F 1,F 2,... is some enumeration of all unlabelle grahs. We efine U := τ(u) [0,1] U to be the image of U uner this maing τ, an let U be the closure of U in [0,1] U. Thus U is a comact metric sace. (For exlicit escritions of the subset U of [0,1] U as a set of grah functionals, see Lovász an Szegey [19].) As ointe out in [19] an [8] (in equivalent terminology), τ is not injective; for examle, τ(k n,n ) is the same for all comlete biartite grahs K n,n. Nevertheless, as in [19] an [8], we can consier a grah G as an element of U by ientifying G an τ(g) (thus ientifying grahs with the same τ(g)), an then convergence of (G n ) as efine above is equivalent to convergence in U. The limit is thus an element of U, but tyically not a grah in U. The main result of Lovász an Szegey [19] is a reresentation of the elements in U to which we will return in Section 6. Remark 2.1. As sai above, U is a comact metric sace, an it can be given several equivalent metrics. One metric is the metric (2.8) inherite from [0,1] U, which for grahs becomes (G,G ) = i 2 i t(f i,g) t(f i,g ). Anothermetric, shownbyborgs, Chayes, Lovász, SósanVesztergombi [8] to be equivalent, is the cut-istance δ, see [8] for efinitions. Further characterizations of convergence of sequences of grahs in U are given in Borgs, Chayes, Lovász, Sós an Vesztergombi [8, 9]. The ientification of grahs with the same image in U (i.e., with the same t(f, ) for all F) is sometimes elegant but at other times inconvenient. It can be avoie if we instea let U + be the union of U an some one-oint set { } an consier the maing τ + : U [0,1] U+ = [0,1] U [0,1] efine by τ + (G) = ( τ(g), v(g) 1). (2.9) Then τ + is injective, because if τ(g 1 ) = τ(g 2 ) for two grahs G 1 an G 2 with the same number of vertices, then G 1 an G 2 are isomorhic an thus G 1 = G 2 as unlabelle grahs. (This can easily be shown irectly: it follows from (2.1) that G 1 [k] = G 2 [k] for every k, which imlies G 1 [k] = G2 [k] for every k v(g 1 ) = v(g 2 ); now take k = v(g 1 ). It is also a consequence of [8, Theorem 2.7 an Theorem 2.3 or Lemma 5.1].)

8 8 PERSI DIACONIS AND SVANTE JANSON Consequently, we can ientify U with its image τ + (U) [0,1] U+ an efine U [0,1] U+ as its closure. It is easily seen that a sequence (G n ) of grahsconverges in U if an only if either v(g n ) an(g n ) converges in U, or the sequence (G n ) is constant from some n 0 on. Hence, convergence in U is essentially the same as the convergence consiere by by Lovász an Szegey [19], but without any ientification of non-isomorhic grahs of ifferent orers. Alternatively, we can consier τ inj or τ in efine by τ inj (G) := (t inj (F,G)) F U [0,1] U, τ in (G) := (t in (F,G)) F U [0,1] U. It is easy to see that both τ inj an τ in are injective maings U [0,1] U. (If τ inj (F,G 1 ) = τ inj (F,G 2 ) for all F, we take F = G 1 an F = G 2 an conclue G 1 = G 2, using our secial efinition above when v(f) > v(g).) Hence, we can again ientify U with its image an consier its closure U in [0,1] U. Moreover, using (2.4), (2.5), an (2.6), it is easily shown that if (G n ) is a sequence of unlabelle grahs, then τ + (G n ) converges τ in (G n ) converges τ inj (G n ) converges. Hence, thethreecomactificationsτ + (U), τ inj (U),τ in (U)arehomeomorhic an we can use any of them for U. We let U := U \U; this is the set of all limit objects of sequences (G n ) in U with v(g n ). (I.e., it is the set of all roer grah limits.) We will in the sequel refer to use U rather than U, thus not ientifying some grahs of ifferent orers, nor ientifying finite grahs with some limit objects in U. For every fixe grah F, the functions t(f, ), t inj (F, ) an t in (F, ) have unique continuous extensions to U, for which we use the same notation. We similarly exten v( ) 1 continuously to U by efining v(g) = an thus v(g) 1 = 0 for G U := U \ U. Then (2.4), (2.5) an (2.6) hol for all G U, where (2.4) means that t inj (F,G) = t(f,g), G U. (2.10) Note that U is a comact metric sace. Different, equivalent, metrics are given by the embeings τ +, τ inj, τ in into [0,1] U+ an [0,1] U. Another equivalent metric is, by Remark 2.1 an the efinition of τ +, δ (G 1,G 2 )+ v(g 1 ) 1 v(g 2 ) 1. We summarize the results above on convergence. Theorem 2.1. A sequence (G n ) of grahs converges in the sense of Lovász an Szegey [19] if an only if it converges in the comact metric sace U. Moreover, if v(g n ), the sequence (G n ) converges in this sense if an only if it converges in U.

9 GRAPH LIMITS AND EXCHANGEABLE RANDOM GRAPHS 9 The rojection π : [0,1] U+ = [0,1] U [0,1] [0,1] U mas τ + (G) to τ(g) for every grah G, so by continuity it mas U into U. For grah G U, π(g) = τ(g) is the object in U corresoning to G consiere above, an we will in the sequel enote this object by π(g); recall that this rojection U U is not injective. (We thus istinguish between a grah G an its ghost π(g) in U. Recall that when grahs are consiere as elements of U as in [19] an [8], certain grahs are ientifie with each other; we avoi this.) On the other han, an element G of U is by efinition etermine by τ(g) an v(g) 1, cf. (2.9), so the restriction π : U n U is injective for each n. In articular, π : U U is injective. Moreover, this ma is surjective because every element G U is the limit of some sequence (G n ) of grahs in U with v(g n ) ; by Theorem 2.1, this sequence converges in U to some element G, an then π(g ) = G. Since U is comact, the restriction of π to U is thus a homeomorhism, an we have the following theorem, saying that we can ientify the set U of roer grah limits with U. Theorem 2.2. The rojection π mas the set U := U \U of roer grah limits homeomorhically onto U. 3. Convergence of ranom grahs A ranom unlabelle grah is a ranom element of U (with any istribution; we o not imly any articular moel). We consier convergence of a sequence (G n ) of ranom unlabelle grahs in the larger sace U; recall that this is a comact metric sace so we may use the general theory set forth in, for examle, Billingsley [2]., a.s. We use the stanar notations, for convergence in istribution, robability, an alsmost surely, resectively. We will only consier the case when v(g n ), at least in robability. (The reaer may think of the case when G n has n vertices, although that is not necessary in general.) We begin with convergence in istribution. Theorem 3.1. Let G n, n 1, be ranom unlabelle grahs an assume that v(g n ). The following are equivalent, as n. (i) G n Γ for some ranom Γ U. (ii) For every finite family F 1,...,F m of (non-ranom) grahs, the ranom variables t(f 1,G n ),...,t(f m,g n ) converge jointly in istribution. (iii) For every (non-ranom) F U, the ranom variables t(f,g n ) converge in istribution. (iv) For every (non-ranom) F U, the exectations Et(F,G n ) converge. If these roerties hol, then the limits in (ii), (iii) an (iv) are ( t(f i,γ) ) m i=1, t(f,γ) an Et(F,Γ), resectively. Furthermore, Γ U a.s.

10 10 PERSI DIACONIS AND SVANTE JANSON The same results hol if t is relace by t inj or t in. Proof. (i) (ii). Since U is a close subset of [0,1] U+, convergence in istributioninu isequivalenttoconvergenceofτ + (G n ) = ( (t(f,g n )) F U, v(g n ) 1) in [0,1] U+, Since we assume v(g n ) 1 0, this is equivalent to convergence of (t(f,g n )) F U in [0,1] U [2, Theorem 4.4], which is equivalent to convergence in istribution of all finite families (t(f i,g n )) m i=1. (ii) = (iii). Trivial. (iii) = (iv). Immeiate, since t is boune (by 1). (iv) = (ii). Let F 1,...,F m be fixe grahs an let l 1,...,l m be ositive integers. Let F be the isjoint union of l i coies of F i, i = 1,...,m. Then, for every G U, from the efinition of t, an hence E t(f,g) = m t(f i,g) l i, i=1 m t(f i,g) l i = Et(F,G). (3.1) i=1 Consequently, if (iv) hols, then every joint moment E m i=1 t(f i,g) l i of t(f 1,G n ),...,t(f m,g n ) converges. Since t(f i,g n ) are boune (by 1), this imlies joint convergence in istribution by the metho of moments. The ientification of the limits is immeiate. Since v(g n ), (i) imlies that v(γ) = a.s., an thus Γ U. Finally, it follows from (2.4), (2.5) an (2.6) that we can relace t by t inj or t in in (ii) an (iv), an the imlications (ii) = (iii) an (iii) = (iv) are immeiate for t inj an t in too. Secializing to the case of a non-ranom limit G U, we obtain the corresoning result for convergence in robability. Corollary 3.2. Let G n, n 1, be ranom unlabelle grahs such that v(g n ), an let G U. The following are equivalent, as n. (i) G n G. (ii) t(f,g n ) t(f,g) for every (non-ranom) F U. (iii) Et(F,G n ) t(f,g) for every (non-ranom) F U. The same result hols if t is relace by t inj or t in. Note further that uner the same assumtions, it follows irectly from a.s. Theorem 2.1 that G n G if an only if t(f,g n ) a.s. t(f,g) for every F U. We observe another corollary to Theorem 3.1 (an its roof).

11 GRAPH LIMITS AND EXCHANGEABLE RANDOM GRAPHS 11 Corollary 3.3. If Γ is a ranom element of U = U \ U = U, then, for every sequence F 1,...,F m of grahs, ossibly with reetitions, m E t(f i,γ) = Et( m i=1 F i,γ), (3.2) i=1 where m i=1 F i enotes the isjoint union of F 1,...,F m. As a consequence, the istribution of Γ is uniquely etermine by the numbers Et(F,Γ), F U. Alternatively, the istribution of Γ is uniquely etermine by the numbers Et in (F,Γ), F U. Proof. Since U is ense in U U, there exists ranom unlabelle grahs a.s. G n such that G n Γ. In articular, G n Γ an v(g n ) (in fact, we may assume v(g n ) = n), so Theorem 3.1 an its roof aly, an (3.2) follows from (3.1) alie to G n by letting n. For the final statement, note that (3.2) shows that the exectations Et(F,Γ), F U, etermine all moments E m i=1 t(f i,γ), an thus the joint istribution of t(f,γ), F U, which is the same as the istribution of τ(γ) = ( t(f,γ) ) F U [0,1]U, an we have efine U such that we ientify Γ an τ(γ). Finally, the numbers Et in (F,Γ), F U, etermine all Et(F,Γ) by (2.5), recalling that t inj (F,Γ) = t(f,γ) by (2.10). Remark 3.1. The numbers Et(F,Γ) for a ranom Γ U thus lay a role similar to the one laye by moments for a ranom variable. (An the relation between Et(F,Γ) an Et in (F,Γ) has some resemblance to the relation between moments an cumulants.) 4. Convergence to infinite grahs We will in this section consier also labelle infinite grahs with the vertex set N = {1,2,...}. Let L enote the set of all such grahs. These grahs are etermine by their ege sets, so L can be ientifie with the ower set P(E(K )) of all subsets of the ege set E(K ) of the comlete infinite grah K, an thus with the infinite rouct set {0,1} E(K ). We give this sace, an thus L, the rouct toology. Hence, L is a comact metric sace. It is sometimes convenient to regar L n for a finite n as a subset of L : we can ientify grahs in L n an L with the same ege set. In other wors, if G L n is a grah with vertex set [n], we a an infinite number of isolate vertices n+1,n+2,... to obtain a grah in L. Conversely, if H L is an infinite grah, we let H [n] L n be the inuce subgrah of H with vertex set [n]. If G is a (finite) grah, let Ĝ be the ranom labelle grah obtaine by a ranom labelling of the vertices of G by the numbers 1,...,v(G). (If G is labelle, we thus ignore the labels an ranomly relabel.) Thus Ĝ is a ranom finite grah with the same number of vertices as G, but as just sai, we can (an will) also regar Ĝ as a ranom grah in L.

12 12 PERSI DIACONIS AND SVANTE JANSON We use the same notation Ĝ also for a ranom (finite) grah G given a ranom labelling. Theorem 4.1. Let (G n ) be a sequence of ranom grahs in U an assume that v(g n ). Then the following are equivalent. (i) G n Γ in U for some ranom Γ U. (ii) Ĝn H in L for some ranom H L. If these hol, then P(H [k] = F) = Et in (F,Γ) for every F L k. Furthermore, Γ U a.s. Proof. Let G be a labelle grah an consier the grah Ĝ [k], assuming k v(g). This ranom grah equals G[k] = G(v 1,...,v k ), where v 1,...,v k are k vertices samle at ranom without relacement as in Section 2. Hence, by (2.3), for every F L k, P(Ĝ [k] = F) = t in (F,G), Alie to the ranom grah G n, this yiels if k v(g). Et in (F,G n ) P(Ĝn [k] = F) Et in (F,G n )+P ( v(g n ) < k ). (4.1) By assumtion, P (v(g n ) < k) 0 as n, an it follows from (4.1) an Theorem 3.1 that G n Γ in U if an only if P(Ĝn [k] = F) Et in (F,Γ) (4.2) for every k 1 an every F L k. Since L k is a finite set, (4.2) says that, for every k, Ĝ n [k] H k for some ranom grah H k L k with P(H k = F) = Et in (F,Γ) for F L k. Since L has the rouct toology, this imlies Ĝn H in L for some ranom H L with H [k] = Hk. Conversely, if Ĝn H in L, then Ĝn [k] H [k] so the argument above shows that Et in (F,G n ) = P(Ĝn [k] = F)+o(1) P(H [k] = F) as n, for every F L k, an Theorem 3.1 yiels the existence of some ranom Γ U U with G n Γ an Et in (F,Γ) = P(H [k] = F). 5. Exchangeable ranom grahs Definition. A ranominfinitegrahh L is exchangeable if its istribution is invariant uner every ermutation of the vertices. (It is well-known that it is equivalent to consier only finite ermutations, i.e., ermutations σ of N that satisfy σ(i) = i for all sufficiently large i, so σ may be regare as a ermutation in S n for some n.) Equivalently, if X ij := 1[ij H] is the inicator of there being an ege ij in H, then the array {X ij }, 1 i,j, is (jointly) exchangeable as efine in Section 1.

13 GRAPH LIMITS AND EXCHANGEABLE RANDOM GRAPHS 13 Lemma 5.1. Let H be a ranom infinite grah in L. Then the following are equivalent. (i) H is exchangeable. (ii) H [k] has a istribution invariant uner all ermutations of [k], for every k 1. (iii) P ( H [k] = F ) eens only on the isomorhism tye of F, an can thus be seen as a function of F as an unlabelle grah in U k, for every k 1. Proof. (i) = (ii). Immeiate. (ii) = (i). If σ is a finite ermutation of N, then σ restricts to a ermutation of [k] for every large k, an it follows that if H σ is H with the vertices ermute by σ, then, for all large k H σ [k] = H [k] σ = H [k], which imlies H σ = H. (ii) (iii). Trivial. Theorem 5.2. The limit H is Theorem 4.1 is exchangeable. Proof. H satisfies Lemma 5.1(iii). Moreover, Theorem 4.1 imlies the following connection with ranom elements of U. Theorem 5.3. There is a one-to-one corresonence between istributions of ranom elements Γ U (or U ) an istributions of exchangeable ranom infinite grahs H L given by Et in (F,Γ) = P(H [k] = F) (5.1) for every k 1 an every F L k, or, equivalently, Et(F,Γ) = P(H F) (5.2) for every F L. Furthermore, H [n] Γ in U as n. Proof. Note first that (5.1) an (5.2) are equivalent by (2.5) an (2.6), since t(f,γ) = t inj (F,Γ) by (2.10), an H F if an only if H [k] F when F L k. Suose that Γ is a ranom element of U U. Since U is ense in U, there exist (as in the roof of Corollary 3.3) ranom unlabelle grahs G n a.s. such that G n Γ in U an thus v(g n ) a.s. an G n Γ. Hence, Theorems 4.1 an 5.2 show that Ĝn H for some ranom exchangeable infinite grah H satisfying (5.1). Furthermore, (5.1) etermines the istribution of H [k] for every k, an thus the istribution of k. Conversely, if H is an exchangeable ranom infinite grah, let G n = H [n]. By Lemma 5.1(ii), the istribution of each G n is invariant uner ermutations of the vertices, so if Ĝn is G n with a ranom (re)labelling, we have Ĝn = G n. Since G n H in L (because L has a rouct

14 14 PERSI DIACONIS AND SVANTE JANSON toology), we thus have Ĝn H in L, so Theorem 4.1 alies an shows the existence of a ranom Γ U such that G n Γ an (5.1) hols. Finally (5.1) etermines the istribution of Γ by Corollary 3.3. Remark 5.1. Moreover, H [n] converges a.s. to some ranom variable Γ U, becauset in (F,H [n] ), n v(f), isareversemartingaleforeveryf Γ. Alternatively, this follows by concentration estimates from the reresentation in Section 6, see Lovász an Szegey [19, Theorem 2.5]. Corollary 5.4. There is a one-to-one corresonence between elements Γ of U = U an extreme oints of the set of istributions of exchangeable ranom infinite grahs H L. This corresonence is given by t(f,γ) = P(H F) (5.3) for every F L. Furthermore, H [n] a.s. Γ in U as n. Proof. The extreme oints of the set of istributions on U are the oint masses, whichareinone-to-onecorresonencewiththeelements ofu. We can characterize these extreme oint istributions of exchangeable ranom infinite grahs as follows. Theorem 5.5. Let H be an exchangeable ranom infinite grah. Then the following are equivalent. (i) The istribution of H is an extreme oint in the set of exchangeable istributions in L. (ii) If F 1 an F 2 are two (finite) grahs with isjoint vertex sets V(F 1 ), V(F 2 ) N, then P(H F 1 F 2 ) = P(H F 1 )P(H F 2 ). (iii) The restrictions H [k] an H [k+1, ) are ineenent for every k. (iv) Let F n be the σ-fiel generate by H [n, ). Then the tail σ-fiel n=1 F n is trivial, i.e., contains only events with robability 0 or 1. Proof. (i) = (ii). By Corollary 5.4, H corresons to some (non-ranom) Γ U such that P(H F) = t(f,γ) (5.4) for every F L. We have efine L such that a grah F L is labelle by 1,...,v(F), but both sies of (5.4) are invariant uner relabelling of F by arbitrary ositive integers; the left han sie because H is exchangeable an the right han sie because t(f,γ) only eens on F as an unlabelle grah. Hence (5.4) hols for every finite grah F with V(F) N. Furthermore, since Γ is non-ranom, Corollary 3.3 yiels t(f 1 F 2,Γ) = t(f 1,Γ)t(F 2,Γ). Hence, P(H F 1 F 2 ) = t(f 1 F 2,Γ) = t(f 1,Γ)t(F 2,Γ) = P(H F 1 )P(H F 2 ). (ii) = (iii). By inclusion exclusion, as for (2.3), (ii) imlies that if 1 k < l <, then for any grahs F 1 an F 2 with V(F 1 ) = {1,...,k}

15 GRAPH LIMITS AND EXCHANGEABLE RANDOM GRAPHS 15 an V(F 2 ) = {k +1,...,k +l}, the events H [k] = F 1 an H {k+1,...,l} = F 2 are ineenent. Hence H [k] an H {k,...,l} are ineenent for every l > k, an the result follows. (iii) = (iv). Suose A is an event in the tail σ-fiel n=1 F n. Let Fn be the σ-fiel generate by H [n]. By (iii), A is ineenent of Fn for every n, an thus of the σ-fiel F generate by Fn, which equals the σ-fiel F 1 generate by H. However, A F 1, so A is ineenent of itself an thus P(A) = 0 or 1. (iv) = (i). Let F L k for some k an let F n be F with all vertices shiftebyn. ConsierthetwoinicatorsI = 1[H F]anI n = 1[H F n ]. Since I n is F n -measurable, P(H F F n ) = E(II n ) = E ( E(I F n )I n ). (5.5) Moreover, E(I F n ), n = 1,2,..., is a reverse martingale, an thus a.s. ( ) E(I F n ) E I F n = EI, using (iv). Hence, ( E(I F n ) EI ) I n 0 a.s., an by ominate convergence ( (E(I E Fn ) EI ) ) I n 0. Consequently, (5.5) yiels n=1 P(H F F n ) = EIEI n +o(1) = P(H F)P(H F n )+o(1). Moreover, since H is exchangeable, P(H F F n ) (for n v(f)) an P(H F n ) o not een on n, an we obtain as n P(H F F k ) = P(H F) 2. (5.6) Let Γ be a ranom element of U corresoning to H as in Theorem 5.3. By (5.2) an (3.2), (5.6) can be written Et(F,Γ) 2 = ( Et(F,Γ) ) 2. Hence the ranom variable t(f,γ) has variance 0 so it is a.s. constant. Since this hols for every F L, it follows that Γ is a.s. constant, i.e., we can take Γ non-ranom, an (i) follows by Corollary Reresentations of grah limits an exchangeable grahs As sai in the introuction, the exchangeable infinite ranom grahs were characterize by Alous [1] an Hoover [14], see also Kallenberg [15], an the grah limits in U = U were characterize in a very similar way by Lovász an Szegey [19]. We can now make the connection between these two characterizations exlicit. Let W be the set of all measurable functions W : [0,1] 2 [0,1] an let W s be the subset of symmetric functions. For every W W s, we efine

16 16 PERSI DIACONIS AND SVANTE JANSON an infinite ranom grah G(,W) L as follows: we first choose a sequence X 1,X 2,... of i.i.. ranom variables uniformly istribute on [0,1], an then, given this sequence, for each air (i,j) with i < j we raw an ege ij with robability W(X i,x j ), ineenently for all airs (i,j) with i < j (conitionally given {X i }). Further, let G(n,W) be the restriction G(,W) [n], which is obtaine by the same construction with a finite sequence X 1,...,X n. It is evient that G(,W) is an exchangeable infinite ranom grah, an the result by Alous an Hoover is that every exchangeable infinite ranom grah is obtaine as a mixtureof such G(,W); in other wors as G(,W) with a ranom W. Consiering again a eterministic W W s, it is evient that Theorem5.5(ii)hols,anthusTheorem5.5anCorollary5.4showthatG(,W) corresons to an element Γ W U. Moreover, by Theorem 5.3 an Remark 5.1, G(n,W) Γ W a.s. as n, an (5.3) shows that if F L k, then t(f,γ W ) = P ( F G(k,W) ) = W(x i,x j )x 1... x k. (6.1) [0,1] k ij E(F) Themainresultof Lovász anszegey [19] isthat every element ofu = U can be obtaine as Γ W satisfying (6.1) for some W W s. It is now clear that the reresentation theorems of Alous Hoover [1, 14] an Lovász an Szegey[19] are connecte by Theorem 5.3 an Corollary 5.4 above, an that one characterization easily follows from the other. Remark 6.1. The reresentations by W are far from unique, see Section 7. Borgs, Chayes, Lovász, Sós an Vesztergombi [8] call an element W W s a grahon. They furtherefineaseuometric (calle thecut-istance) on W s an show that if we consier the quotient sace Ŵs obtaine by ientifying elements with cut-istance 0, we obtain a comact metric sace, an the maing W Γ W yiels a bijection Ŵs U = U, which furthermore is a homeomorhism. Remark 6.2. As remarke in Lovász an Szegey [19], we can more generally consier a symmetric measurable function W : S 2 [0,1] for any robability sace (S,µ), an efine G(,W) as above with X i i.i.. ranom variables in S with istribution µ. This oes not give any new limit objectsg(,w)orγ W, sincewejustsaithateverylimitobjectisobtaine from some W W s, but they can sometimes give useful reresentations. An interesting case is when W is the ajacency matrix of a (finite) grah G, with S = V(G) an µ the uniform measure on S; we thus let X i be i.i.. ranom vertices of G an G(n,W) equals the ranom grah G[n] efine in Section 2. It follows from (6.1) an (2.1) that t(f,γ W ) = t(f,g) for every F U, an thus Γ W = G as elements of U. In other wors, Γ W U = π(g), the ghost of G in U = U.

17 GRAPH LIMITS AND EXCHANGEABLE RANDOM GRAPHS 17 Remark 6.3. For the asymtotic behavior of G(n,W) in another, sarse, case, with W eening on n, see [3]. 7. Non-uniqueness The functions W on [0,1] 2 use to reresent grah limits or exchangeable arrays are far from unique. (For a secial case when there is a natural canonical choice, which much simlifies an hels alications, see [12].) For examle, it is obvious that if ϕ : [0,1] [0,1] is any measure reserving ma, then W an W ϕ, efine by W ϕ(x,y) := W ( ϕ(x),ϕ(y) ), efine the same grah limit an the same (in istribution) exchangeable array. Although in rincile, this is the only source on non-uniqueness, the etails are more comlicate, mainly because the measure reserving ma ϕ oes not have to be a bijection, an thus the relation W = W ϕ is not symmetric: it can hol without there being a measure reserving ma ϕ such that W = W ϕ. (For a 1-imensional examle, consier f(x) = x an f (x) = ϕ(x) = 2x mo 1; for a 2-imensional examle, let W(x,y) = f(x)f(y) an W (x,y) = f (x)f (y).) For exchangeable arrays, the equivalence roblem was solve by Hoover [14], who gave a criterion which in our case reuces to (vi) below; this criterion involves an auxiliary variable, an can be interrete as saying W = W ϕ for a ranom ϕ. This work was continue by Kallenberg, see [15], who gave a robabilistic roof an ae criterion(v). For grah limits, Borgs, Chayes, Lovász, Sós an Vesztergombi [8] gave the criterion (vii) in terms of the cut-istance, an Bollobás an Rioran [4] foun the criterion (v) in this context. Further, Borgs, Chayes, Lovász, Sós an Vesztergombi [8] announce the relate criterion that there exists a measurable function U : [0,1] 2 [0,1] an two measure reserving mas ϕ,ϕ : [0,1] [0,1] such that W = U ϕ an W = U ϕ a.e.; the roof of this will aear in [5]. As in Section 6, these two lines of work are connecte by the results in Section 5, an we can combine the revious results as follows. Theorem 7.1. Let W,W W s. Then the following are equivalent. (i) Γ W = Γ W for the grah limits Γ W,Γ W U. (ii) t(f,γ W ) = t(f,γ W ) for every grah F. (iii) The exchangeable ranom infinite grahs G(,W) an G(,W ) have the same istribution. (iv) The ranom grahs G(n,W) an G(n,W ) have the same istribution for every finite n. (v) There exist measure reserving mas ϕ,ϕ : [0,1] [0,1] such that W ϕ = W ϕ a.e. on [0,1] 2, i.e., W ( ϕ(x),ϕ(y) ) = W ( ϕ (x),ϕ (y) ) a.e. (vi) There exists a measure reserving ma ψ : [0,1] 2 [0,1] such that W(x 1,x 2 ) = W ( ψ(x 1,y 1 ),ψ(x 2,y 2 ) ) a.e. on [0,1] 4. (vii) δ (W,W ) = 0, where δ is the cut-istance efine in [8].

18 18 PERSI DIACONIS AND SVANTE JANSON Proof. (i) (ii). By our efinition of U U. (i) (iii). By Corollary 5.4. (iii) (iv). Obvious. (v) = (iii). If X 1,X 2,... are i.i.. ranom variables uniformly istribute on [0,1], then so are ϕ(x 1 ),ϕ(x 2 ),..., an thus G(,W) G(,W ϕ) = G(,W ϕ ) = G(,W ). (iii) = (v). The general form of the reresentation theorem as state in [15, Theorem 7.15, see also. 304] is (in our two-imensional case) X ij = f(ξ,ξ i,ξ j,ξ ij ) for a function f : [0,1] 4 [0,1], symmetric in the two mile variables, an ineenent ranom variables ξ, ξ i (1 i) an ξ ij (1 i < j), all uniformly istribute on [0,1], an where we further let ξ ji = ξ ij for j > i. We can write the construction of G(,W) in this form with f(ξ,ξ i,ξ j,ξ ij ) = 1[ξ ij W(ξ i,ξ j )]. (7.1) Note that this f oes not een on ξ. (In general, ξ is neee for the case of a ranom W, which can be written as a eterministic function of ξ, but this is not neee in the resent theorem.) Suosethat G(,W) = G(,W ), let f begiven by W by (7.1), anlet similarly f be given by W ; for notational convenience we write W 1 := W, W 2 := W, f 1 := f an f 2 := f. The equivalence theorem [15, Theorem 7.28] takes the form, using (7.1), that there exist measurable functions g k,0 : [0,1] [0,1], g k,1 : [0,1] 2 [0,1] an g k,2 : [0,1] 4 [0,1], for k = 1,2, that are measure reserving in the last coorinate for any fixe values of the other coorinates, an such that the two functions (for k = 1 an k = 2) f k ( gk,0 (ξ ),g k,1 (ξ,ξ 1 ),g k,1 (ξ,ξ 2 ),g k,2 (ξ,ξ 1,ξ 2,ξ 12 ) ) = 1 [ W k ( gk,1 (ξ,ξ 1 ),g k,1 (ξ,ξ 2 ) ) g k,2 (ξ,ξ 1,ξ 2,ξ 12 ) ] area.s.equal. Conitioneonξ,ξ 1 anξ 2, theranomvariableg k,2 (ξ,ξ 1,ξ 2,ξ 12 ) is uniformly istribute on [0,1], an it follows (e.g., by taking the conitional exectation) that a.s. W 1 ( g1,1 (ξ,ξ 1 ),g 1,1 (ξ,ξ 2 ) ) = W 2 ( g2,1 (ξ,ξ 1 ),g 2,1 (ξ,ξ 2 ) ). For a.e. value x 0 of ξ, this thus hols for a.e. values of ξ 1 an ξ 2, an we may choose ϕ(x) = g 1,1 (x 0,x) an ϕ (x) := g 2,1 (x 0,x) for some such x 0. (iii) (vi). Similar, using [15, Theorem 7.28(iii)]. (ii) (vii). See [8]. 8. Biartite grahs The efinitions an results above have analogues for biartite grahs, which we give in this section, leaving some etails to the reaer. The roofs are straightforwar analogues of the ones given above an are omitte. Alications of the results of this section to ranom ifference grahs are in [12]. =

19 GRAPH LIMITS AND EXCHANGEABLE RANDOM GRAPHS 19 A biartite grah will be a grah with an exlicit biartition; in other wors, a biartite grah G consists of two vertex sets V 1 (G) an V 2 (G) an an ege set E(G) V 1 (G) V 2 (G); we let v 1 (G) := V 1 (G) an v 2 (G) := V 2 (G) be the numbers of vertices in the two sets. Again we consier both the labelle an unlabelle cases; in the labelle case we assume the labels of the vertices in V j (G) are 1,...,v j (G) for j = 1,2. Let B L n 1 n 2 be the set of the 2 n 1n 2 labelle biartite grahs with vertex sets [n 1 ] an [n 2 ], an let B n1 n 2 be the quotient set B L n 1 n 2 / = of unlabelle biartite grahs with n 1 an n 2 vertices in the two arts; further, let B L := n 1,n 2 1 BL n 1 n 2 an B := n 1,n 2 1 B n 1 n 2. We let G[k 1,k 2 ] be the ranom grah in B L k 1 k 2 obtaine by samling k j vertices from V j (G) (j = 1,2), uniformly with relacement, an let, roviek j v j (G), G[k 1,k 2 ] bethecorresoningranom grahobtaine by samling without relacement. We then efine t(f,g), t inj (F,G) an t in (F,G) for (unlabelle) biartite grahs F an G in analogy with (2.1) (2.3). Then (2.4) (2.6) still hol, mutatis mutanis; for examle, t(f,g) tinj (F,G) v 1 (F) 2 2v 1 (G) + v 2(F) 2 2v 2 (G). (8.1) In analogy with (2.7), we now efine τ : B [0,1] B by τ(g) := (t(f,g)) F B [0,1] B. (8.2) We efine B := τ(b) [0,1] B to be the image of B uner this maing τ, an let B be the closure of B in [0,1] B ; this is a comact metric sace. Again, τ is not injective; we may consier a grah G as an element of B by ientifying G an τ(g), but this imlies ientification of some grahs of ifferent orers an we refer to avoi it. We let B + be the union of B an some two-oint set { 1, 2 } an consier the maing τ + : B [0,1] B+ = [0,1] B [0,1] [0,1] efine by τ + (G) = ( τ(g), v 1 (G) 1, v 2 (G) 1). (8.3) Then τ + is injective an we can ientify B with its image τ + (B) [0,1] B+ an efine B [0,1] B+ as its closure; this is a comact metric sace. The functions t(f, ), t inj (F, ), t in (F, ) an v j ( ) 1, for F B an j = 1, 2, have unique continuous extensions to B. We let B := {G B : v 1 (G) = v 2 (G) = }; this is the set of all limit objects of sequences (G n ) in B with v 1 (G n ),v 2 (G n ). By (8.1), t inj (F,G) = t(f,g) for every G B an every F B. The rojection π : B B restricts to a homeomorhism B = B. Remark 8.1. Note that in the biartite case there are other limit objects too in B; in fact, B can be artitione into B, B, an the sets B n, B n, for n = 1,2,..., where, for examle, B n1 is the set of limits of sequences (G n ) of biartitegrahssuch thatv 2 (G n ) butv 1 (G n ) = n 1 is constant. We will not consier such egenerate limits further here, but we remark that

20 20 PERSI DIACONIS AND SVANTE JANSON in the simlest case n 1 = 1, a biartite grah in B L 1n 2 can be ientifie with a subset of [n 2 ], an an unlabelle grah in B 1n2 thus with a number in m {0,...,n 2 }, the number of eges in the grah, an it is easily seen that a sequence of such unlabelle grahs with n 2 converges in B if an only if the roortion m/n 2 converges; hence we can ientify B 1 with the interval [0,1]. We have the following basic result, cf. Theorem 2.1. Theorem 8.1. Let (G n ) be a sequence of biartite grahs with v 1 (G n ), v 2 (G n ). Then the following are equivalent. (i) t(f,g n ) converges for every F B. (ii) t inj (F,G n ) converges for every F B. (iii) t in (F,G n ) converges for every F B. (iv) G n converges in B. In this case, the limit G of G n belongs to B an the limits in (i), (iii) an (iii) are t(f,g), t inj (F,G) an t in (F,G). For convergence of ranom unlabelle biartite grahs, the results in Section 3 hol with trivial changes. Theorem 8.2. Let G n, n 1, be ranom unlabelle biartite grahs an assume that v 1 (G n ),v 2 (G n ). The following are equivalent, as n. (i) G n Γ for some ranom Γ B. (ii) For every finite family F 1,...,F m of (non-ranom) biartite grahs, the ranom variables t(f 1,G n ),...,t(f m,g n ) converge jointly in istribution. (iii) For every (non-ranom) F B, the ranom variables t(f,g n ) converge in istribution. (iv) For every (non-ranom) F B, the exectations Et(F,G n ) converge. If these roerties hol, then the limits in (ii), (iii) an (iv) are ( t(f i,γ) ) m i=1, t(f,γ) an Et(F,Γ), resectively. Furthermore, Γ B a.s. The same results hol if t is relace by t inj or t in. Corollary 8.3. Let G n, n 1, be ranom unlabelle biartite grahs such that v 1 (G n ),v 2 (G n ), an let G B. The following are equivalent, as n. (i) G n G. (ii) t(f,g n ) t(f,g) for every (non-ranom) F B. (iii) Et(F,G n ) t(f,g) for every (non-ranom) F B. The same result hols if t is relace by t inj or t in. As above, the istribution of Γ is uniquely etermine by the numbers Et(F,Γ), F B.

21 GRAPH LIMITS AND EXCHANGEABLE RANDOM GRAPHS 21 Let B L enote the set of all labelle infinite biartite grahs with the vertex sets V 1 (G) = V 2 (G) = N. B L is a comact metric sace with the natural rouct toology. If G is a biartite grah, let Ĝ be the ranom labelle biartite grah obtaine by ranom labellings of the vertices in V j (G) by the numbers 1,...,v j (G), for j = 1,2. This is a ranom finite biartite grah, but we can also regar it as a ranom element of B L by aing isolate vertices. Definition. A ranom infinite biartite grah H B L is exchangeable if its istribution is invariant uner every air of finite ermutations of V 1 (H) an V 2 (H). Theorem 8.4. Let (G n ) be a sequence of ranom grahs in B an assume that v 1 (G n ),v 2 (G n ). Then the following are equivalent. (i) G n Γ in B for some ranom Γ B. (ii) Ĝn H in B L for some ranom H BL. If these hol, then P(H [k1 ] [k 2 ] = F) = Et in (F,Γ) for every F B L k 1 k 2. Furthermore, Γ B a.s., an H is exchangeable. Theorem 8.5. There is a one-to-one corresonence between istributions of ranom elements Γ B (or B ) an istributions of exchangeable ranom infinite grahs H B L given by Et in (F,Γ) = P(H [k1 ] [k 2 ] = F) (8.4) for every k 1,k 2 1 an every F B L k 1 k 2, or, equivalently, for every F B L. Furthermore, H [n1 ] [n 2 ] Et(F,Γ) = P(H F) (8.5) Γ in B as n 1,n 2. Corollary 8.6. There is a one-to-one corresonence between elements Γ of B = B an extreme oints of the set of istributions of exchangeable ranom infinite grahs H B L. This corresonence is given by for every F B L. Furthermore, H [n1 ] [n 2 ] t(f,γ) = P(H F) (8.6) Γ in B as n 1,n 2. a.s. Remark 8.2. We have not checke whether H [n1 ] [n 2 ] Γ in B as n 1,n 2. This hols at least for a subsequence (n 1 (m),n 2 (m)) with both n 1 (m) an n 2 (m) non-ecreasing because then t inj (F,H [n1 ] [n 2 ]) is a reverse martingale. Theorem 8.7. Let H be an exchangeable ranom infinite biartite grah. Then the following are equivalent. (i) The istribution of H is an extreme oint in the set of exchangeable istributions in B L.

22 22 PERSI DIACONIS AND SVANTE JANSON (ii) If F 1 an F 2 are two (finite) biartite grahs with the vertex sets V j (F 1 ) an V j (F 2 ) isjoint subsets of N for j = 1,2, then P(H F 1 F 2 ) = P(H F 1 )P(H F 2 ). The construction in Section 6 takes the following form; note that there is no nee to assume symmetry of W. For every W W, we efine an infinite ranom biartite grah G(,,W) B L as follows: we first choose two sequence X 1,X 2,... an Y 1,Y 2,... of i.i.. ranom variables uniformly istribute on [0, 1], an then, given these sequences, for each air (i,j) N N we raw an ege ij with robability W(X i,y j ), ineenently for all airs (i,j). Further, let G(n 1,n 2,W) be the restriction G(,,W) [n1 ] [n 2 ], which is obtaine by the same construction with finite sequences X 1,...,X n1 an Y 1,...,Y n2. It is evient that G(,,W) is an exchangeable infinite ranom biartite grah. Furthermore, it satisfies Theorem 8.7(ii). Theorem 8.5 an Corollary 8.6 yiel a corresoning element Γ W B = B such that G(n 1,n 2,W) Γ W as n 1,n 2 an, for every F Bk L 1 k 2, t(f,γ W ) = W(x i,y j )x 1... x k1 y 1... y k2. (8.7) [0,1] k 1 +k 2 ij E(F) The result by Alous [1] in the non-symmetric case is that every exchangeable infinite ranom biartite grah is obtaine as a mixture of such G(,,W); in other wors as G(,,W) with a ranom W. By Theorem 8.5 an Corollary 8.6 above, this imlies (an is imlie by) the fact that every element of B equals Γ W for some (non-unique) W W; the biartite version of the characterization by Lovász an Szegey [19]. 9. Directe grahs A irecte grah G consists of a vertex set V(G) an an ege set E(G) V(G) V(G); the ege inicators thus form an arbitrary zero one matrix {X ij }, i,j V(G). Note that we allow loos, corresoning to the iagonal inicators X ii. Theefinitions an results above have analogues for irecte grahs too, with mainly notational ifferences. We sketch these in this section, leaving the etails to the reaer. Let D L n be the set of the 2n2 labelle irecte grahs with vertex set [n] an let D n be the quotient set D L n/ = of unlabelle irecte grahs with n vertices; further, let D L := n 1 DL n an D := n 1 D n. The efinitions in Section 2 aly to irecte grahs too, with at most notational ifferences. G[k] an G[k] now are ranom irecte grahs an t(f,g), t inj (F,G) an t in (F,G) are efine for (unlabelle) irecte grahs F an G by (2.1) (2.3). We now efine τ : D [0,1] D by, cf. (2.7), τ(g) := (t(f,g)) F D [0,1] D. (9.1)