Statistical Physics on Sparse Random Graphs: Mathematical Perspective

Size: px
Start display at page:

Download "Statistical Physics on Sparse Random Graphs: Mathematical Perspective"

Transcription

1 Statistical Physics on Sparse Random Graphs: Mathematical Perspective Amir Dembo Stanford University Northwestern, July 19, 2016

2 x 5 x 6 Factor model [DM10, Eqn. (1.4)] x 1 x 2 x 3 x 4 x 9 x8 x 7 x 10 x 11 x 12 G = (V, E), V = [n], x = (x 1,..., x n ), x i X (finite set). µ(x) = 1 Z G (ij) E ψ(x i, x j ) i V ψ(x i ).

3 Ising models

4 Ising models [DM10, Eqn. (1.20)] G n = (V n [n], E n ), finite, non-directed graphs. x i {+1, 1} µ(x) = 1 Z n (β, B) exp β x i x j + B (ij) E n n i=1 x i β 0 Ferromagnetic, β < 0 Anti-ferromagnetic, B 0 wlog

5 Potts models [DMS13, Eqn. (1.3)] G n = (V n [n], E n ), finite, non-directed graphs. x i [q] {1, 2,..., q} µ(x) = 1 Z n (β, B) (ij) E n e β1{xi =xj } n i=1 distribution on spin configurations x [q] V. Interaction strength parametrized by β; e B1{x i =1} May add external field B towards distinguished spin 1 Natural generalization of Ising models (q = 2);

6 Potts models [DMS13, Eqn. (1.3)] G n = (V n [n], E n ), finite, non-directed graphs. x i [q] {1, 2,..., q} µ(x) = 1 Z n (β, B) (ij) E n e β1{xi =xj } n i=1 distribution on spin configurations x [q] V. Interaction strength parametrized by β; e B1{x i =1} May add external field B towards distinguished spin 1 Natural generalization of Ising models (q = 2);

7 Potts models [DMS13, Eqn. (1.3)] G n = (V n [n], E n ), finite, non-directed graphs. x i [q] {1, 2,..., q} µ(x) = 1 Z n (β, B) (ij) E n e β1{xi =xj } n i=1 distribution on spin configurations x [q] V. Interaction strength parametrized by β; e B1{x i =1} May add external field B towards distinguished spin 1 Natural generalization of Ising models (q = 2);

8 Potts models [DMS13, Eqn. (1.3)] G n = (V n [n], E n ), finite, non-directed graphs. x i [q] {1, 2,..., q} µ(x) = 1 Z n (β, B) (ij) E n e β1{xi =xj } n i=1 distribution on spin configurations x [q] V. Interaction strength parametrized by β; e B1{x i =1} May add external field B towards distinguished spin 1 Natural generalization of Ising models (q = 2);

9 Constraint Satisfaction Problem: q-coloring G = (V, E) graph. x = (x 1, x 2,..., x n ), x i {1,..., q} variables

10 Constraint Satisfaction Problem: q-coloring G = (V, E) graph. x = (x 1, x 2,..., x n ), x i {1,..., q} variables

11 Uniform measure over proper colorings [DM10, Eqn. (1.22)] µ(x) = 1 Z G (i,j) E ψ(x i, x j ), ψ(x, y) = I(x y). Z G counts number of proper q-colorings of G. AF Potts at β =, B = 0

12 The hard-core model [SS14] µ(x) = 1 Z G (λ) (ij) E(1 x i x j ) i V supported on x {0, 1} V encoding independent sets (no neighbors occupied) Occupied vertices are weighted by a fugacity λ Z G (1) counts independent sets of G; λ = for largest indepednent set of G. λ x i

13 The hard-core model [SS14] µ(x) = 1 Z G (λ) (ij) E(1 x i x j ) i V supported on x {0, 1} V encoding independent sets (no neighbors occupied) Occupied vertices are weighted by a fugacity λ Z G (1) counts independent sets of G; λ = for largest indepednent set of G. λ x i

14 The hard-core model [SS14] µ(x) = 1 Z G (λ) (ij) E(1 x i x j ) i V supported on x {0, 1} V encoding independent sets (no neighbors occupied) Occupied vertices are weighted by a fugacity λ Z G (1) counts independent sets of G; λ = for largest indepednent set of G. λ x i

15 Free energy density [DM10, Eqn. (2.1)] Graph sequences G n = ([n], E n ) Z n x ψ(x i, x j ) (ij) E n n i=1 ψ(x i ) Find asymptotic free energy density φ lim n n 1 log Z n (if limit exists);

16 Free energy density [DM10, Eqn. (2.1)] Graph sequences G n = ([n], E n ) Z n x ψ(x i, x j ) (ij) E n n i=1 ψ(x i ) Find asymptotic free energy density φ lim n n 1 log Z n (if limit exists);

17 Free energy density [DM10, Eqn. (2.1)] Graph sequences G n = ([n], E n ) Z n x ψ(x i, x j ) (ij) E n n i=1 ψ(x i ) Find asymptotic free energy density φ lim n n 1 log Z n (if limit exists);

18 Random graph models [DM10, Sec ] Erdős-Renyi Random graph G = (V, E) G n,m V = n vertices Uniform among graphs of m = E edges (or edges independently present with probability p = m/ ( n 2) ) Average degree d = 2m/n Random regular graph G = (V, E) G n,d V = n vertices Uniformly random among graphs with i = d i V. d = O(1) for (uniformly) sparse graphs

19 Random graph models [DM10, Sec ] Erdős-Renyi Random graph G = (V, E) G n,m V = n vertices Uniform among graphs of m = E edges (or edges independently present with probability p = m/ ( n 2) ) Average degree d = 2m/n Random regular graph G = (V, E) G n,d V = n vertices Uniformly random among graphs with i = d i V. d = O(1) for (uniformly) sparse graphs

20 Random graph models [DM10, Sec ] Erdős-Renyi Random graph G = (V, E) G n,m V = n vertices Uniform among graphs of m = E edges (or edges independently present with probability p = m/ ( n 2) ) Average degree d = 2m/n Random regular graph G = (V, E) G n,d V = n vertices Uniformly random among graphs with i = d i V. d = O(1) for (uniformly) sparse graphs

21 Locally tree-like graphs: regular limit Consider graphs that are sparse ( E n V n ) and locally tree-like the local neighborhood of a uniformly random vertex converges in distribution to a (random) rooted tree the random d-regular graph G n,d converges (locally) to the infinite d-regular tree T d, denoted G n,d T d

22 Locally tree-like graphs: regular limit Consider graphs that are sparse ( E n V n ) and locally tree-like the local neighborhood of a uniformly random vertex converges in distribution to a (random) rooted tree the random d-regular graph G n,d converges (locally) to the infinite d-regular tree T d, denoted G n,d T d

23 Locally tree-like graphs: regular limit Consider graphs that are sparse ( E n V n ) and locally tree-like the local neighborhood of a uniformly random vertex converges in distribution to a (random) rooted tree the random d-regular graph G n,d converges (locally) to the infinite d-regular tree T d, denoted G n,d T d

24 Locally tree-like graphs: regular limit Consider graphs that are sparse ( E n V n ) and locally tree-like the local neighborhood of a uniformly random vertex converges in distribution to a (random) rooted tree the random d-regular graph G n,d converges (locally) to the infinite d-regular tree T d, denoted G n,d T d

25 Locally tree-like graphs: regular limit Consider graphs that are sparse ( E n V n ) and locally tree-like the local neighborhood of a uniformly random vertex converges in distribution to a (random) rooted tree the random d-regular graph G n,d converges (locally) to the infinite d-regular tree T d, denoted G n,d T d

26 Locally tree-like graphs: regular limit Consider graphs that are sparse ( E n V n ) and locally tree-like the local neighborhood of a uniformly random vertex converges in distribution to a (random) rooted tree the random d-regular graph G n,d converges (locally) to the infinite d-regular tree T d, denoted G n,d T d

27 Locally tree-like graphs: regular limit Consider graphs that are sparse ( E n V n ) and locally tree-like the local neighborhood of a uniformly random vertex converges in distribution to a (random) rooted tree the random d-regular graph G n,d converges (locally) to the infinite d-regular tree T d, denoted G n,d T d

28 Locally tree-like graphs: regular limit Consider graphs that are sparse ( E n V n ) and locally tree-like the local neighborhood of a uniformly random vertex converges in distribution to a (random) rooted tree the random d-regular graph G n,d converges (locally) to the infinite d-regular tree T d, denoted G n,d T d

29 UGW T(P, ρ, t) P k ρ k+1

30 UGW T(P, ρ, t) P k ρ k+1

31 UGW T(P, ρ, t) P k ρ k+1

32 UGW T(P, ρ, t) P k ρ k+1

33 UGW T(P, ρ, t) P k ρ k+1

34 Uniformly sparse, locally tree-like graphs: GW limit The Unimodular Galton-Watson tree: P {P k } k 0 Degree distribution, law of L (of finite mean P) ρ { k P P k} k 0 Law of K (degree of uniform edge) T(P, ρ, t) t-generations UGW tree (root degree P, else ρ) B i (t) Ball of radius t in G n centered at node i Definition (DM10, Dfn. 2.1) {G n } converges locally to T(P, ρ, ) if for uniformly random I n [n] and fixed t, law of B In (t) converges as n to T(P, ρ, t). {G n } uniformly sparse if { I n } is uniformly integrable. see Benjamini Schramm 01, Aldous Lyons 07

35 Tree-like graphs: examples Random regular graph G n,d regular tree T d Sparse Erdős Rényi graph G n,nd/2 T(P, ρ, ) with P = ρ Poisson(d) [DM10, Prop. 2.6] Graphs of fixed degree distribution P T(P, ρ, ) [DM10, Prop. 2.5]

36 Tree-like graphs: examples Random regular graph G n,d regular tree T d Sparse Erdős Rényi graph G n,nd/2 T(P, ρ, ) with P = ρ Poisson(d) [DM10, Prop. 2.6] Graphs of fixed degree distribution P T(P, ρ, ) [DM10, Prop. 2.5]

37 Tree-like graphs: examples Random regular graph G n,d regular tree T d Sparse Erdős Rényi graph G n,nd/2 T(P, ρ, ) with P = ρ Poisson(d) [DM10, Prop. 2.6] Graphs of fixed degree distribution P T(P, ρ, ) [DM10, Prop. 2.5]

38 Tree-like graphs: motivation Encompasses natural random graph ensembles such as sparse Erdős Rényi graphs or random regular graphs; Natural randomized computational problems also described by a locally tree-like constraint structure (random hard-core, q-coloring) Trees are amenable to exact analysis (recursive equations) physicists predict many exact asymptotic results for the setting G n T, based on comparisons between models on G n and on T The Bethe replica symmetric prediction for φ in graphs G n T : φ = Φ Bethe explicit which depends only on the limit tree T

39 Tree-like graphs: motivation Encompasses natural random graph ensembles such as sparse Erdős Rényi graphs or random regular graphs; Natural randomized computational problems also described by a locally tree-like constraint structure (random hard-core, q-coloring) Trees are amenable to exact analysis (recursive equations) physicists predict many exact asymptotic results for the setting G n T, based on comparisons between models on G n and on T The Bethe replica symmetric prediction for φ in graphs G n T : φ = Φ Bethe explicit which depends only on the limit tree T

40 Tree-like graphs: motivation Encompasses natural random graph ensembles such as sparse Erdős Rényi graphs or random regular graphs; Natural randomized computational problems also described by a locally tree-like constraint structure (random hard-core, q-coloring) Trees are amenable to exact analysis (recursive equations) physicists predict many exact asymptotic results for the setting G n T, based on comparisons between models on G n and on T The Bethe replica symmetric prediction for φ in graphs G n T : φ = Φ Bethe explicit which depends only on the limit tree T

41 Tree-like graphs: motivation Encompasses natural random graph ensembles such as sparse Erdős Rényi graphs or random regular graphs; Natural randomized computational problems also described by a locally tree-like constraint structure (random hard-core, q-coloring) Trees are amenable to exact analysis (recursive equations) physicists predict many exact asymptotic results for the setting G n T, based on comparisons between models on G n and on T The Bethe replica symmetric prediction for φ in graphs G n T : φ = Φ Bethe explicit which depends only on the limit tree T

42 Tree-like graphs: motivation Encompasses natural random graph ensembles such as sparse Erdős Rényi graphs or random regular graphs; Natural randomized computational problems also described by a locally tree-like constraint structure (random hard-core, q-coloring) Trees are amenable to exact analysis (recursive equations) physicists predict many exact asymptotic results for the setting G n T, based on comparisons between models on G n and on T The Bethe replica symmetric prediction for φ in graphs G n T : φ = Φ Bethe explicit which depends only on the limit tree T

43 Tree-like graphs: motivation Encompasses natural random graph ensembles such as sparse Erdős Rényi graphs or random regular graphs; Natural randomized computational problems also described by a locally tree-like constraint structure (random hard-core, q-coloring) Trees are amenable to exact analysis (recursive equations) physicists predict many exact asymptotic results for the setting G n T, based on comparisons between models on G n and on T The Bethe replica symmetric prediction for φ in graphs G n T : φ = Φ Bethe explicit which depends only on the limit tree T

44 Tree-like graphs: motivation Encompasses natural random graph ensembles such as sparse Erdős Rényi graphs or random regular graphs; Natural randomized computational problems also described by a locally tree-like constraint structure (random hard-core, q-coloring) Trees are amenable to exact analysis (recursive equations) physicists predict many exact asymptotic results for the setting G n T, based on comparisons between models on G n and on T The Bethe replica symmetric prediction for φ in graphs G n T : φ = Φ Bethe explicit which depends only on the limit tree T

45 Mean field equations µ i j ( ) Marginal of x i on without edge (i, j) replacing factor ψ(x i, x j ) by 1 Belief propagation, Bethe-Peierls (BP) equations (Replica Symmetric cavity method): µ i j (x i ) 1 z i j ψ(x i ) l i\j x l ψ(x i, x l )µ l i (x l ) Exact if G = T a tree; approximate marginals of µ( ) by measures on trees. [DM10, Dfn. 3.4 & Prop. 3.7]

46 Mean field equations µ i j ( ) Marginal of x i on without edge (i, j) replacing factor ψ(x i, x j ) by 1 Belief propagation, Bethe-Peierls (BP) equations (Replica Symmetric cavity method): µ i j (x i ) 1 z i j ψ(x i ) l i\j x l ψ(x i, x l )µ l i (x l ) Exact if G = T a tree; approximate marginals of µ( ) by measures on trees. [DM10, Dfn. 3.4 & Prop. 3.7]

47 Mean field equations µ i j ( ) Marginal of x i on without edge (i, j) replacing factor ψ(x i, x j ) by 1 Belief propagation, Bethe-Peierls (BP) equations (Replica Symmetric cavity method): µ i j (x i ) 1 z i j ψ(x i ) l i\j x l ψ(x i, x l )µ l i (x l ) Exact if G = T a tree; approximate marginals of µ( ) by measures on trees. [DM10, Dfn. 3.4 & Prop. 3.7]

48 Bethe-Peierls approximation [DM10, Dfn. 3.10] u(i) i A tree T = (U, E U ) G with i U or i U = {u(i)} µ U (x U ) ν U (x U ) = 1 Z U ψ(x i, x j ) ψ(x i ) h i u(i) (x i ). (i,j) E U i / U i U

49 Bethe Gibbs measures [DMS13, Eqn. (1.6)-(1.12)] On G n T, Φ Bethe = Φ(ν ), with Φ an explicit function, and ν a certain infinite-volume Gibbs measure on T represents proposed local limit µ n ν of models µ n on G n. The replica symmetric prediction assumes special structure for ν : marginal on any finite subgraph U T given by ν (x U ) ( weight of x ) = U h (x within U v ) v U Bethe Gibbs measure with entrance law h Consistency mandates fixed-point relations for h (BP equations) Φ Bethe is equivalently defined in terms of BP solutions h

50 Bethe Gibbs measures [DMS13, Eqn. (1.6)-(1.12)] On G n T, Φ Bethe = Φ(ν ), with Φ an explicit function, and ν a certain infinite-volume Gibbs measure on T represents proposed local limit µ n ν of models µ n on G n. The replica symmetric prediction assumes special structure for ν : marginal on any finite subgraph U T given by ν (x U ) ( weight of x ) = U h (x within U v ) v U Bethe Gibbs measure with entrance law h Consistency mandates fixed-point relations for h (BP equations) Φ Bethe is equivalently defined in terms of BP solutions h

51 Bethe Gibbs measures [DMS13, Eqn. (1.6)-(1.12)] On G n T, Φ Bethe = Φ(ν ), with Φ an explicit function, and ν a certain infinite-volume Gibbs measure on T represents proposed local limit µ n ν of models µ n on G n. The replica symmetric prediction assumes special structure for ν : marginal on any finite subgraph U T given by ν (x U ) ( weight of x ) = U h (x within U v ) v U Bethe Gibbs measure with entrance law h Consistency mandates fixed-point relations for h (BP equations) Φ Bethe is equivalently defined in terms of BP solutions h

52 Bethe Gibbs measures [DMS13, Eqn. (1.6)-(1.12)] On G n T, Φ Bethe = Φ(ν ), with Φ an explicit function, and ν a certain infinite-volume Gibbs measure on T represents proposed local limit µ n ν of models µ n on G n. The replica symmetric prediction assumes special structure for ν : marginal on any finite subgraph U T given by ν (x U ) ( weight of x ) = U h (x within U v ) v U Bethe Gibbs measure with entrance law h Consistency mandates fixed-point relations for h (BP equations) Φ Bethe is equivalently defined in terms of BP solutions h

53 Bethe Gibbs measures [DMS13, Eqn. (1.6)-(1.12)] On G n T, Φ Bethe = Φ(ν ), with Φ an explicit function, and ν a certain infinite-volume Gibbs measure on T represents proposed local limit µ n ν of models µ n on G n. The replica symmetric prediction assumes special structure for ν : marginal on any finite subgraph U T given by ν (x U ) ( weight of x ) = U h (x within U v ) v U Bethe Gibbs measure with entrance law h Consistency mandates fixed-point relations for h (BP equations) Φ Bethe is equivalently defined in terms of BP solutions h

54 Bethe Gibbs measures [DMS13, Eqn. (1.6)-(1.12)] On G n T, Φ Bethe = Φ(ν ), with Φ an explicit function, and ν a certain infinite-volume Gibbs measure on T represents proposed local limit µ n ν of models µ n on G n. The replica symmetric prediction assumes special structure for ν : marginal on any finite subgraph U T given by ν (x U ) ( weight of x ) = U h (x within U v ) v U Bethe Gibbs measure with entrance law h Consistency mandates fixed-point relations for h (BP equations) Φ Bethe is equivalently defined in terms of BP solutions h

55 Bethe free energy density for T d [DMSS14, Dfn ] If G n T d entrance law h in simplex H of prob. measures on X, with h H set of fixed points of mapping BP : H H: (BPh)(x) 1 ( d 1, ψ(x) ψ(x, y)h(y)) x X z h (z h the normalizing constant) y The Bethe functional { ( ) } d Φ(h) = log ψ(x) ψ(x, y)h(y) d { 2 log x y x,y }{{} vertex term Φ vx (h) Φ Bethe sup{φ(h) : h H }. } ψ(x, y)h(x)h(y) } {{ } edge term Φ e (h).

56 Interpolation in phase-space: Ferromagnetic Ising [DM10, Thm. 2.15] For β 0, B > 0 if G n T then φ = Φ Bethe (h + ). Proof outline. 0. B = 0 given by limit B 0, so fix B > Reduce to expectations of local quantities d db log Z n(β, B) = n x i n i=1 ( n denote expectation under Ising on G n ). 2. Prove convergence of local expectations to tree values.

57 2. Convergence to tree values o T(t) t z 1 z 2 z 3 T infinite tree with max degree d max T(t) first t generations µ t,z ( ) Ising model on T(t) boundary condition z root spin expectation µ t,z o

58 2. Convergence to tree values o T(t) t z 1 z 2 z 3 T infinite tree with max degree d max T(t) first t generations µ t,z ( ) Ising model on T(t) boundary condition z root spin expectation µ t,z o

59 2. Convergence to tree values o T(t) t z 1 z 2 z 3 T infinite tree with max degree d max T(t) first t generations µ t,z ( ) Ising model on T(t) boundary condition z root spin expectation µ t,z o

60 Decorrelation Uniform (Gibbs measure uniqueness) µ t,z(1) o µ t,z(2) o µ t,+ o µ t, o 0. Easier True only at high temperature (β < β c )

61 Decorrelation Uniform (Gibbs measure uniqueness) µ t,z(1) o µ t,z(2) o µ t,+ o µ t, o 0. Easier True only at high temperature (β < β c )

62 Decorrelation Uniform (Gibbs measure uniqueness) µ t,z(1) o µ t,z(2) o µ t,+ o µ t, o 0. Easier True only at high temperature (β < β c )

63 Why non-uniform control? Phase transition... For β > β c atanh(1/ρ) lim B 0+ lim n E x I n = lim B 0 lim n E x I n > 0

64 ... and its tree counterpart o T(ρ, t) t z 1 z 2 z 3 z = (+1, +1,..., +1) lim x o t > 0 t z = ( 1, 1,..., 1) lim x o t < 0 t

65 Decorrelation Non uniform µ t,+ o µ t,free o 0. Any temperature

66 Trick 0 µ t,+ o µ t,free o ɛ{µ t,free o µ t 1,free o } 0 (µ t,free o monotone by Griffiths Inequality [DM10, Prop. 2.11]) [Ising specific, but strategy extends to Potts, Hard-core models]

67 Bethe Gibbs measures: Non-uniqueness A major challenge in verifying the Bethe prediction is the non-uniqueness of infinite-volume Gibbs measures Ising already has non-uniqueness, but the correct measure can be isolated by monotonicity considerations Situation is qualitatively different in q 3 Potts models, where monotonicity considerations do not close the gap If multiple Gibbs measures, physics prescription is to select Bethe Gibbs measure achieving highest value of Φ Bethe, Φ Bethe = sup{φ(ν ) : ν Bethe Gibbs measure} (restriction to Bethe Gibbs measures is an assumption) [dmss14] prove such prediction holds (within one non-trivial example).

68 Bethe Gibbs measures: Non-uniqueness A major challenge in verifying the Bethe prediction is the non-uniqueness of infinite-volume Gibbs measures Ising already has non-uniqueness, but the correct measure can be isolated by monotonicity considerations Situation is qualitatively different in q 3 Potts models, where monotonicity considerations do not close the gap If multiple Gibbs measures, physics prescription is to select Bethe Gibbs measure achieving highest value of Φ Bethe, Φ Bethe = sup{φ(ν ) : ν Bethe Gibbs measure} (restriction to Bethe Gibbs measures is an assumption) [dmss14] prove such prediction holds (within one non-trivial example).

69 Bethe Gibbs measures: Non-uniqueness A major challenge in verifying the Bethe prediction is the non-uniqueness of infinite-volume Gibbs measures Ising already has non-uniqueness, but the correct measure can be isolated by monotonicity considerations Situation is qualitatively different in q 3 Potts models, where monotonicity considerations do not close the gap If multiple Gibbs measures, physics prescription is to select Bethe Gibbs measure achieving highest value of Φ Bethe, Φ Bethe = sup{φ(ν ) : ν Bethe Gibbs measure} (restriction to Bethe Gibbs measures is an assumption) [dmss14] prove such prediction holds (within one non-trivial example).

70 Bethe Gibbs measures: Non-uniqueness A major challenge in verifying the Bethe prediction is the non-uniqueness of infinite-volume Gibbs measures Ising already has non-uniqueness, but the correct measure can be isolated by monotonicity considerations Situation is qualitatively different in q 3 Potts models, where monotonicity considerations do not close the gap If multiple Gibbs measures, physics prescription is to select Bethe Gibbs measure achieving highest value of Φ Bethe, Φ Bethe = sup{φ(ν ) : ν Bethe Gibbs measure} (restriction to Bethe Gibbs measures is an assumption) [dmss14] prove such prediction holds (within one non-trivial example).

71 Bethe Gibbs measures: Non-uniqueness A major challenge in verifying the Bethe prediction is the non-uniqueness of infinite-volume Gibbs measures Ising already has non-uniqueness, but the correct measure can be isolated by monotonicity considerations Situation is qualitatively different in q 3 Potts models, where monotonicity considerations do not close the gap If multiple Gibbs measures, physics prescription is to select Bethe Gibbs measure achieving highest value of Φ Bethe, Φ Bethe = sup{φ(ν ) : ν Bethe Gibbs measure} (restriction to Bethe Gibbs measures is an assumption) [dmss14] prove such prediction holds (within one non-trivial example).

72 Potts: Non-uniqueness regime Non-uniqueness regime for Potts on T d (d = 4, q = 30) in uniqueness regime, ν f = ν 1 on T d in non-uniqueness regime, ν f ν 1 on T d. positive (β, B) quadrant

73 Potts: Non-uniqueness regime Non-uniqueness regime for Potts on T d (d = 4, q = 30) in uniqueness regime, ν f = ν 1 on T d in non-uniqueness regime, ν f ν 1 on T d. positive (β, B) quadrant

74 Potts: Bethe free energy Potts Bethe prediction as function of β (d = 4, q = 30, B = 0.05) Φ(ν f ), with ν f the free-boundary Bethe Gibbs measure nonuniqueness regime Φ Bethe = Φ(ν f ) Φ(ν 1 ) Φ(ν 1 ), with ν 1 the 1-boundary Bethe Gibbs measure

75 Potts: Bethe free energy Potts Bethe prediction as function of β (d = 4, q = 30, B = 0.05) Φ(ν f ), with ν f the free-boundary Bethe Gibbs measure nonuniqueness regime Φ Bethe = Φ(ν f ) Φ(ν 1 ) Φ(ν 1 ), with ν 1 the 1-boundary Bethe Gibbs measure

76 Potts: Bethe free energy Potts Bethe prediction as function of β (d = 4, q = 30, B = 0.05) Φ(ν f ), with ν f the free-boundary Bethe Gibbs measure nonuniqueness regime Φ Bethe = Φ(ν f ) Φ(ν 1 ) Φ(ν 1 ), with ν 1 the 1-boundary Bethe Gibbs measure

77 Potts: Bethe free energy Potts Bethe prediction as function of β (d = 4, q = 30, B = 0.05) Φ(ν f ), with ν f the free-boundary Bethe Gibbs measure nonuniqueness regime Φ Bethe = Φ(ν f ) Φ(ν 1 ) Φ(ν 1 ), with ν 1 the 1-boundary Bethe Gibbs measure

78 Potts: Bethe free energy Potts Bethe prediction as function of β (d = 4, q = 30, B = 0.05) Φ(ν f ), with ν f the free-boundary Bethe Gibbs measure nonuniqueness regime Φ Bethe = Φ(ν f ) Φ(ν 1 ) Φ(ν 1 ), with ν 1 the 1-boundary Bethe Gibbs measure

79 Free energy: other models By interpolation in parameters and other means... mostly for G n T d (regular tree) simpler Bethe prediction. Examples of G n T d include the (uniformly) random d-regular graph, the (uniformly) random bipartite d-regular graph, and any sequence G n of d-regular graphs of divergent girth THEOREM (Sly Sun 14). For the hard-core (independent set) model at any fugacity λ > 0, and for the anti-ferromagnetic Ising model at any B R, the Bethe prediction holds on any bipartite sequence G n T d. (nonbipartite sequence, e.g. G n,d has strictly smaller φ for λ large) THEOREM (D. Montanari Sly Sun 14). For the Potts model at any β, B 0, the Bethe prediction holds on any sequence G n T d with d even. (lower bound by interpolation for tree-like graphs)

80 Free energy: other models By interpolation in parameters and other means... mostly for G n T d (regular tree) simpler Bethe prediction. Examples of G n T d include the (uniformly) random d-regular graph, the (uniformly) random bipartite d-regular graph, and any sequence G n of d-regular graphs of divergent girth THEOREM (Sly Sun 14). For the hard-core (independent set) model at any fugacity λ > 0, and for the anti-ferromagnetic Ising model at any B R, the Bethe prediction holds on any bipartite sequence G n T d. (nonbipartite sequence, e.g. G n,d has strictly smaller φ for λ large) THEOREM (D. Montanari Sly Sun 14). For the Potts model at any β, B 0, the Bethe prediction holds on any sequence G n T d with d even. (lower bound by interpolation for tree-like graphs)

81 Free energy: other models By interpolation in parameters and other means... mostly for G n T d (regular tree) simpler Bethe prediction. Examples of G n T d include the (uniformly) random d-regular graph, the (uniformly) random bipartite d-regular graph, and any sequence G n of d-regular graphs of divergent girth THEOREM (Sly Sun 14). For the hard-core (independent set) model at any fugacity λ > 0, and for the anti-ferromagnetic Ising model at any B R, the Bethe prediction holds on any bipartite sequence G n T d. (nonbipartite sequence, e.g. G n,d has strictly smaller φ for λ large) THEOREM (D. Montanari Sly Sun 14). For the Potts model at any β, B 0, the Bethe prediction holds on any sequence G n T d with d even. (lower bound by interpolation for tree-like graphs)

82 Free energy: other models By interpolation in parameters and other means... mostly for G n T d (regular tree) simpler Bethe prediction. Examples of G n T d include the (uniformly) random d-regular graph, the (uniformly) random bipartite d-regular graph, and any sequence G n of d-regular graphs of divergent girth THEOREM (Sly Sun 14). For the hard-core (independent set) model at any fugacity λ > 0, and for the anti-ferromagnetic Ising model at any B R, the Bethe prediction holds on any bipartite sequence G n T d. (nonbipartite sequence, e.g. G n,d has strictly smaller φ for λ large) THEOREM (D. Montanari Sly Sun 14). For the Potts model at any β, B 0, the Bethe prediction holds on any sequence G n T d with d even. (lower bound by interpolation for tree-like graphs)

83 Free energy: other models By interpolation in parameters and other means... mostly for G n T d (regular tree) simpler Bethe prediction. Examples of G n T d include the (uniformly) random d-regular graph, the (uniformly) random bipartite d-regular graph, and any sequence G n of d-regular graphs of divergent girth THEOREM (Sly Sun 14). For the hard-core (independent set) model at any fugacity λ > 0, and for the anti-ferromagnetic Ising model at any B R, the Bethe prediction holds on any bipartite sequence G n T d. (nonbipartite sequence, e.g. G n,d has strictly smaller φ for λ large) THEOREM (D. Montanari Sly Sun 14). For the Potts model at any β, B 0, the Bethe prediction holds on any sequence G n T d with d even. (lower bound by interpolation for tree-like graphs)

84 Free energy: other models By interpolation in parameters and other means... mostly for G n T d (regular tree) simpler Bethe prediction. Examples of G n T d include the (uniformly) random d-regular graph, the (uniformly) random bipartite d-regular graph, and any sequence G n of d-regular graphs of divergent girth THEOREM (Sly Sun 14). For the hard-core (independent set) model at any fugacity λ > 0, and for the anti-ferromagnetic Ising model at any B R, the Bethe prediction holds on any bipartite sequence G n T d. (nonbipartite sequence, e.g. G n,d has strictly smaller φ for λ large) THEOREM (D. Montanari Sly Sun 14). For the Potts model at any β, B 0, the Bethe prediction holds on any sequence G n T d with d even. (lower bound by interpolation for tree-like graphs)

85 References [DM10] Dembo A. & Montanari A. Gibbs measures and phase transitions on sparse random graphs. Brazilian J. Probab. & Stat. 24 (2010), pp [DMS13] Dembo, A., Montanari, A. & Sun, N. Factor models on locally tree-like graphs. Ann. Prob. 41 (2013), pp [DMSS14] Dembo, A., Montanari, A., Sly, A. & Sun, N. The replica symmetric solution for Potts models on d-regular graphs. Comm. Math. Phys. 327 (2014), pp [SS14] Sly, A. & Sun, N. Counting in two-spin models on d-regular graphs. Ann. Probab. 42 (2014), pp

Phase transitions in discrete structures

Phase transitions in discrete structures Phase transitions in discrete structures Amin Coja-Oghlan Goethe University Frankfurt Overview 1 The physics approach. [following Mézard, Montanari 09] Basics. Replica symmetry ( Belief Propagation ).

More information

Ising models on locally tree-like graphs

Ising models on locally tree-like graphs Ising models on locally tree-like graphs Amir Dembo and Andrea Montanari April 30, 2008 Abstract We consider Ising models on graphs that converge locally to trees. Examples include random regular graphs

More information

arxiv: v1 [math.pr] 21 Oct 2011

arxiv: v1 [math.pr] 21 Oct 2011 FACOR MODELS ON LOCALLY REE-LIKE GRAPHS AMIR DEMBO, ANDREA MONANARI, AND NIKE SUN arxiv:1110.4821v1 [math.pr] 21 Oct 2011 Abstract. We consider homogeneous factor models on uniformly sparse graph sequences

More information

Hard-Core Model on Random Graphs

Hard-Core Model on Random Graphs Hard-Core Model on Random Graphs Antar Bandyopadhyay Theoretical Statistics and Mathematics Unit Seminar Theoretical Statistics and Mathematics Unit Indian Statistical Institute, New Delhi Centre New Delhi,

More information

The Tightness of the Kesten-Stigum Reconstruction Bound for a Symmetric Model With Multiple Mutations

The Tightness of the Kesten-Stigum Reconstruction Bound for a Symmetric Model With Multiple Mutations The Tightness of the Kesten-Stigum Reconstruction Bound for a Symmetric Model With Multiple Mutations City University of New York Frontier Probability Days 2018 Joint work with Dr. Sreenivasa Rao Jammalamadaka

More information

Antiferromagnetic Potts models and random colorings

Antiferromagnetic Potts models and random colorings Antiferromagnetic Potts models and random colorings of planar graphs. joint with A.D. Sokal (New York) and R. Kotecký (Prague) October 9, 0 Gibbs measures Let G = (V, E) be a finite graph and let S be

More information

By Amir Dembo and Andrea Montanari Stanford University

By Amir Dembo and Andrea Montanari Stanford University The Annals of Applied Probability 2010, Vol. 20, No. 2, 565 592 DOI: 10.1214/09-AAP627 c Institute of Mathematical Statistics, 2010 ISING MODELS ON LOCALLY TREE-LIKE GRAPHS 1 arxiv:0804.4726v3 [math.pr]

More information

Approximate counting of large subgraphs in random graphs with statistical mechanics methods

Approximate counting of large subgraphs in random graphs with statistical mechanics methods Approximate counting of large subgraphs in random graphs with statistical mechanics methods Guilhem Semerjian LPT-ENS Paris 13.03.08 / Eindhoven in collaboration with Rémi Monasson, Enzo Marinari and Valery

More information

Ferromagnetic Ising models

Ferromagnetic Ising models Stat 36 Stochastic Processes on Graphs Ferromagnetic Ising models Amir Dembo Lecture 3-4 - 0/5/2007 Introduction By ferromagnetic Ising models we mean the study of the large-n behavior of the measures

More information

The non-backtracking operator

The non-backtracking operator The non-backtracking operator Florent Krzakala LPS, Ecole Normale Supérieure in collaboration with Paris: L. Zdeborova, A. Saade Rome: A. Decelle Würzburg: J. Reichardt Santa Fe: C. Moore, P. Zhang Berkeley:

More information

Decay of Correlation in Spin Systems

Decay of Correlation in Spin Systems (An algorithmic perspective to the) Decay of Correlation in Spin Systems Yitong Yin Nanjing University Decay of Correlation hardcore model: random independent set I v Pr[v 2 I ] (d+)-regular tree `! σ:

More information

Statistical Mechanics and Algorithms on Sparse and Random Graphs

Statistical Mechanics and Algorithms on Sparse and Random Graphs Statistical Mechanics and Algorithms on Sparse and Random Graphs Andrea Montanari 1 October 8, 2014 1 A. Montanari is with the Departments of Electrical Engineering and Statistics, Stanford University

More information

On the number of circuits in random graphs. Guilhem Semerjian. [ joint work with Enzo Marinari and Rémi Monasson ]

On the number of circuits in random graphs. Guilhem Semerjian. [ joint work with Enzo Marinari and Rémi Monasson ] On the number of circuits in random graphs Guilhem Semerjian [ joint work with Enzo Marinari and Rémi Monasson ] [ Europhys. Lett. 73, 8 (2006) ] and [ cond-mat/0603657 ] Orsay 13-04-2006 Outline of the

More information

The weak limit of Ising models on locally tree-like graphs

The weak limit of Ising models on locally tree-like graphs The weak limit of Ising models on locally tree-like graphs Andrea Montanari, Elchanan Mossel and Allan Sly December 3, 2009 Abstract We consider the Ising model with inverse temperature β and without external

More information

XVI International Congress on Mathematical Physics

XVI International Congress on Mathematical Physics Aug 2009 XVI International Congress on Mathematical Physics Underlying geometry: finite graph G=(V,E ). Set of possible configurations: V (assignments of +/- spins to the vertices). Probability of a configuration

More information

Message Passing Algorithms: A Success Looking for Theoreticians

Message Passing Algorithms: A Success Looking for Theoreticians Message Passing Algorithms: A Success Looking for Theoreticians Andrea Montanari Stanford University June 5, 2010 Andrea Montanari (Stanford) Message Passing June 5, 2010 1 / 93 What is this talk about?

More information

THE PHYSICS OF COUNTING AND SAMPLING ON RANDOM INSTANCES. Lenka Zdeborová

THE PHYSICS OF COUNTING AND SAMPLING ON RANDOM INSTANCES. Lenka Zdeborová THE PHYSICS OF COUNTING AND SAMPLING ON RANDOM INSTANCES Lenka Zdeborová (CEA Saclay and CNRS, France) MAIN CONTRIBUTORS TO THE PHYSICS UNDERSTANDING OF RANDOM INSTANCES Braunstein, Franz, Kabashima, Kirkpatrick,

More information

Weakly interacting particle systems on graphs: from dense to sparse

Weakly interacting particle systems on graphs: from dense to sparse Weakly interacting particle systems on graphs: from dense to sparse Ruoyu Wu University of Michigan (Based on joint works with Daniel Lacker and Kavita Ramanan) USC Math Finance Colloquium October 29,

More information

Gibbs Measures and Phase Transitions on Sparse Random Graphs

Gibbs Measures and Phase Transitions on Sparse Random Graphs Gibbs Measures and Phase Transitions on Sparse Random Graphs Amir Dembo, Andrea Montanari Stanford University. e-mail: amir@math.stanford.edu; montanari@stanford.edu Abstract: Many problems of interest

More information

1. Introduction. Let G=(V,E) be a finite undirected graph, and X a finite alphabet of spins. A factor model on G is a probability measure on

1. Introduction. Let G=(V,E) be a finite undirected graph, and X a finite alphabet of spins. A factor model on G is a probability measure on he Annals of Probability 2013, Vol. 41, No. 6, 4162 4213 DOI: 10.1214/12-AOP828 c Institute of Mathematical Statistics, 2013 FACOR MODELS ON LOCALLY REE-LIKE GRAPHS arxiv:1110.4821v3 [math.pr] 16 Dec 2013

More information

PHASE TRANSITIONS IN THE COMPLEXITY OF COUNTING

PHASE TRANSITIONS IN THE COMPLEXITY OF COUNTING PHASE TRANSITIONS IN THE COMPLEXITY OF COUNTING A Thesis Presented to The Academic Faculty by Andreas Galanis In Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy in Algorithms,

More information

SPIN SYSTEMS: HARDNESS OF APPROXIMATE COUNTING VIA PHASE TRANSITIONS

SPIN SYSTEMS: HARDNESS OF APPROXIMATE COUNTING VIA PHASE TRANSITIONS SPIN SYSTEMS: HARDNESS OF APPROXIMATE COUNTING VIA PHASE TRANSITIONS Andreas Galanis Joint work with: Jin-Yi Cai Leslie Ann Goldberg Heng Guo Mark Jerrum Daniel Štefankovič Eric Vigoda The Power of Randomness

More information

RESEARCH STATEMENT ANIRBAN BASAK

RESEARCH STATEMENT ANIRBAN BASAK RESEARCH STATEMENT ANIRBAN BASAK 1. Introduction I am interested in all areas of theoretical and applied probability. Specifically, I have worked on problems on hermitian and non-hermitian random matrices.

More information

Ising critical exponents on random trees and graphs

Ising critical exponents on random trees and graphs Ising critical exponents on random trees and graphs Sander Dommers Cristian Giardinà Remco van der Hofstad December 11, 2013 Abstract We study the critical behavior of the ferromagnetic Ising model on

More information

Oberwolfach workshop on Combinatorics and Probability

Oberwolfach workshop on Combinatorics and Probability Apr 2009 Oberwolfach workshop on Combinatorics and Probability 1 Describes a sharp transition in the convergence of finite ergodic Markov chains to stationarity. Steady convergence it takes a while to

More information

Phase Transitions in the Coloring of Random Graphs

Phase Transitions in the Coloring of Random Graphs Phase Transitions in the Coloring of Random Graphs Lenka Zdeborová (LPTMS, Orsay) In collaboration with: F. Krząkała (ESPCI Paris) G. Semerjian (ENS Paris) A. Montanari (Standford) F. Ricci-Tersenghi (La

More information

What can be sampled locally?

What can be sampled locally? What can be sampled locally? Yitong Yin Nanjing University Joint work with: Weiming Feng, Yuxin Sun Local Computation Locality in distributed graph algorithms. [Linial, FOCS 87, SICOMP 92] the LOCAL model:

More information

Physics on Random Graphs

Physics on Random Graphs Physics on Random Graphs Lenka Zdeborová (CNLS + T-4, LANL) in collaboration with Florent Krzakala (see MRSEC seminar), Marc Mezard, Marco Tarzia... Take Home Message Solving problems on random graphs

More information

Nonamenable Products are not Treeable

Nonamenable Products are not Treeable Version of 30 July 1999 Nonamenable Products are not Treeable by Robin Pemantle and Yuval Peres Abstract. Let X and Y be infinite graphs, such that the automorphism group of X is nonamenable, and the automorphism

More information

Ground states for exponential random graphs

Ground states for exponential random graphs Ground states for exponential random graphs Mei Yin Department of Mathematics, University of Denver March 5, 2018 We propose a perturbative method to estimate the normalization constant in exponential

More information

Spin models on random graphs

Spin models on random graphs Spin models on random graphs Sander Dommers Spin models on random graphs Sander Dommers, 2013. A catalogue record is available from the Eindhoven University of Technology Library. ISBN: 978-90-386-3348-0

More information

Loopy Belief Propagation for Bipartite Maximum Weight b-matching

Loopy Belief Propagation for Bipartite Maximum Weight b-matching Loopy Belief Propagation for Bipartite Maximum Weight b-matching Bert Huang and Tony Jebara Computer Science Department Columbia University New York, NY 10027 Outline 1. Bipartite Weighted b-matching 2.

More information

A reverse Sidorenko inequality Independent sets, colorings, and graph homomorphisms

A reverse Sidorenko inequality Independent sets, colorings, and graph homomorphisms A reverse Sidorenko inequality Independent sets, colorings, and graph homomorphisms Yufei Zhao (MIT) Joint work with Ashwin Sah (MIT) Mehtaab Sawhney (MIT) David Stoner (Harvard) Question Fix d. Which

More information

A LARGE DEVIATION PRINCIPLE FOR THE ERDŐS RÉNYI UNIFORM RANDOM GRAPH

A LARGE DEVIATION PRINCIPLE FOR THE ERDŐS RÉNYI UNIFORM RANDOM GRAPH A LARGE DEVIATION PRINCIPLE FOR THE ERDŐS RÉNYI UNIFORM RANDOM GRAPH AMIR DEMBO AND EYAL LUBETZKY Abstract. Starting with the large deviation principle (ldp) for the Erdős Rényi binomial random graph G(n,

More information

The cavity method. Vingt ans après

The cavity method. Vingt ans après The cavity method Vingt ans après Les Houches lectures 1982 Early days with Giorgio SK model E = J ij s i s j i

More information

Information, Physics, and Computation

Information, Physics, and Computation Information, Physics, and Computation Marc Mezard Laboratoire de Physique Thdorique et Moales Statistiques, CNRS, and Universit y Paris Sud Andrea Montanari Department of Electrical Engineering and Department

More information

Endogeny for the Logistic Recursive Distributional Equation

Endogeny for the Logistic Recursive Distributional Equation Zeitschrift für Analysis und ihre Anendungen Journal for Analysis and its Applications Volume 30 20, 237 25 DOI: 0.47/ZAA/433 c European Mathematical Society Endogeny for the Logistic Recursive Distributional

More information

Phase Transitions in Physics and Computer Science. Cristopher Moore University of New Mexico and the Santa Fe Institute

Phase Transitions in Physics and Computer Science. Cristopher Moore University of New Mexico and the Santa Fe Institute Phase Transitions in Physics and Computer Science Cristopher Moore University of New Mexico and the Santa Fe Institute Magnetism When cold enough, Iron will stay magnetized, and even magnetize spontaneously

More information

Some Correlation Inequalities for Ising Antiferromagnets

Some Correlation Inequalities for Ising Antiferromagnets Some Correlation Inequalities for Ising Antiferromagnets David Klein Wei-Shih Yang Department of Mathematics Department of Mathematics California State University University of Colorado Northridge, California

More information

arxiv: v2 [cond-mat.dis-nn] 29 Feb 2008

arxiv: v2 [cond-mat.dis-nn] 29 Feb 2008 Clusters of solutions and replica symmetry breaking in random k-satisfiability Andrea Montanari Depts of Electrical Engineering and Statistics, Stanford University, USA. arxiv:080.367v [cond-mat.dis-nn]

More information

Counting independent sets up to the tree threshold

Counting independent sets up to the tree threshold Counting independent sets up to the tree threshold Dror Weitz March 16, 2006 Abstract We consider the problem of approximately counting/sampling weighted independent sets of a graph G with activity λ,

More information

Walk-Sum Interpretation and Analysis of Gaussian Belief Propagation

Walk-Sum Interpretation and Analysis of Gaussian Belief Propagation Walk-Sum Interpretation and Analysis of Gaussian Belief Propagation Jason K. Johnson, Dmitry M. Malioutov and Alan S. Willsky Department of Electrical Engineering and Computer Science Massachusetts Institute

More information

Improved FPTAS for Multi-Spin Systems

Improved FPTAS for Multi-Spin Systems Improved FPTAS for Multi-Spin Systems Pinyan Lu and Yitong Yin 2 Microsoft Research Asia, China. pinyanl@microsoft.com 2 State Key Laboratory for Novel Software Technology, Nanjing University, China. yinyt@nju.edu.cn

More information

Cluster and virial expansions for multi-species models

Cluster and virial expansions for multi-species models Cluster and virial expansions for multi-species models Sabine Jansen Ruhr-Universität Bochum Yerevan, September 2016 Overview 1. Motivation: dynamic nucleation models 2. Statistical mechanics for mixtures

More information

Local limits of random graphs

Local limits of random graphs Local limits of random graphs Disclaimer. These pages a correspond to notes for three lectures given by Itai Benjamini and Nicolas Curien at the ANR AGORA 2011 meeting in le château de Goutelas. Thanks

More information

Phase Transitions in Random Discrete Structures

Phase Transitions in Random Discrete Structures Institut für Optimierung und Diskrete Mathematik Phase Transition in Thermodynamics The phase transition deals with a sudden change in the properties of an asymptotically large structure by altering critical

More information

Random Graph Coloring

Random Graph Coloring Random Graph Coloring Amin Coja-Oghlan Goethe University Frankfurt A simple question... What is the chromatic number of G(n,m)? [ER 60] n vertices m = dn/2 random edges ... that lacks a simple answer Early

More information

Gibbs measures in statistical physics and combinatorics

Gibbs measures in statistical physics and combinatorics Gibbs measures in statistical physics and combinatorics Will Perkins University of Birmingham March 30, 2018 Extremal thorems for sparse graphs Extremal theorems for bounded degree graphs Two classic extremal

More information

The Minesweeper game: Percolation and Complexity

The Minesweeper game: Percolation and Complexity The Minesweeper game: Percolation and Complexity Elchanan Mossel Hebrew University of Jerusalem and Microsoft Research March 15, 2002 Abstract We study a model motivated by the minesweeper game In this

More information

A simple branching process approach to the phase transition in G n,p

A simple branching process approach to the phase transition in G n,p A simple branching process approach to the phase transition in G n,p Béla Bollobás Department of Pure Mathematics and Mathematical Statistics Wilberforce Road, Cambridge CB3 0WB, UK b.bollobas@dpmms.cam.ac.uk

More information

COUNTING SELF-AVOIDING WALKS

COUNTING SELF-AVOIDING WALKS COUNTING SELF-AVOIDING WALKS GEOFFREY R. GRIMMETT AND ZHONGYANG LI Abstract. The connective constant µ(g) of a graph G is the asymptotic growth rate of the number of self-avoiding walks on G from a given

More information

Bootstrap Percolation on Periodic Trees

Bootstrap Percolation on Periodic Trees Bootstrap Percolation on Periodic Trees Milan Bradonjić Iraj Saniee Abstract We study bootstrap percolation with the threshold parameter θ 2 and the initial probability p on infinite periodic trees that

More information

Notes 6 : First and second moment methods

Notes 6 : First and second moment methods Notes 6 : First and second moment methods Math 733-734: Theory of Probability Lecturer: Sebastien Roch References: [Roc, Sections 2.1-2.3]. Recall: THM 6.1 (Markov s inequality) Let X be a non-negative

More information

UNDERSTANDING BELIEF PROPOGATION AND ITS GENERALIZATIONS

UNDERSTANDING BELIEF PROPOGATION AND ITS GENERALIZATIONS UNDERSTANDING BELIEF PROPOGATION AND ITS GENERALIZATIONS JONATHAN YEDIDIA, WILLIAM FREEMAN, YAIR WEISS 2001 MERL TECH REPORT Kristin Branson and Ian Fasel June 11, 2003 1. Inference Inference problems

More information

Survival Probabilities for N-ary Subtrees on a Galton-Watson Family Tree

Survival Probabilities for N-ary Subtrees on a Galton-Watson Family Tree Survival Probabilities for N-ary Subtrees on a Galton-Watson Family Tree arxiv:0706.1904v2 [math.pr] 4 Mar 2008 Ljuben R. Mutafchiev American University in Bulgaria 2700 Blagoevgrad, Bulgaria and Institute

More information

Scribes: Po-Hsuan Wei, William Kuzmaul Editor: Kevin Wu Date: October 18, 2016

Scribes: Po-Hsuan Wei, William Kuzmaul Editor: Kevin Wu Date: October 18, 2016 CS 267 Lecture 7 Graph Spanners Scribes: Po-Hsuan Wei, William Kuzmaul Editor: Kevin Wu Date: October 18, 2016 1 Graph Spanners Our goal is to compress information about distances in a graph by looking

More information

5. Density evolution. Density evolution 5-1

5. Density evolution. Density evolution 5-1 5. Density evolution Density evolution 5-1 Probabilistic analysis of message passing algorithms variable nodes factor nodes x1 a x i x2 a(x i ; x j ; x k ) x3 b x4 consider factor graph model G = (V ;

More information

The Ising Partition Function: Zeros and Deterministic Approximation

The Ising Partition Function: Zeros and Deterministic Approximation The Ising Partition Function: Zeros and Deterministic Approximation Jingcheng Liu Alistair Sinclair Piyush Srivastava University of California, Berkeley Summer 2017 Jingcheng Liu (UC Berkeley) The Ising

More information

Bivariate Uniqueness in the Logistic Recursive Distributional Equation

Bivariate Uniqueness in the Logistic Recursive Distributional Equation Bivariate Uniqueness in the Logistic Recursive Distributional Equation Antar Bandyopadhyay Technical Report # 629 University of California Department of Statistics 367 Evans Hall # 3860 Berkeley CA 94720-3860

More information

arxiv: v1 [math.pr] 11 Dec 2017

arxiv: v1 [math.pr] 11 Dec 2017 Local limits of spatial Gibbs random graphs Eric Ossami Endo Department of Applied Mathematics eric@ime.usp.br Institute of Mathematics and Statistics - IME USP - University of São Paulo Johann Bernoulli

More information

Reconstruction in the Generalized Stochastic Block Model

Reconstruction in the Generalized Stochastic Block Model Reconstruction in the Generalized Stochastic Block Model Marc Lelarge 1 Laurent Massoulié 2 Jiaming Xu 3 1 INRIA-ENS 2 INRIA-Microsoft Research Joint Centre 3 University of Illinois, Urbana-Champaign GDR

More information

Bayesian Machine Learning - Lecture 7

Bayesian Machine Learning - Lecture 7 Bayesian Machine Learning - Lecture 7 Guido Sanguinetti Institute for Adaptive and Neural Computation School of Informatics University of Edinburgh gsanguin@inf.ed.ac.uk March 4, 2015 Today s lecture 1

More information

Reconstruction for Models on Random Graphs

Reconstruction for Models on Random Graphs 1 Stanford University, 2 ENS Paris October 21, 2007 Outline 1 The Reconstruction Problem 2 Related work and applications 3 Results The Reconstruction Problem: A Story Alice and Bob Alice, Bob and G root

More information

An Application of Catalan Numbers on Cayley Tree of Order 2: Single Polygon Counting

An Application of Catalan Numbers on Cayley Tree of Order 2: Single Polygon Counting BULLETIN of the Malaysian Mathematical Sciences Society http://math.usm.my/bulletin Bull. Malays. Math. Sci. Soc. (2) 31(2) (2008), 175 183 An Application of Catalan Numbers on Cayley Tree of Order 2:

More information

A = A U. U [n] P(A U ). n 1. 2 k(n k). k. k=1

A = A U. U [n] P(A U ). n 1. 2 k(n k). k. k=1 Lecture I jacques@ucsd.edu Notation: Throughout, P denotes probability and E denotes expectation. Denote (X) (r) = X(X 1)... (X r + 1) and let G n,p denote the Erdős-Rényi model of random graphs. 10 Random

More information

Simulation of Max Stable Processes

Simulation of Max Stable Processes Simulation of Max Stable Processes Whitney Huang Department of Statistics Purdue University November 6, 2013 1 / 30 Outline 1 Max-Stable Processes 2 Unconditional Simulations 3 Conditional Simulations

More information

Random Lifts of Graphs

Random Lifts of Graphs 27th Brazilian Math Colloquium, July 09 Plan of this talk A brief introduction to the probabilistic method. A quick review of expander graphs and their spectrum. Lifts, random lifts and their properties.

More information

NOTES ON MATCHINGS IN CONVERGENT GRAPH SEQUENCES

NOTES ON MATCHINGS IN CONVERGENT GRAPH SEQUENCES NOTES ON MATCHINGS IN CONVERGENT GRAPH SEQUENCES HARRY RICHMAN Abstract. These are notes on the paper Matching in Benjamini-Schramm convergent graph sequences by M. Abért, P. Csikvári, P. Frenkel, and

More information

arxiv: v1 [math.pr] 13 Dec 2017

arxiv: v1 [math.pr] 13 Dec 2017 Statistical physics on a product of trees Tom Hutchcroft arxiv:1712.04911v1 [math.pr] 13 Dec 2017 December 14, 2017 Abstract Let G be the product of finitely many trees T 1 T 2 T N, each of which is regular

More information

Fractal Geometry of Minimal Spanning Trees

Fractal Geometry of Minimal Spanning Trees Fractal Geometry of Minimal Spanning Trees T. S. Jackson and N. Read Part I: arxiv:0902.3651 Part II: arxiv:0909.5343 Accepted by Phys. Rev. E Problem Definition Given a graph with costs on the edges,

More information

Studying large networks via local weak limit theory

Studying large networks via local weak limit theory Studying large networks via local weak limit theory Venkat Anantharam EECS Department University of California, Berkeley March 10, 2017 Advanced Networks Colloquium University of Maryland, College Park

More information

arxiv:math/ v1 [math.pr] 29 Nov 2002

arxiv:math/ v1 [math.pr] 29 Nov 2002 arxiv:math/0211455v1 [math.pr] 29 Nov 2002 Trees and Matchings from Point Processes Alexander E. Holroyd Yuval Peres February 1, 2008 Abstract A factor graph of a point process is a graph whose vertices

More information

Phase Transitions (and their meaning) in Random Constraint Satisfaction Problems

Phase Transitions (and their meaning) in Random Constraint Satisfaction Problems International Workshop on Statistical-Mechanical Informatics 2007 Kyoto, September 17 Phase Transitions (and their meaning) in Random Constraint Satisfaction Problems Florent Krzakala In collaboration

More information

Cutwidth and degeneracy of graphs

Cutwidth and degeneracy of graphs Cutwidth and degeneracy of graphs Benoit Kloeckner To cite this version: Benoit Kloeckner. Cutwidth and degeneracy of graphs. IF_PREPUB. 2009. HAL Id: hal-00408210 https://hal.archives-ouvertes.fr/hal-00408210v1

More information

Beyond Log-Supermodularity: Lower Bounds and the Bethe Partition Function

Beyond Log-Supermodularity: Lower Bounds and the Bethe Partition Function Beyond Log-Supermodularity: Lower Bounds and the Bethe Partition Function Nicholas Ruozzi Communication Theory Laboratory École Polytechnique Fédérale de Lausanne Lausanne, Switzerland nicholas.ruozzi@epfl.ch

More information

13 : Variational Inference: Loopy Belief Propagation and Mean Field

13 : Variational Inference: Loopy Belief Propagation and Mean Field 10-708: Probabilistic Graphical Models 10-708, Spring 2012 13 : Variational Inference: Loopy Belief Propagation and Mean Field Lecturer: Eric P. Xing Scribes: Peter Schulam and William Wang 1 Introduction

More information

The Sherrington-Kirkpatrick model

The Sherrington-Kirkpatrick model Stat 36 Stochastic Processes on Graphs The Sherrington-Kirkpatrick model Andrea Montanari Lecture - 4/-4/00 The Sherrington-Kirkpatrick (SK) model was introduced by David Sherrington and Scott Kirkpatrick

More information

The Lopsided Lovász Local Lemma

The Lopsided Lovász Local Lemma Department of Mathematics Nebraska Wesleyan University With Linyuan Lu and László Székely, University of South Carolina Note on Probability Spaces For this talk, every a probability space Ω is assumed

More information

Edge-disjoint induced subgraphs with given minimum degree

Edge-disjoint induced subgraphs with given minimum degree Edge-disjoint induced subgraphs with given minimum degree Raphael Yuster Department of Mathematics University of Haifa Haifa 31905, Israel raphy@math.haifa.ac.il Submitted: Nov 9, 01; Accepted: Feb 5,

More information

Lecture 5: Counting independent sets up to the tree threshold

Lecture 5: Counting independent sets up to the tree threshold CS 7535: Markov Chain Monte Carlo Algorithms Fall 2014 Lecture 5: Counting independent sets up to the tree threshold Lecturer: Richard Brooks and Rakshit Trivedi Date: December 02 In this lecture, we will

More information

Advanced Algorithms 南京大学 尹一通

Advanced Algorithms 南京大学 尹一通 Advanced Algorithms 南京大学 尹一通 Constraint Satisfaction Problem variables: (CSP) X = {x 1, x2,..., xn} each variable ranges over a finite domain Ω an assignment σ ΩX assigns each variable a value in Ω constraints:

More information

3.2 Configuration model

3.2 Configuration model 3.2 Configuration model 3.2.1 Definition. Basic properties Assume that the vector d = (d 1,..., d n ) is graphical, i.e., there exits a graph on n vertices such that vertex 1 has degree d 1, vertex 2 has

More information

Entropy for Sparse Random Graphs With Vertex-Names

Entropy for Sparse Random Graphs With Vertex-Names Entropy for Sparse Random Graphs With Vertex-Names David Aldous 11 February 2013 if a problem seems... Research strategy (for old guys like me): do-able = give to Ph.D. student maybe do-able = give to

More information

Lecture 6: September 22

Lecture 6: September 22 CS294 Markov Chain Monte Carlo: Foundations & Applications Fall 2009 Lecture 6: September 22 Lecturer: Prof. Alistair Sinclair Scribes: Alistair Sinclair Disclaimer: These notes have not been subjected

More information

CSC 412 (Lecture 4): Undirected Graphical Models

CSC 412 (Lecture 4): Undirected Graphical Models CSC 412 (Lecture 4): Undirected Graphical Models Raquel Urtasun University of Toronto Feb 2, 2016 R Urtasun (UofT) CSC 412 Feb 2, 2016 1 / 37 Today Undirected Graphical Models: Semantics of the graph:

More information

2 The Curie Weiss Model

2 The Curie Weiss Model 2 The Curie Weiss Model In statistical mechanics, a mean-field approximation is often used to approximate a model by a simpler one, whose global behavior can be studied with the help of explicit computations.

More information

Undirected Graphical Models

Undirected Graphical Models Undirected Graphical Models 1 Conditional Independence Graphs Let G = (V, E) be an undirected graph with vertex set V and edge set E, and let A, B, and C be subsets of vertices. We say that C separates

More information

Graph limits Graph convergence Approximate asymptotic properties of large graphs Extremal combinatorics/computer science : flag algebra method, proper

Graph limits Graph convergence Approximate asymptotic properties of large graphs Extremal combinatorics/computer science : flag algebra method, proper Jacob Cooper Dan Král Taísa Martins University of Warwick Monash University - Discrete Maths Research Group Graph limits Graph convergence Approximate asymptotic properties of large graphs Extremal combinatorics/computer

More information

The condensation phase transition in random graph coloring

The condensation phase transition in random graph coloring The condensation phase transition in random graph coloring Victor Bapst Goethe University, Frankfurt Joint work with Amin Coja-Oghlan, Samuel Hetterich, Felicia Rassmann and Dan Vilenchik arxiv:1404.5513

More information

Directed Dominating Set Problem Studied by Cavity Method: Warning Propagation and Population Dynamics

Directed Dominating Set Problem Studied by Cavity Method: Warning Propagation and Population Dynamics Commun. Theor. Phys. 70 (28) 785 794 Vol. 70, No. 6, December 1, 28 Directed Dominating Set Problem Studied by Cavity Method: Warning Propagation and Population Dynamics Yusupjan Habibulla ( 玉素甫 艾比布拉 )

More information

arxiv: v2 [cs.ds] 11 Jan 2018

arxiv: v2 [cs.ds] 11 Jan 2018 The cavity approach for Steiner trees Packing Problems Alfredo Braunstein DISAT, Politecnico di Torino, Corso Duca Degli Abruzzi 4, Torino, Italy Human Genetics Foundation, Via Nizza 5, Torino, Italy and

More information

arxiv: v3 [math.pr] 19 Apr 2018

arxiv: v3 [math.pr] 19 Apr 2018 Exponential random graphs behave like mixtures of stochastic block models Ronen Eldan and Renan Gross arxiv:70707v3 [mathpr] 9 Apr 08 Abstract We study the behavior of exponential random graphs in both

More information

Perfect simulation for image analysis

Perfect simulation for image analysis Perfect simulation for image analysis Mark Huber Fletcher Jones Foundation Associate Professor of Mathematics and Statistics and George R. Roberts Fellow Mathematical Sciences Claremont McKenna College

More information

Growth Rate of Spatially Coupled LDPC codes

Growth Rate of Spatially Coupled LDPC codes Growth Rate of Spatially Coupled LDPC codes Workshop on Spatially Coupled Codes and Related Topics at Tokyo Institute of Technology 2011/2/19 Contents 1. Factor graph, Bethe approximation and belief propagation

More information

Simons Workshop on Approximate Counting, Markov Chains and Phase Transitions: Open Problem Session

Simons Workshop on Approximate Counting, Markov Chains and Phase Transitions: Open Problem Session Simons Workshop on Approximate Counting, Markov Chains and Phase Transitions: Open Problem Session Scribes: Antonio Blanca, Sarah Cannon, Yumeng Zhang February 4th, 06 Yuval Peres: Simple Random Walk on

More information

arxiv: v1 [math.pr] 29 Jan 2018

arxiv: v1 [math.pr] 29 Jan 2018 Controllability, matching ratio and graph convergence Dorottya Beringer Ádám Timár January 30, 2018 arxiv:1801.09647v1 [math.pr] 29 Jan 2018 Abstract There is an important parameter in control theory which

More information

Interfaces between Probability and Geometry

Interfaces between Probability and Geometry Interfaces between Probability and Geometry (Prospects in Mathematics Durham, 15 December 2007) Wilfrid Kendall w.s.kendall@warwick.ac.uk Department of Statistics, University of Warwick Introduction Brownian

More information

On the critical value function in the divide and color model

On the critical value function in the divide and color model ALEA, Lat. Am. J. Probab. Math. Stat. 10 (2), 653 666 (2013) On the critical value function in the divide and color model András Bálint, Vincent Beffara and Vincent Tassion Chalmers University of Technology

More information

Resistance Growth of Branching Random Networks

Resistance Growth of Branching Random Networks Peking University Oct.25, 2018, Chengdu Joint work with Yueyun Hu (U. Paris 13) and Shen Lin (U. Paris 6), supported by NSFC Grant No. 11528101 (2016-2017) for Research Cooperation with Oversea Investigators

More information

arxiv:math.pr/ v1 21 Oct 2005

arxiv:math.pr/ v1 21 Oct 2005 Counting without sampling. New algorithms for enumeration problems using statistical physics arxiv:math.pr/05047 v 2 Oct 2005 Antar Bandyopadhyay David Gamarnik October 2, 2005 Abstract We propose a new

More information