THE PHYSICS OF COUNTING AND SAMPLING ON RANDOM INSTANCES. Lenka Zdeborová
|
|
- Neil Joseph
- 6 years ago
- Views:
Transcription
1 THE PHYSICS OF COUNTING AND SAMPLING ON RANDOM INSTANCES Lenka Zdeborová (CEA Saclay and CNRS, France)
2 MAIN CONTRIBUTORS TO THE PHYSICS UNDERSTANDING OF RANDOM INSTANCES Braunstein, Franz, Kabashima, Kirkpatrick, Krzakala, Monasson, Montanari, Nishimori, Pagnani, Parisi, Ricci- Tersenghi, Saad, Semerjian, Sherrington, Sourlas, Sompolinsky, Tanaka, Weigt, Zdeborova, Zecchina,...
3 WHY RANDOM? also Andrea s talk First step towards typical instances. Intriguing mathematical properties Solvable (by theoretical physics standards, mean field...). Using belief propagation, Bethe approximation and its extensions, cavity method, replica symmetry breaking. Ideas, inspiration and benchmarks for algorithms
4 THE PICTURE This talk s example: Graph coloring on random graphs. Resulting picture relevant for: satisfiability, CSP, vertex cover, independent sets, max-cut,... error correcting codes, sparse estimation, regression, clustering, compressed sensing, feature learning, neural networks,...
5 GRAPH COLORING How many proper colorings on a large random graph? Can they be sampled uniformly? MCMC properties? Variant 1: Finite temperature µ({s i } i=1,...,n )= 1 Z G ( ) e P (ij)2e s i,s j Variant 2: Planted graphs Fix a random string of colors {s i } i=1,...,n also Andrea s talk s i = s j ) (ij) /2 E
6 COUNTING COLORINGS Averaging and the large N limit. V = N, E = M, c =2M/N c fixed,n!1, Annealed entropy s ann = lim N!1 1 N [log E(Z G)] = log q + c 2 log 1 1 q Quenched entropy s = lim N!1 1 N E[log (Z G + 1)]
7 COUNTING COLORINGS V = N, E = M, c =2M/N s ann = lim N!1 1 N [log E(Z G)] = log q + c 2 log (1 1 q ) c fixed,n!1, s = lim N!1 1 N E[log (Z G + 1)] cc: colorability threshold s = 0 for c>c c ck: Kauzmann/condensation s<s ann for c>c K (Krzakala et al. PNAS 07)
8 PHASE TRANSITIONS cu cd ck cc cc: colorability threshold ck: Kauzmann/condensation transition cd: dynamical/clustering/reconstruction transition cu: unicity threshold sometimes (e.g. 3-SAT or 3-coloring) ck= cd
9 SAMPLING Recall: random graph, random or warm start, weaker convergence that total variation. cluster = blue blob = subspace that MCMC samples uniformly in linear time. cu cd ck cc q!1 q q log q 2q log q = lim N!1 1 N E[log (#clusters)]
10 TEMPERATURE DEPENDENCE liquid liquid dynamical glass ideal glass
11 TEMPERATURE DEPENDENCE sampling easy liquid liquid dynamical glass ideal glass sampling hard
12 WHAT IS A PHASE TRANSITION? Phase transition always characterized by a divergence of a correlation length: point-to-set two-point T & T d T & T K (Montanari, Semerjian 06)
13 WHAT IS A PHASE TRANSITION? Phase transition always characterized by a divergence of a correlation length: point-to-set two-point T & T d T & T K (Montanari, Semerjian 06)
14 PLANTED COLORING also Andrea s talk Definition: Fix a random string at random such that if {s i } i=1,...,n s i = s j ) (ij) /2 E choose M edges Interest n.1 = paradigm of statistical inference (95% of use of MCMC in computer science). Bayes optimal inference = computing marginals of the posterior distribution = approximate counting problem. Interest n.2 = Math simpler. Warm start for MCMC for free.
15 PLANTED COLORING Definition: Fix a random string at random such that if {s i } i=1,...,n s i = s j ) (ij) /2 E choose M edges (Krzakala, LZ 09)
16 PLANTED PHASE TRANSITIONS cu cd ck cc For c<ck random and planted contiguous, statistical inference impossible, planted configuration is an equilibrium one. In cases for which ck= cd (e.g. 3-col, 3-sat) we have that for c>ck statistical inference is easy. MCMC becomes fast correlated to the planted configuration.
17 PLANTED PHASE TRANSITIONS cu cd ck cc q!1 q q log q 2q log q q 2 For c<ck random and planted contiguous, statistical inference impossible, planted configuration is an equilibrium one. cs spinodal phase transition at c s evaluation of marginals (inference, sampling) hard evaluation of marginals tractable c>c s c K <c<c s
18 1ST ORDER TRANSITION 1 planted 5-coloring log Z 0.8 overlap c d init. planted init. random q=5,c in =0, N=100k c s overlap c
19 1ST ORDER TRANSITIONS Phase of possible but hard inference. Equilibrium state hidden by metastability. known bounds impossible hard known algorithms easy ck cs amount of information in the measurements The hard phase quantified also in: planted constraint satisfaction, compressed sensing, stochastic block model, dictionary learning, blind source separation, sparse PCA, error correcting codes, others...
20 THE BIG QUESTION Establish rigorous notions of algorithmic complexity (some kind of dichotomies) that are sensitive to the dynamical (cd) and the spinodal (cs) phase transition.
Phase Transitions in the Coloring of Random Graphs
Phase Transitions in the Coloring of Random Graphs Lenka Zdeborová (LPTMS, Orsay) In collaboration with: F. Krząkała (ESPCI Paris) G. Semerjian (ENS Paris) A. Montanari (Standford) F. Ricci-Tersenghi (La
More informationPhase Transitions (and their meaning) in Random Constraint Satisfaction Problems
International Workshop on Statistical-Mechanical Informatics 2007 Kyoto, September 17 Phase Transitions (and their meaning) in Random Constraint Satisfaction Problems Florent Krzakala In collaboration
More informationThe non-backtracking operator
The non-backtracking operator Florent Krzakala LPS, Ecole Normale Supérieure in collaboration with Paris: L. Zdeborova, A. Saade Rome: A. Decelle Würzburg: J. Reichardt Santa Fe: C. Moore, P. Zhang Berkeley:
More informationPredicting Phase Transitions in Hypergraph q-coloring with the Cavity Method
Predicting Phase Transitions in Hypergraph q-coloring with the Cavity Method Marylou Gabrié (LPS, ENS) Varsha Dani (University of New Mexico), Guilhem Semerjian (LPT, ENS), Lenka Zdeborová (CEA, Saclay)
More informationThe condensation phase transition in random graph coloring
The condensation phase transition in random graph coloring Victor Bapst Goethe University, Frankfurt Joint work with Amin Coja-Oghlan, Samuel Hetterich, Felicia Rassmann and Dan Vilenchik arxiv:1404.5513
More informationLearning from and about complex energy landspaces
Learning from and about complex energy landspaces Lenka Zdeborová (CNLS + T-4, LANL) in collaboration with: Florent Krzakala (ParisTech) Thierry Mora (Princeton Univ.) Landscape Landscape Santa Fe Institute
More informationOn convergence of Approximate Message Passing
On convergence of Approximate Message Passing Francesco Caltagirone (1), Florent Krzakala (2) and Lenka Zdeborova (1) (1) Institut de Physique Théorique, CEA Saclay (2) LPS, Ecole Normale Supérieure, Paris
More informationPhysics on Random Graphs
Physics on Random Graphs Lenka Zdeborová (CNLS + T-4, LANL) in collaboration with Florent Krzakala (see MRSEC seminar), Marc Mezard, Marco Tarzia... Take Home Message Solving problems on random graphs
More informationOn the number of circuits in random graphs. Guilhem Semerjian. [ joint work with Enzo Marinari and Rémi Monasson ]
On the number of circuits in random graphs Guilhem Semerjian [ joint work with Enzo Marinari and Rémi Monasson ] [ Europhys. Lett. 73, 8 (2006) ] and [ cond-mat/0603657 ] Orsay 13-04-2006 Outline of the
More informationPhase transition phenomena of statistical mechanical models of the integer factorization problem (submitted to JPSJ, now in review process)
Phase transition phenomena of statistical mechanical models of the integer factorization problem (submitted to JPSJ, now in review process) Chihiro Nakajima WPI-AIMR, Tohoku University Masayuki Ohzeki
More informationInformation, Physics, and Computation
Information, Physics, and Computation Marc Mezard Laboratoire de Physique Thdorique et Moales Statistiques, CNRS, and Universit y Paris Sud Andrea Montanari Department of Electrical Engineering and Department
More informationPhase transitions in discrete structures
Phase transitions in discrete structures Amin Coja-Oghlan Goethe University Frankfurt Overview 1 The physics approach. [following Mézard, Montanari 09] Basics. Replica symmetry ( Belief Propagation ).
More informationarxiv: v1 [cond-mat.dis-nn] 16 Feb 2018
Parallel Tempering for the planted clique problem Angelini Maria Chiara 1 1 Dipartimento di Fisica, Ed. Marconi, Sapienza Università di Roma, P.le A. Moro 2, 00185 Roma Italy arxiv:1802.05903v1 [cond-mat.dis-nn]
More informationThe cavity method. Vingt ans après
The cavity method Vingt ans après Les Houches lectures 1982 Early days with Giorgio SK model E = J ij s i s j i
More informationarxiv: v4 [cond-mat.stat-mech] 28 Jul 2016
Statistical physics of inference: Thresholds and algorithms Lenka Zdeborová 1,, and Florent Krzakala 2, 1 Institut de Physique Théorique, CNRS, CEA, Université Paris-Saclay, F-91191, Gif-sur-Yvette, France
More informationApproximate counting of large subgraphs in random graphs with statistical mechanics methods
Approximate counting of large subgraphs in random graphs with statistical mechanics methods Guilhem Semerjian LPT-ENS Paris 13.03.08 / Eindhoven in collaboration with Rémi Monasson, Enzo Marinari and Valery
More informationStatistical Physics on Sparse Random Graphs: Mathematical Perspective
Statistical Physics on Sparse Random Graphs: Mathematical Perspective Amir Dembo Stanford University Northwestern, July 19, 2016 x 5 x 6 Factor model [DM10, Eqn. (1.4)] x 1 x 2 x 3 x 4 x 9 x8 x 7 x 10
More informationarxiv: v1 [cond-mat.dis-nn] 18 Dec 2009
arxiv:0912.3563v1 [cond-mat.dis-nn] 18 Dec 2009 Belief propagation for graph partitioning Petr Šulc 1,2,3, Lenka Zdeborová 1 1 Theoretical Division and Center for Nonlinear Studies, Los Alamos National
More informationRandom Graph Coloring
Random Graph Coloring Amin Coja-Oghlan Goethe University Frankfurt A simple question... What is the chromatic number of G(n,m)? [ER 60] n vertices m = dn/2 random edges ... that lacks a simple answer Early
More informationPerturbed Message Passing for Constraint Satisfaction Problems
Journal of Machine Learning Research 16 (2015) 1249-1274 Submitted 4/13; Revised 9/14; Published 7/15 Perturbed Message Passing for Constraint Satisfaction Problems Siamak Ravanbakhsh Russell Greiner Department
More informationConstraint satisfaction problems (CSPs) arise in a large spectrum
Gibbs states and the set of solutions of random constraint satisfaction problems Florent Krza kała a, Andrea Montanari b,c,d, Federico Ricci-Tersenghi e, Guilhem Semerjian c, and Lenka Zdeborová f a Laboratoire
More informationChasing the k-sat Threshold
Chasing the k-sat Threshold Amin Coja-Oghlan Goethe University Frankfurt Random Discrete Structures In physics, phase transitions are studied by non-rigorous methods. New mathematical ideas are necessary
More informationThis is an electronic reprint of the original article. This reprint may differ from the original in pagination and typographic detail.
Powered by TCPDF (www.tcpdf.org) This is an electronic reprint of the original article. This reprint may differ from the original in pagination and typographic detail. Alava, Mikko; Ardelius, John; Aurell,
More informationAlgebraic characteristics and satisfiability threshold of random Boolean equations
Renmin University of China From the SelectedWorks of Yifan Sun Summer July, Algebraic characteristics and satisfiability threshold of random Boolean equations Binghui Guo, Dr, Beihang University Wei Wei,
More informationPhase transitions in low-rank matrix estimation
Phase transitions in low-rank matrix estimation Florent Krzakala http://krzakala.github.io/lowramp/ arxiv:1503.00338 & 1507.03857 Thibault Lesieur Lenka Zeborová Caterina Debacco Cris Moore Jess Banks
More informationPhase Transitions and Local Search for k-satisfiability
Phase Transitions and Local Search for k-satisfiability Pekka Orponen (joint work with many others) Department of Information and Computer Science Helsinki University of Technology TKK Outline Part I:
More informationarxiv: v3 [cs.na] 21 Mar 2016
Phase transitions and sample complexity in Bayes-optimal matrix factorization ariv:40.98v3 [cs.a] Mar 06 Yoshiyuki Kabashima, Florent Krzakala, Marc Mézard 3, Ayaka Sakata,4, and Lenka Zdeborová 5, Department
More informationPan Zhang Ph.D. Santa Fe Institute 1399 Hyde Park Road Santa Fe, NM 87501, USA
Pan Zhang Ph.D. Santa Fe Institute 1399 Hyde Park Road Santa Fe, NM 87501, USA PERSONAL DATA Date of Birth: November 19, 1983 Nationality: China Mail: 1399 Hyde Park Rd, Santa Fe, NM 87501, USA E-mail:
More informationarxiv: v3 [cond-mat.dis-nn] 3 Sep 2012
Replica Cluster Variational Method: the Replica Symmetric solution for the 2D random bond Ising model Alejandro Lage-Castellanos Henri-Poincaré-Group of Complex Systems and Department of Theoretical Physics,
More informationVariational algorithms for marginal MAP
Variational algorithms for marginal MAP Alexander Ihler UC Irvine CIOG Workshop November 2011 Variational algorithms for marginal MAP Alexander Ihler UC Irvine CIOG Workshop November 2011 Work with Qiang
More informationLong Range Frustration in Finite Connectivity Spin Glasses: Application to the random K-satisfiability problem
arxiv:cond-mat/0411079v1 [cond-mat.dis-nn] 3 Nov 2004 Long Range Frustration in Finite Connectivity Spin Glasses: Application to the random K-satisfiability problem Haijun Zhou Max-Planck-Institute of
More informationThe spin-glass cornucopia
The spin-glass cornucopia Marc Mézard! Ecole normale supérieure - PSL Research University and CNRS, Université Paris Sud LPT-ENS, January 2015 40 years of research n 40 years of research 70 s:anomalies
More informationarxiv: v2 [cond-mat.dis-nn] 4 Dec 2008
Constraint satisfaction problems with isolated solutions are hard Lenka Zdeborová Université Paris-Sud, LPTMS, UMR8626, Bât. 00, Université Paris-Sud 9405 Orsay cedex CNRS, LPTMS, UMR8626, Bât. 00, Université
More informationStatistical Physics of Inference and Bayesian Estimation
Statistical Physics of Inference and Bayesian Estimation Florent Krzakala, Lenka Zdeborova, Maria Chiara Angelini and Francesco Caltagirone Contents Bayesian Inference and Estimators 3. The Bayes formula..........................................
More informationPropagating beliefs in spin glass models. Abstract
Propagating beliefs in spin glass models Yoshiyuki Kabashima arxiv:cond-mat/0211500v1 [cond-mat.dis-nn] 22 Nov 2002 Department of Computational Intelligence and Systems Science, Tokyo Institute of Technology,
More informationSolution-space structure of (some) optimization problems
Solution-space structure of (some) optimization problems Alexander K. Hartmann 1, Alexander Mann 2 and Wolfgang Radenbach 3 1 Institute for Physics, University of Oldenburg, 26111 Oldenburg, Germany 2
More informationAlgorithmic Barriers from Phase Transitions
Algorithmic Barriers from Phase Transitions Dimitris Achlioptas Amin Coja-Oghlan Abstract For many random Constraint Satisfaction Problems, by now there exist asymptotically tight estimates of the largest
More informationSparse Superposition Codes for the Gaussian Channel
Sparse Superposition Codes for the Gaussian Channel Florent Krzakala (LPS, Ecole Normale Supérieure, France) J. Barbier (ENS) arxiv:1403.8024 presented at ISIT 14 Long version in preparation Communication
More informationarxiv: v2 [cond-mat.dis-nn] 29 Feb 2008
Clusters of solutions and replica symmetry breaking in random k-satisfiability Andrea Montanari Depts of Electrical Engineering and Statistics, Stanford University, USA. arxiv:080.367v [cond-mat.dis-nn]
More informationLearning About Spin Glasses Enzo Marinari (Cagliari, Italy) I thank the organizers... I am thrilled since... (Realistic) Spin Glasses: a debated, inte
Learning About Spin Glasses Enzo Marinari (Cagliari, Italy) I thank the organizers... I am thrilled since... (Realistic) Spin Glasses: a debated, interesting issue. Mainly work with: Giorgio Parisi, Federico
More informationThe Sherrington-Kirkpatrick model
Stat 36 Stochastic Processes on Graphs The Sherrington-Kirkpatrick model Andrea Montanari Lecture - 4/-4/00 The Sherrington-Kirkpatrick (SK) model was introduced by David Sherrington and Scott Kirkpatrick
More information3-Coloring of Random Graphs
3-Coloring of Random Graphs Josep Díaz 1 UPC 1 Research partially supported by the Future and Emerging Technologies programme of the EU under contract 001907 (DELIS) Coloring problems. Given a graph G
More informationSpin glasses, where do we stand?
Spin glasses, where do we stand? Giorgio Parisi Many progresses have recently done in spin glasses: theory, experiments, simulations and theorems! In this talk I will present: A very brief introduction
More informationReconstruction for Models on Random Graphs
1 Stanford University, 2 ENS Paris October 21, 2007 Outline 1 The Reconstruction Problem 2 Related work and applications 3 Results The Reconstruction Problem: A Story Alice and Bob Alice, Bob and G root
More information13: Variational inference II
10-708: Probabilistic Graphical Models, Spring 2015 13: Variational inference II Lecturer: Eric P. Xing Scribes: Ronghuo Zheng, Zhiting Hu, Yuntian Deng 1 Introduction We started to talk about variational
More informationBrazilian Journal of Physics ISSN: Sociedade Brasileira de Física Brasil
Brazilian Journal of Physics ISSN: 0103-9733 luizno.bjp@gmail.com Sociedade Brasileira de Física Brasil Almeida, J.R.L. de On the Entropy of the Viana-Bray Model Brazilian Journal of Physics, vol. 33,
More informationDirected Dominating Set Problem Studied by Cavity Method: Warning Propagation and Population Dynamics
Commun. Theor. Phys. 70 (28) 785 794 Vol. 70, No. 6, December 1, 28 Directed Dominating Set Problem Studied by Cavity Method: Warning Propagation and Population Dynamics Yusupjan Habibulla ( 玉素甫 艾比布拉 )
More informationReplica cluster variational method: the replica symmetric solution for the 2D random bond Ising model
IOP PUBLISHING OURNAL OF PHYSICS A: MATHEMATICAL AND THEORETICAL. Phys. A: Math. Theor. 46 (2013) 135001 (20pp) doi:10.1088/1751-8113/46/13/135001 Replica cluster variational method: the replica symmetric
More informationRisk and Noise Estimation in High Dimensional Statistics via State Evolution
Risk and Noise Estimation in High Dimensional Statistics via State Evolution Mohsen Bayati Stanford University Joint work with Jose Bento, Murat Erdogdu, Marc Lelarge, and Andrea Montanari Statistical
More informationSpin Glass Approach to Restricted Isometry Constant
Spin Glass Approach to Restricted Isometry Constant Ayaka Sakata 1,Yoshiyuki Kabashima 2 1 Institute of Statistical Mathematics 2 Tokyo Institute of Technology 1/29 Outline Background: Compressed sensing
More informationReconstruction in the Generalized Stochastic Block Model
Reconstruction in the Generalized Stochastic Block Model Marc Lelarge 1 Laurent Massoulié 2 Jiaming Xu 3 1 INRIA-ENS 2 INRIA-Microsoft Research Joint Centre 3 University of Illinois, Urbana-Champaign GDR
More informationPhase Transitions in Semisupervised Clustering of Sparse Networks
Phase Transitions in Semisupervised Clustering of Sparse Networks Pan Zhang Cristopher Moore Lenka Zdeorová SFI WORKING PAPER: 24-5-5 SFI Working Papers contain accounts of scienti5ic work of the author(s)
More informationComparing Beliefs, Surveys and Random Walks
Comparing Beliefs, Surveys and Random Walks Erik Aurell SICS, Swedish Institute of Computer Science P.O. Box 1263, SE-164 29 Kista, Sweden and Dept. of Physics, KTH Royal Institute of Technology AlbaNova
More informationNumerical Studies of the Quantum Adiabatic Algorithm
Numerical Studies of the Quantum Adiabatic Algorithm A.P. Young Work supported by Colloquium at Universität Leipzig, November 4, 2014 Collaborators: I. Hen, M. Wittmann, E. Farhi, P. Shor, D. Gosset, A.
More informationIs there a de Almeida-Thouless line in finite-dimensional spin glasses? (and why you should care)
Is there a de Almeida-Thouless line in finite-dimensional spin glasses? (and why you should care) Peter Young Talk at MPIPKS, September 12, 2013 Available on the web at http://physics.ucsc.edu/~peter/talks/mpipks.pdf
More informationCritical properties of disordered XY model on sparse random graphs
Manuale di Identità Visiva Sapienza Università di Roma Sapienza Università di Roma Scuola di Dottorato Vito Volterra Dipartimento di Fisica Critical properties of disordered XY model on sparse random graphs
More information13 : Variational Inference: Loopy Belief Propagation and Mean Field
10-708: Probabilistic Graphical Models 10-708, Spring 2012 13 : Variational Inference: Loopy Belief Propagation and Mean Field Lecturer: Eric P. Xing Scribes: Peter Schulam and William Wang 1 Introduction
More informationRelaxed Random Search for Solving K-Satisfiability and its Information Theoretic Interpretation
Relaxed Random Search for Solving K-Satisfiability and its Information Theoretic Interpretation Amirahmad Nayyeri Department of Science, Division of Computer Science Salman Farsi University of Kazerun
More informationGenerating Hard Satisfiable Formulas by Hiding Solutions Deceptively
Journal of Artificial Intelligence Research 28 (2007) 107-118 Submitted 9/05; published 2/07 Generating Hard Satisfiable Formulas by Hiding Solutions Deceptively Haixia Jia Computer Science Department
More informationFrozen variables in random boolean constraint satisfaction problems
Frozen variables in random boolean constraint satisfaction problems Michael Molloy and Ricardo Restrepo Department of Computer Science, University of Toronto 10 King s College Road, Toronto, ON July 3,
More informationAdvanced Algorithms 南京大学 尹一通
Advanced Algorithms 南京大学 尹一通 Constraint Satisfaction Problem variables: (CSP) X = {x 1, x2,..., xn} each variable ranges over a finite domain Ω an assignment σ ΩX assigns each variable a value in Ω constraints:
More informationPattern Recognition and Machine Learning
Christopher M. Bishop Pattern Recognition and Machine Learning ÖSpri inger Contents Preface Mathematical notation Contents vii xi xiii 1 Introduction 1 1.1 Example: Polynomial Curve Fitting 4 1.2 Probability
More informationQuadratic replica coupling in the Sherrington-Kirkpatrick mean field spin glass model
arxiv:cond-mat/0201091v2 [cond-mat.dis-nn] 5 Mar 2002 Quadratic replica coupling in the Sherrington-Kirkpatrick mean field spin glass model Francesco Guerra Dipartimento di Fisica, Università di Roma La
More informationSpin glasses have been intensively studied in the last 30 years.
Spin glasses and fragile glasses: Statics, dynamics, and complexity Giorgio Parisi* Dipartimento di Fisica, Istituto azionale di Fisica ucleare, Center for Statistical Mechanics and Complexity, Università
More informationA brief introduction to the inverse Ising problem and some algorithms to solve it
A brief introduction to the inverse Ising problem and some algorithms to solve it Federico Ricci-Tersenghi Physics Department Sapienza University, Roma original results in collaboration with Jack Raymond
More informationComputational Complexity of Bayesian Networks
Computational Complexity of Bayesian Networks UAI, 2015 Complexity theory Many computations on Bayesian networks are NP-hard Meaning (no more, no less) that we cannot hope for poly time algorithms that
More informationSlightly off-equilibrium dynamics
Slightly off-equilibrium dynamics Giorgio Parisi Many progresses have recently done in understanding system who are slightly off-equilibrium because their approach to equilibrium is quite slow. In this
More informationModern WalkSAT algorithms
Modern WalkSAT algorithms J. Rosti Summary of workshop presentation Special research course T-79.7003, Autumn 2007 Phase Transitions in Optimization Problems ABSTRACT In this workshop presentation summary
More informationAlgorithmisches Lernen/Machine Learning
Algorithmisches Lernen/Machine Learning Part 1: Stefan Wermter Introduction Connectionist Learning (e.g. Neural Networks) Decision-Trees, Genetic Algorithms Part 2: Norman Hendrich Support-Vector Machines
More informationA variational approach to Ising spin glasses in finite dimensions
. Phys. A: Math. Gen. 31 1998) 4127 4140. Printed in the UK PII: S0305-447098)89176-2 A variational approach to Ising spin glasses in finite dimensions R Baviera, M Pasquini and M Serva Dipartimento di
More informationMessage Passing Algorithms: A Success Looking for Theoreticians
Message Passing Algorithms: A Success Looking for Theoreticians Andrea Montanari Stanford University June 5, 2010 Andrea Montanari (Stanford) Message Passing June 5, 2010 1 / 93 What is this talk about?
More informationThe Last Survivor: a Spin Glass Phase in an External Magnetic Field.
The Last Survivor: a Spin Glass Phase in an External Magnetic Field. J. J. Ruiz-Lorenzo Dep. Física, Universidad de Extremadura Instituto de Biocomputación y Física de los Sistemas Complejos (UZ) http://www.eweb.unex.es/eweb/fisteor/juan
More informationBayesian Learning in Undirected Graphical Models
Bayesian Learning in Undirected Graphical Models Zoubin Ghahramani Gatsby Computational Neuroscience Unit University College London, UK http://www.gatsby.ucl.ac.uk/ Work with: Iain Murray and Hyun-Chul
More informationFundamental limits of symmetric low-rank matrix estimation
Proceedings of Machine Learning Research vol 65:1 5, 2017 Fundamental limits of symmetric low-rank matrix estimation Marc Lelarge Safran Tech, Magny-Les-Hameaux, France Département d informatique, École
More informationThe interface of statistical physics, algorithmic theory, and
Scaling and universality in continuous length combinatorial optimization David Aldous and Allon G. Percus Department of Statistics, University of California, Berkeley, CA 94720-3860; and Computer and Computational
More informationBayesian learning of sparse factor loadings
Magnus Rattray School of Computer Science, University of Manchester Bayesian Research Kitchen, Ambleside, September 6th 2008 Talk Outline Brief overview of popular sparsity priors Example application:
More informationSatisfying Assignments of Random Boolean Constraint Satisfaction Problems: Clusters and Overlaps 1
Journal of Universal Computer Science, vol. 13, no. 11 (2007), 1655-1670 submitted: 10/9/07, accepted: 19/11/07, appeared: 28/11/07 J.UCS Satisfying Assignments of Random Boolean Constraint Satisfaction
More informationPolar Codes are Optimal for Lossy Source Coding
Polar Codes are Optimal for Lossy Source Coding Satish Babu Korada and Rüdiger Urbanke EPFL, Switzerland, Email: satish.korada,ruediger.urbanke}@epfl.ch Abstract We consider lossy source compression of
More informationAndrea Montanari. Professor of Electrical Engineering, of Statistics and, by courtesy, of Mathematics. Bio. Teaching BIO ACADEMIC APPOINTMENTS
Professor of Electrical Engineering, of Statistics and, by courtesy, of Mathematics Bio BIO I am interested in developing efficient algorithms to make sense of large amounts of noisy data, extract information
More informationSample Complexity of Bayesian Optimal Dictionary Learning
Sample Complexity of Bayesian Optimal Dictionary Learning Ayaka Sakata and Yoshiyuki Kabashima Dep. of Computational Intelligence & Systems Science Tokyo Institute of Technology Yokohama 6-85, Japan Email:
More informationInferring Sparsity: Compressed Sensing Using Generalized Restricted Boltzmann Machines. Eric W. Tramel. itwist 2016 Aalborg, DK 24 August 2016
Inferring Sparsity: Compressed Sensing Using Generalized Restricted Boltzmann Machines Eric W. Tramel itwist 2016 Aalborg, DK 24 August 2016 Andre MANOEL, Francesco CALTAGIRONE, Marylou GABRIE, Florent
More informationLearning Energy-Based Models of High-Dimensional Data
Learning Energy-Based Models of High-Dimensional Data Geoffrey Hinton Max Welling Yee-Whye Teh Simon Osindero www.cs.toronto.edu/~hinton/energybasedmodelsweb.htm Discovering causal structure as a goal
More informationThe glass transition as a spin glass problem
The glass transition as a spin glass problem Mike Moore School of Physics and Astronomy, University of Manchester UBC 2007 Co-Authors: Joonhyun Yeo, Konkuk University Marco Tarzia, Saclay Mike Moore (Manchester)
More informationIndependence and chromatic number (and random k-sat): Sparse Case. Dimitris Achlioptas Microsoft
Independence and chromatic number (and random k-sat): Sparse Case Dimitris Achlioptas Microsoft Random graphs W.h.p.: with probability that tends to 1 as n. Hamiltonian cycle Let τ 2 be the moment all
More informationQuantum Annealing in spin glasses and quantum computing Anders W Sandvik, Boston University
PY502, Computational Physics, December 12, 2017 Quantum Annealing in spin glasses and quantum computing Anders W Sandvik, Boston University Advancing Research in Basic Science and Mathematics Example:
More informationPhase Transitions in Spin Glasses
p.1 Phase Transitions in Spin Glasses Peter Young http://physics.ucsc.edu/ peter/talks/bifi2008.pdf e-mail:peter@physics.ucsc.edu Work supported by the and the Hierarchical Systems Research Foundation.
More informationPhase Transitions in Physics and Computer Science. Cristopher Moore University of New Mexico and the Santa Fe Institute
Phase Transitions in Physics and Computer Science Cristopher Moore University of New Mexico and the Santa Fe Institute Magnetism When cold enough, Iron will stay magnetized, and even magnetize spontaneously
More informationInference in Bayesian Networks
Andrea Passerini passerini@disi.unitn.it Machine Learning Inference in graphical models Description Assume we have evidence e on the state of a subset of variables E in the model (i.e. Bayesian Network)
More informationarxiv:cond-mat/ v1 [cond-mat.dis-nn] 15 Sep 2003
Europhysics Letters PREPRINT arxiv:cond-mat/39348v1 [cond-mat.dis-nn] 15 Sep 23 Maximum matching on random graphs Haijun Zhou 1,2,3 and Zhong-can Ou-Yang 1 1 Institute of Theoretical Physics, the Chinese
More informationFocused Local Search for Random 3-Satisfiability
Focused Local Search for Random 3-Satisfiability Sakari Seitz Laboratory for Theoretical Computer Science, P.O. Box 54, FI-215 Helsinki University of Technology, Finland. E-mail: firstname.lastname@hut.fi.
More informationUpper-bounding the k-colorability threshold by counting covers
Upper-bounding the k-colorability threshold by counting covers Amin Coja-Oghlan Goethe University Mathematics Institute Frankfurt am Main, Germany acoghlan@math.uni-frankfurt.de Submitted: May 2, 2013;
More informationLearning latent structure in complex networks
Learning latent structure in complex networks Lars Kai Hansen www.imm.dtu.dk/~lkh Current network research issues: Social Media Neuroinformatics Machine learning Joint work with Morten Mørup, Sune Lehmann
More informationThe Condensation Phase Transition in the Regular k-sat Model
The Condensation Phase Transition in the Regular k-sat Model Victor Bapst 1 and Amin Coja-Oghlan 2 1 Mathematics Institute, Goethe University, Frankfurt, Germany bapst@math.uni-frankfurt.de 2 Mathematics
More informationRestricted Boltzmann Machines
Restricted Boltzmann Machines Boltzmann Machine(BM) A Boltzmann machine extends a stochastic Hopfield network to include hidden units. It has binary (0 or 1) visible vector unit x and hidden (latent) vector
More information6.867 Machine learning, lecture 23 (Jaakkola)
Lecture topics: Markov Random Fields Probabilistic inference Markov Random Fields We will briefly go over undirected graphical models or Markov Random Fields (MRFs) as they will be needed in the context
More informationThe Tightness of the Kesten-Stigum Reconstruction Bound for a Symmetric Model With Multiple Mutations
The Tightness of the Kesten-Stigum Reconstruction Bound for a Symmetric Model With Multiple Mutations City University of New York Frontier Probability Days 2018 Joint work with Dr. Sreenivasa Rao Jammalamadaka
More informationClustering from Sparse Pairwise Measurements
Clustering from Sparse Pairwise Measurements arxiv:6006683v2 [cssi] 9 May 206 Alaa Saade Laboratoire de Physique Statistique École Normale Supérieure, 24 Rue Lhomond Paris 75005 Marc Lelarge INRIA and
More informationPERSPECTIVES ON SPIN GLASSES
PERSPECTIVES ON SPIN GLASSES Presenting and developing the theory of spin glasses as a prototype for complex systems, this book is a rigorous and up-to-date introduction to their properties. The book combines
More informationCPSC 540: Machine Learning
CPSC 540: Machine Learning MCMC and Non-Parametric Bayes Mark Schmidt University of British Columbia Winter 2016 Admin I went through project proposals: Some of you got a message on Piazza. No news is
More informationRecent Advances in Bayesian Inference Techniques
Recent Advances in Bayesian Inference Techniques Christopher M. Bishop Microsoft Research, Cambridge, U.K. research.microsoft.com/~cmbishop SIAM Conference on Data Mining, April 2004 Abstract Bayesian
More information