Clustering means geometry in sparse graphs. Dmitri Krioukov Northeastern University Workshop on Big Graphs UCSD, San Diego, CA, January 2016
|
|
- Spencer Gordon
- 5 years ago
- Views:
Transcription
1 in sparse graphs Dmitri Krioukov Northeastern University Workshop on Big Graphs UCSD, San Diego, CA, January 206
2 Motivation Latent space models Successfully used in sociology since the 70ies Recently shown to reproduce many structural properties of large real networks (with many applications) Which are necessary but not sufficient conditions for realism Pregeometric quantum gravity Define a random graph ensemble in purely graphstructural terms such that geometry is emergent, i.e., the ensemble is equivalent to a random geometric graph ensemble Motivation 2
3 Real networks Sparse Strong clustering Power laws Community structure Let s put the last two properties aside Background 3
4 Two properties to model Fixed number of edges Fixed number of triangles Plus we want to define an unbiased ensemble, graphs are random in all other respects Background 4
5 Strauss model Maximum-entropy random graphs with fixed number of nodes, edges, and triangles Exponential random graphs with P G = e H(G) /Z, H G = λ k k + λ t t, k = 2 t = 6 i,j a ij, i,j,k a ij a jk a ki. Background 5
6 Clustering In real networks Triangles are spread equally across all nodes In the Strauss model Triangles coalesce into a large clique The graphon is bipodal (Kenyon, Radin, Sadun) Strauss model has many other pathological properties (degeneracies, hysteresis, etc.) that are not observed in real networks Background 6
7 Clustering in the brain Background 7
8 Strauss can t be fixed for spreading H G = i (λ k,i k i + λ t,i t i ), s.t. λ k,i = λ k and λ t,i = λ t, where k i = j a ij and t i = a ij a jk a ki 2 j,k H G = λ k i k i + λ t i t i = 2λ k k + 3λ t t Background 8
9 Edge-independent random graphs Maximum-entropy random graphs with fixed expected values of edges (adjacency matrix elements, independent Bernoulli random variables) a ij = p ij H G = 2 i,j λ ij a ij p ij = / + e λ ij Z = + e λ ij i,j Problem formulation 9
10 Spreading problem is fixed k i = p ij j = k t i = p 2 j,k ij p jk p ki = t But we want an unbiased ensemble! The problem can be formulated using graphon entropy, after the following graphon modifications Problem formulation 0
11 Graphon modifications Dense graphons (intuitively, p ij p x, y ) If p 0, 2 [0,], then k x = n p x, y dy 0 and graphs are dense One way to get sparse graphs (used in L p graphons) is p n x, y = p(x, y)/n n k x t x 0 = n p n x, y dy 0 = n = p x, y dy, but p n x, y p n y, z p n z, x dy dz p x, y p y, z p z, x dy dz = -- clustering is zero Problem formulation
12 Graphon modifications Another way to sparsity is a la Caron-Fox p n n, n 2 0, 2 2 p n R 2 [0,] In the large-graph n limit, we have then k x = p x, y dy R t x = p x, y p y, z p z, x dy dz 2 R 2 Which can be both finite and positive Problem formulation 2
13 Graphon entropy density For a fixed n, the entropy density (entropy per node) of an exponential random graph ensemble with p ij = p(x i, y j ), where x i, y j n 2, n 2, is σ n p ij = H(p 2n i,j ij ), where H p = p log p p log p σ n p ij σ p = lim n 2n n 2,n 2 2 H p x, y dx dy (Janson-Hatami) Problem formulation 3
14 Problem formulation Find p x, y, a graphon defining the maximumentropy edge-independent random graphs with expected numbers of edges and triangles of all nodes fixed to values k, t Graphon p x, y maximizes σ p, constrained by k p = p x, y dy R = k t p = p x, y p y, z p z, x dy dz 2 R 2 = t Since the constraints do not depend on x, σ p = 2 R H p x, y dy Problem formulation 4
15 Problem solution Define Lagrangian L p = σ p + λ k k p + λ t t p L p p(x,y) = 0 yields the following integral equation log + 2λ p x,y k + λ t p y, z p z, x dz = 0 R which appears intractable We show that p x, y = +e β(ε μ), where ε = x y, β = λ t, and μ = 2λ k /λ t is an approximate solution Problem solution 5
16 Proof Define α = μβ, r = ε/2μ, a = e α, b = e 2αr log p x,y = β ε μ = 2α r 2 I r, α = 2μ R p y, z p z, x dz = α(b )(b a 2 ) [αr a2 b + a 2 2b 2 a 2 b + b 2a 2 log( + a) + b 2 a 2 log(a + b)] J r = r Proof 6
17 Proof I r, α J(r) /α for α Proof 7
18 Proof The expected number of common neighbors between x and y, p y, z p z, x dz = R 2μI r, α 2μJ r = 2μ r The red equation simplifies to α r 2 + λ k + λ t μ r = 0 With α = 2λ k and β = λ t yielding the solution Proof 8
19 Large-α asymptotics k 2μ + α e α -- expected # of edges t 3 2 μ2 π 3α c = 2t k π 3α σ β π expected # of triangles 2 -- expected clustering 3 αe α -- entropy density Problem solution 9
20 Summary Since entropy-maximizing graphon p x, y = p x y, these results mean that the ensemble of edge-independent random graphs with fixed expected degrees and clustering of all nodes, defined in purely graph-structural terms, is equivalent to the ensemble of soft random geometric graphs on the real line with the Fermi-Dirac connection probability p ε = /[ + exp β(ε μ) ] Surprisingly, this graph-structural characterization of a potentially rich geometric ensemble turned out to be rather simple, as it deals only with edges and triangles, evenly spread across all nodes Summary 20
21 Summary Caveats No proof of uniqueness The solution is approximate Becomes exact in the α = βμ limit In particular, in the standard (sharp) random geometric graphs with any μ > 0 and T = /β 0 (p x, y = Θ μ x y, k = 2μ, t = 3μ 2 /2, c = 3/4, σ = 0) Modulo these caveats, this appears to be the first characterization of a random geometric graph ensemble, purely in terms of graph-structural properties, plus the maximum-entropy principle Summary 2
arxiv: v3 [math.pr] 10 Oct 2017
Sparse Maximum-Entropy Random Graphs with a Given Power-Law Degree Distribution Pim van der Hoorn 1, Gabor Lippner 2, and Dmitri Krioukov 1,2,3 arxiv:175.1261v3 [math.pr] 1 Oct 217 1 Northeastern University,
More informationRandom geometric graphs, Apollonian packings, number networks, and the Riemann hypothesis
Random geometric graphs, Apollonian packings, number networks, and the Riemann hypothesis Dmitri Krioukov NU M. Kitsak (NU), R. Sinkovits (UCSD/SDSC) David Rideout & David Meyer UCSD/Math Marian Boguñá
More informationMultipodal Structure and Phase Transitions in Large Constrained Graphs
Multipodal Structure and Phase Transitions in Large Constrained Graphs Richard Kenyon Charles Radin Kui Ren Lorenzo Sadun May 3, 24 Abstract We study the asymptotics of large, simple, labeled graphs constrained
More informationExponential Family and Maximum Likelihood, Gaussian Mixture Models and the EM Algorithm. by Korbinian Schwinger
Exponential Family and Maximum Likelihood, Gaussian Mixture Models and the EM Algorithm by Korbinian Schwinger Overview Exponential Family Maximum Likelihood The EM Algorithm Gaussian Mixture Models Exponential
More informationAn Introduction to Exponential-Family Random Graph Models
An Introduction to Exponential-Family Random Graph Models Luo Lu Feb.8, 2011 1 / 11 Types of complications in social network Single relationship data A single relationship observed on a set of nodes at
More informationarxiv: v2 [math.pr] 22 Oct 2018
Breaking of ensemble equivalence for perturbed Erdős-Rényi random graphs arxiv:807.07750v [math.pr] Oct 08 F. den Hollander M. Mandjes A. Roccaverde 3 N.J. Starreveld 4 October 3, 08 Abstract In a previous
More informationarxiv: v1 [physics.soc-ph] 17 Mar 2015
Hyperbolic Graph Generator Rodrigo Aldecoa a,, Chiara Orsini b, Dmitri Krioukov a,c arxiv:53.58v [physics.soc-ph] 7 Mar 25 a Northeastern University, Department of Physics, Boston, MA, USA b Center for
More informationGround states for exponential random graphs
Ground states for exponential random graphs Mei Yin Department of Mathematics, University of Denver March 5, 2018 We propose a perturbative method to estimate the normalization constant in exponential
More informationGraph Limits: Some Open Problems
Graph Limits: Some Open Problems 1 Introduction Here are some questions from the open problems session that was held during the AIM Workshop Graph and Hypergraph Limits, Palo Alto, August 15-19, 2011.
More informationVariational Inference and Learning. Sargur N. Srihari
Variational Inference and Learning Sargur N. srihari@cedar.buffalo.edu 1 Topics in Approximate Inference Task of Inference Intractability in Inference 1. Inference as Optimization 2. Expectation Maximization
More informationGeneralized Exponential Random Graph Models: Inference for Weighted Graphs
Generalized Exponential Random Graph Models: Inference for Weighted Graphs James D. Wilson University of North Carolina at Chapel Hill June 18th, 2015 Political Networks, 2015 James D. Wilson GERGMs for
More informationCPSC 540: Machine Learning
CPSC 540: Machine Learning Undirected Graphical Models Mark Schmidt University of British Columbia Winter 2016 Admin Assignment 3: 2 late days to hand it in today, Thursday is final day. Assignment 4:
More informationFisher Information in Gaussian Graphical Models
Fisher Information in Gaussian Graphical Models Jason K. Johnson September 21, 2006 Abstract This note summarizes various derivations, formulas and computational algorithms relevant to the Fisher information
More informationProbabilistic Graphical Models
Probabilistic Graphical Models Lecture 9: Variational Inference Relaxations Volkan Cevher, Matthias Seeger Ecole Polytechnique Fédérale de Lausanne 24/10/2011 (EPFL) Graphical Models 24/10/2011 1 / 15
More informationVariational Inference (11/04/13)
STA561: Probabilistic machine learning Variational Inference (11/04/13) Lecturer: Barbara Engelhardt Scribes: Matt Dickenson, Alireza Samany, Tracy Schifeling 1 Introduction In this lecture we will further
More informationA LARGE DEVIATION PRINCIPLE FOR THE ERDŐS RÉNYI UNIFORM RANDOM GRAPH
A LARGE DEVIATION PRINCIPLE FOR THE ERDŐS RÉNYI UNIFORM RANDOM GRAPH AMIR DEMBO AND EYAL LUBETZKY Abstract. Starting with the large deviation principle (ldp) for the Erdős Rényi binomial random graph G(n,
More information13 : Variational Inference: Loopy Belief Propagation and Mean Field
10-708: Probabilistic Graphical Models 10-708, Spring 2012 13 : Variational Inference: Loopy Belief Propagation and Mean Field Lecturer: Eric P. Xing Scribes: Peter Schulam and William Wang 1 Introduction
More informationSzemerédi s regularity lemma revisited. Lewis Memorial Lecture March 14, Terence Tao (UCLA)
Szemerédi s regularity lemma revisited Lewis Memorial Lecture March 14, 2008 Terence Tao (UCLA) 1 Finding models of large dense graphs Suppose we are given a large dense graph G = (V, E), where V is a
More informationCutwidth and degeneracy of graphs
Cutwidth and degeneracy of graphs Benoit Kloeckner To cite this version: Benoit Kloeckner. Cutwidth and degeneracy of graphs. IF_PREPUB. 2009. HAL Id: hal-00408210 https://hal.archives-ouvertes.fr/hal-00408210v1
More information1 Mechanistic and generative models of network structure
1 Mechanistic and generative models of network structure There are many models of network structure, and these largely can be divided into two classes: mechanistic models and generative or probabilistic
More informationParameter estimators of sparse random intersection graphs with thinned communities
Parameter estimators of sparse random intersection graphs with thinned communities Lasse Leskelä Aalto University Johan van Leeuwaarden Eindhoven University of Technology Joona Karjalainen Aalto University
More informationBayesian nonparametric models of sparse and exchangeable random graphs
Bayesian nonparametric models of sparse and exchangeable random graphs F. Caron & E. Fox Technical Report Discussion led by Esther Salazar Duke University May 16, 2014 (Reading group) May 16, 2014 1 /
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 11 Project
More informationHomework 1 Due: Thursday 2/5/2015. Instructions: Turn in your homework in class on Thursday 2/5/2015
10-704 Homework 1 Due: Thursday 2/5/2015 Instructions: Turn in your homework in class on Thursday 2/5/2015 1. Information Theory Basics and Inequalities C&T 2.47, 2.29 (a) A deck of n cards in order 1,
More informationCorrelations in Populations: Information-Theoretic Limits
Correlations in Populations: Information-Theoretic Limits Don H. Johnson Ilan N. Goodman dhj@rice.edu Department of Electrical & Computer Engineering Rice University, Houston, Texas Population coding Describe
More informationsheng@mail.ncyu.edu.tw Content Joint distribution functions Independent random variables Sums of independent random variables Conditional distributions: discrete case Conditional distributions: continuous
More informationData Mining and Analysis: Fundamental Concepts and Algorithms
Data Mining and Analysis: Fundamental Concepts and Algorithms dataminingbook.info Mohammed J. Zaki 1 Wagner Meira Jr. 2 1 Department of Computer Science Rensselaer Polytechnic Institute, Troy, NY, USA
More informationThe Expectation Maximization or EM algorithm
The Expectation Maximization or EM algorithm Carl Edward Rasmussen November 15th, 2017 Carl Edward Rasmussen The EM algorithm November 15th, 2017 1 / 11 Contents notation, objective the lower bound functional,
More informationPhase transitions in the edge-triangle exponential random graph model
Phase transitions in the edge-triangle exponential random graph model Mei Yin Department of Mathematics, Brown University April 28, 2014 Probability space: The set G n of all simple graphs G n on n vertices.
More informationLearning Gaussian Graphical Models with Unknown Group Sparsity
Learning Gaussian Graphical Models with Unknown Group Sparsity Kevin Murphy Ben Marlin Depts. of Statistics & Computer Science Univ. British Columbia Canada Connections Graphical models Density estimation
More informationGraph Detection and Estimation Theory
Introduction Detection Estimation Graph Detection and Estimation Theory (and algorithms, and applications) Patrick J. Wolfe Statistics and Information Sciences Laboratory (SISL) School of Engineering and
More informationMeron-Cluster and Nested Cluster Algorithms: Addressing the Sign Problem in Quantum Monte Carlo Simulations
Meron-Cluster and Nested Cluster Algorithms: Addressing the Sign Problem in Quantum Monte Carlo Simulations Uwe-Jens Wiese Bern University IPAM Workshop QS2009, January 26, 2009 Collaborators: B. B. Beard
More information13: Variational inference II
10-708: Probabilistic Graphical Models, Spring 2015 13: Variational inference II Lecturer: Eric P. Xing Scribes: Ronghuo Zheng, Zhiting Hu, Yuntian Deng 1 Introduction We started to talk about variational
More informationMultislice community detection
Multislice community detection P. J. Mucha, T. Richardson, K. Macon, M. A. Porter, J.-P. Onnela Jukka-Pekka JP Onnela Harvard University NetSci2010, MIT; May 13, 2010 Outline (1) Background (2) Multislice
More informationPurnamrita Sarkar (Carnegie Mellon) Deepayan Chakrabarti (Yahoo! Research) Andrew W. Moore (Google, Inc.)
Purnamrita Sarkar (Carnegie Mellon) Deepayan Chakrabarti (Yahoo! Research) Andrew W. Moore (Google, Inc.) Which pair of nodes {i,j} should be connected? Variant: node i is given Alice Bob Charlie Friend
More informationChris Bishop s PRML Ch. 8: Graphical Models
Chris Bishop s PRML Ch. 8: Graphical Models January 24, 2008 Introduction Visualize the structure of a probabilistic model Design and motivate new models Insights into the model s properties, in particular
More informationLikelihood, MLE & EM for Gaussian Mixture Clustering. Nick Duffield Texas A&M University
Likelihood, MLE & EM for Gaussian Mixture Clustering Nick Duffield Texas A&M University Probability vs. Likelihood Probability: predict unknown outcomes based on known parameters: P(x q) Likelihood: estimate
More informationInference as Optimization
Inference as Optimization Sargur Srihari srihari@cedar.buffalo.edu 1 Topics in Inference as Optimization Overview Exact Inference revisited The Energy Functional Optimizing the Energy Functional 2 Exact
More informationHW4 : Bivariate Distributions (1) Solutions
STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 7 Néhémy Lim HW4 : Bivariate Distributions () Solutions Problem. The joint probability mass function of X and Y is given by the following table : X Y
More informationQuantum Grand Canonical Ensemble
Chapter 16 Quantum Grand Canonical Ensemble How do we proceed quantum mechanically? For fermions the wavefunction is antisymmetric. An N particle basis function can be constructed in terms of single-particle
More informationCommunities Via Laplacian Matrices. Degree, Adjacency, and Laplacian Matrices Eigenvectors of Laplacian Matrices
Communities Via Laplacian Matrices Degree, Adjacency, and Laplacian Matrices Eigenvectors of Laplacian Matrices The Laplacian Approach As with betweenness approach, we want to divide a social graph into
More informationProject in Computational Game Theory: Communities in Social Networks
Project in Computational Game Theory: Communities in Social Networks Eldad Rubinstein November 11, 2012 1 Presentation of the Original Paper 1.1 Introduction In this section I present the article [1].
More informationc Copyright 2015 Ke Li
c Copyright 2015 Ke Li Degeneracy, Duration, and Co-evolution: Extending Exponential Random Graph Models (ERGM) for Social Network Analysis Ke Li A dissertation submitted in partial fulfillment of the
More informationMATH The Derivative as a Function - Section 3.2. The derivative of f is the function. f x h f x. f x lim
MATH 90 - The Derivative as a Function - Section 3.2 The derivative of f is the function f x lim h 0 f x h f x h for all x for which the limit exists. The notation f x is read "f prime of x". Note that
More information7.4* General logarithmic and exponential functions
7.4* General logarithmic and exponential functions Mark Woodard Furman U Fall 2010 Mark Woodard (Furman U) 7.4* General logarithmic and exponential functions Fall 2010 1 / 9 Outline 1 General exponential
More informationCS242: Probabilistic Graphical Models Lecture 4A: MAP Estimation & Graph Structure Learning
CS242: Probabilistic Graphical Models Lecture 4A: MAP Estimation & Graph Structure Learning Professor Erik Sudderth Brown University Computer Science October 4, 2016 Some figures and materials courtesy
More informationModeling with semidefinite and copositive matrices
Modeling with semidefinite and copositive matrices Franz Rendl http://www.math.uni-klu.ac.at Alpen-Adria-Universität Klagenfurt Austria F. Rendl, Singapore workshop 2006 p.1/24 Overview Node and Edge relaxations
More informationMAP Examples. Sargur Srihari
MAP Examples Sargur srihari@cedar.buffalo.edu 1 Potts Model CRF for OCR Topics Image segmentation based on energy minimization 2 Examples of MAP Many interesting examples of MAP inference are instances
More informationA sequence of triangle-free pseudorandom graphs
A sequence of triangle-free pseudorandom graphs David Conlon Abstract A construction of Alon yields a sequence of highly pseudorandom triangle-free graphs with edge density significantly higher than one
More informationMultipodal Structure and Phase Transitions in Large Constrained Graphs
Multipodal Structure and Phase Transitions in Large Constrained Graphs Richard Kenyon Charles Radin Kui Ren Lorenzo Sadun July 2, 26 Abstract We study the asymptotics of large, simple, labeled graphs constrained
More informationMGMT 69000: Topics in High-dimensional Data Analysis Falll 2016
MGMT 69000: Topics in High-dimensional Data Analysis Falll 2016 Lecture 14: Information Theoretic Methods Lecturer: Jiaming Xu Scribe: Hilda Ibriga, Adarsh Barik, December 02, 2016 Outline f-divergence
More informationSignal Processing - Lecture 7
1 Introduction Signal Processing - Lecture 7 Fitting a function to a set of data gathered in time sequence can be viewed as signal processing or learning, and is an important topic in information theory.
More informationElusive problems in extremal graph theory
Elusive problems in extremal graph theory Andrzej Grzesik (Krakow) Dan Král (Warwick) László Miklós Lovász (MIT/Stanford) 2/5/27 Overview of talk uniqueness of extremal configurations motivation and formulation
More informationProbabilistic Graphical Models
Probabilistic Graphical Models Brown University CSCI 295-P, Spring 213 Prof. Erik Sudderth Lecture 11: Inference & Learning Overview, Gaussian Graphical Models Some figures courtesy Michael Jordan s draft
More informationPerformance Analysis and Code Optimization of Low Density Parity-Check Codes on Rayleigh Fading Channels
Performance Analysis and Code Optimization of Low Density Parity-Check Codes on Rayleigh Fading Channels Jilei Hou, Paul H. Siegel and Laurence B. Milstein Department of Electrical and Computer Engineering
More information,... We would like to compare this with the sequence y n = 1 n
Example 2.0 Let (x n ) n= be the sequence given by x n = 2, i.e. n 2, 4, 8, 6,.... We would like to compare this with the sequence = n (which we know converges to zero). We claim that 2 n n, n N. Proof.
More informationStein s Method for concentration inequalities
Number of Triangles in Erdős-Rényi random graph, UC Berkeley joint work with Sourav Chatterjee, UC Berkeley Cornell Probability Summer School July 7, 2009 Number of triangles in Erdős-Rényi random graph
More informationFirst order differential equations
First order differential equations Samy Tindel Purdue University Differential equations and linear algebra - MA 262 Taken from Differential equations and linear algebra by Goode and Annin Samy T. First
More informationStochastic Proximal Gradient Algorithm
Stochastic Institut Mines-Télécom / Telecom ParisTech / Laboratoire Traitement et Communication de l Information Joint work with: Y. Atchade, Ann Arbor, USA, G. Fort LTCI/Télécom Paristech and the kind
More informationMessage-Passing Algorithms for GMRFs and Non-Linear Optimization
Message-Passing Algorithms for GMRFs and Non-Linear Optimization Jason Johnson Joint Work with Dmitry Malioutov, Venkat Chandrasekaran and Alan Willsky Stochastic Systems Group, MIT NIPS Workshop: Approximate
More informationInvertibility of random matrices
University of Michigan February 2011, Princeton University Origins of Random Matrix Theory Statistics (Wishart matrices) PCA of a multivariate Gaussian distribution. [Gaël Varoquaux s blog gael-varoquaux.info]
More informationChapter 5-2: Clustering
Chapter 5-2: Clustering Jilles Vreeken Revision 1, November 20 th typo s fixed: dendrogram Revision 2, December 10 th clarified: we do consider a point x as a member of its own ε-neighborhood 12 Nov 2015
More informationAsymptotics and Extremal Properties of the Edge-Triangle Exponential Random Graph Model
Asymptotics and Extremal Properties of the Edge-Triangle Exponential Random Graph Model Alessandro Rinaldo Carnegie Mellon University joint work with Mei Yin, Sukhada Fadnavis, Stephen E. Fienberg and
More informationEMERGENT STRUCTURES IN LARGE NETWORKS
Applied Probability Trust (29 November 2012) EMERGENT STRUCTURES IN LARGE NETWORKS DAVID ARISTOFF, University of Minnesota CHARLES RADIN, The University of Texas at Austin Abstract We consider a large
More informationBayesian Machine Learning - Lecture 7
Bayesian Machine Learning - Lecture 7 Guido Sanguinetti Institute for Adaptive and Neural Computation School of Informatics University of Edinburgh gsanguin@inf.ed.ac.uk March 4, 2015 Today s lecture 1
More informationMachine Learning Srihari. Information Theory. Sargur N. Srihari
Information Theory Sargur N. Srihari 1 Topics 1. Entropy as an Information Measure 1. Discrete variable definition Relationship to Code Length 2. Continuous Variable Differential Entropy 2. Maximum Entropy
More informationVertex order in some large constrained random graphs
Vertex order in some large constrained random graphs Hans Koch Abstract. In large random graphs with fixed edge density and triangle density, it has been observed numerically [9] that a typical graph is
More informationProbabilistic Graphical Models
School of Computer Science Probabilistic Graphical Models Variational Inference II: Mean Field Method and Variational Principle Junming Yin Lecture 15, March 7, 2012 X 1 X 1 X 1 X 1 X 2 X 3 X 2 X 2 X 3
More informationSTA 414/2104: Machine Learning
STA 414/2104: Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistics! rsalakhu@cs.toronto.edu! http://www.cs.toronto.edu/~rsalakhu/ Lecture 9 Sequential Data So far
More informationSTAT 200C: High-dimensional Statistics
STAT 200C: High-dimensional Statistics Arash A. Amini April 27, 2018 1 / 80 Classical case: n d. Asymptotic assumption: d is fixed and n. Basic tools: LLN and CLT. High-dimensional setting: n d, e.g. n/d
More informationGraph limits Graph convergence Approximate asymptotic properties of large graphs Extremal combinatorics/computer science : flag algebra method, proper
Jacob Cooper Dan Král Taísa Martins University of Warwick Monash University - Discrete Maths Research Group Graph limits Graph convergence Approximate asymptotic properties of large graphs Extremal combinatorics/computer
More informationExponential random graph models for the Japanese bipartite network of banks and firms
Exponential random graph models for the Japanese bipartite network of banks and firms Abhijit Chakraborty, Hazem Krichene, Hiroyasu Inoue, and Yoshi Fujiwara Graduate School of Simulation Studies, The
More informationHorizontal Charge Excitation of Supertranslation and Superrotation
Horizontal Charge Excitation of Supertranslation and Superrotation Masahiro Hotta Tohoku University Based on M. Hotta, J. Trevison and K. Yamaguchi arxiv:1606.02443. M. Hotta, K. Sasaki and T. Sasaki,
More informationCONSTRAINED OPTIMIZATION OVER DISCRETE SETS VIA SPSA WITH APPLICATION TO NON-SEPARABLE RESOURCE ALLOCATION
Proceedings of the 200 Winter Simulation Conference B. A. Peters, J. S. Smith, D. J. Medeiros, and M. W. Rohrer, eds. CONSTRAINED OPTIMIZATION OVER DISCRETE SETS VIA SPSA WITH APPLICATION TO NON-SEPARABLE
More informationElementary Differential Equations, Section 2 Prof. Loftin: Practice Test Problems for Test Find the radius of convergence of the power series
Elementary Differential Equations, Section 2 Prof. Loftin: Practice Test Problems for Test 2 SOLUTIONS 1. Find the radius of convergence of the power series Show your work. x + x2 2 + x3 3 + x4 4 + + xn
More informationUNDERSTANDING BELIEF PROPOGATION AND ITS GENERALIZATIONS
UNDERSTANDING BELIEF PROPOGATION AND ITS GENERALIZATIONS JONATHAN YEDIDIA, WILLIAM FREEMAN, YAIR WEISS 2001 MERL TECH REPORT Kristin Branson and Ian Fasel June 11, 2003 1. Inference Inference problems
More informationReview: Directed Models (Bayes Nets)
X Review: Directed Models (Bayes Nets) Lecture 3: Undirected Graphical Models Sam Roweis January 2, 24 Semantics: x y z if z d-separates x and y d-separation: z d-separates x from y if along every undirected
More informationPolylogarithms and Double Scissors Congruence Groups
Polylogarithms and Double Scissors Congruence Groups for Gandalf and the Arithmetic Study Group Steven Charlton Abstract Polylogarithms are a class of special functions which have applications throughout
More informationPhase Transitions in a Sequence-Structure Channel. ITA, San Diego, 2015
Phase Transitions in a Sequence-Structure Channel A. Magner and D. Kihara and W. Szpankowski Purdue University W. Lafayette, IN 47907 January 29, 2015 ITA, San Diego, 2015 Structural Information Information
More informationRobust Principal Component Analysis
ELE 538B: Mathematics of High-Dimensional Data Robust Principal Component Analysis Yuxin Chen Princeton University, Fall 2018 Disentangling sparse and low-rank matrices Suppose we are given a matrix M
More informationRandom Walk Based Algorithms for Complex Network Analysis
Random Walk Based Algorithms for Complex Network Analysis Konstantin Avrachenkov Inria Sophia Antipolis Winter School on Complex Networks 2015, Inria SAM, 12-16 Jan. Complex networks Main features of complex
More informationSupport Vector Machines
Support Vector Machines Le Song Machine Learning I CSE 6740, Fall 2013 Naïve Bayes classifier Still use Bayes decision rule for classification P y x = P x y P y P x But assume p x y = 1 is fully factorized
More informationChapter 2: Random Variables
ECE54: Stochastic Signals and Systems Fall 28 Lecture 2 - September 3, 28 Dr. Salim El Rouayheb Scribe: Peiwen Tian, Lu Liu, Ghadir Ayache Chapter 2: Random Variables Example. Tossing a fair coin twice:
More informationInferring from data. Theory of estimators
Inferring from data Theory of estimators 1 Estimators Estimator is any function of the data e(x) used to provide an estimate ( a measurement ) of an unknown parameter. Because estimators are functions
More informationn! (k 1)!(n k)! = F (X) U(0, 1). (x, y) = n(n 1) ( F (y) F (x) ) n 2
Order statistics Ex. 4.1 (*. Let independent variables X 1,..., X n have U(0, 1 distribution. Show that for every x (0, 1, we have P ( X (1 < x 1 and P ( X (n > x 1 as n. Ex. 4.2 (**. By using induction
More informationAn introduction to rough paths
An introduction to rough paths Antoine LEJAY INRIA, Nancy, France From works from T. Lyons, Z. Qian, P. Friz, N. Victoir, M. Gubinelli, D. Feyel, A. de la Pradelle, A.M. Davie,... SPDE semester Isaac Newton
More informationCS839: Probabilistic Graphical Models. Lecture 7: Learning Fully Observed BNs. Theo Rekatsinas
CS839: Probabilistic Graphical Models Lecture 7: Learning Fully Observed BNs Theo Rekatsinas 1 Exponential family: a basic building block For a numeric random variable X p(x ) =h(x)exp T T (x) A( ) = 1
More informationEuler s Method and Logistic Growth (BC Only)
Euler s Method Students should be able to: Approximate numerical solutions of differential equations using Euler s method without a calculator. Recognize the method as a recursion formula extension of
More informationarxiv: v3 [math.pr] 18 Aug 2017
Sparse Exchangeable Graphs and Their Limits via Graphon Processes arxiv:1601.07134v3 [math.pr] 18 Aug 2017 Christian Borgs Microsoft Research One Memorial Drive Cambridge, MA 02142, USA Jennifer T. Chayes
More informationMid Term-1 : Practice problems
Mid Term-1 : Practice problems These problems are meant only to provide practice; they do not necessarily reflect the difficulty level of the problems in the exam. The actual exam problems are likely to
More information1 Complex Networks - A Brief Overview
Power-law Degree Distributions 1 Complex Networks - A Brief Overview Complex networks occur in many social, technological and scientific settings. Examples of complex networks include World Wide Web, Internet,
More informationn! (k 1)!(n k)! = F (X) U(0, 1). (x, y) = n(n 1) ( F (y) F (x) ) n 2
Order statistics Ex. 4. (*. Let independent variables X,..., X n have U(0, distribution. Show that for every x (0,, we have P ( X ( < x and P ( X (n > x as n. Ex. 4.2 (**. By using induction or otherwise,
More informationLearning MN Parameters with Approximation. Sargur Srihari
Learning MN Parameters with Approximation Sargur srihari@cedar.buffalo.edu 1 Topics Iterative exact learning of MN parameters Difficulty with exact methods Approximate methods Approximate Inference Belief
More informationPlanted Cliques, Iterative Thresholding and Message Passing Algorithms
Planted Cliques, Iterative Thresholding and Message Passing Algorithms Yash Deshpande and Andrea Montanari Stanford University November 5, 2013 Deshpande, Montanari Planted Cliques November 5, 2013 1 /
More informationUndirected Graphical Models
Undirected Graphical Models 1 Conditional Independence Graphs Let G = (V, E) be an undirected graph with vertex set V and edge set E, and let A, B, and C be subsets of vertices. We say that C separates
More informationI. BASICS OF STATISTICAL MECHANICS AND QUANTUM MECHANICS
I. BASICS OF STATISTICAL MECHANICS AND QUANTUM MECHANICS Marus Holzmann LPMMC, Maison de Magistère, Grenoble, and LPTMC, Jussieu, Paris marus@lptl.jussieu.fr http://www.lptl.jussieu.fr/users/marus (Dated:
More informationIV. Analyse de réseaux biologiques
IV. Analyse de réseaux biologiques Catherine Matias CNRS - Laboratoire de Probabilités et Modèles Aléatoires, Paris catherine.matias@math.cnrs.fr http://cmatias.perso.math.cnrs.fr/ ENSAE - 2014/2015 Sommaire
More information9740/01 October/November MATHEMATICS (H2) Paper 1 Suggested Solutions. (ii)
GCE A Level October/November 9 Suggested Solutions Mathematics H (97/) version. MATHEMATICS (H) Paper Suggested Solutions. Topic: Matrices (i) Given that u n is a quadratic polynomial in n, Let u n an
More informationLecture 3: Pattern Classification
EE E6820: Speech & Audio Processing & Recognition Lecture 3: Pattern Classification 1 2 3 4 5 The problem of classification Linear and nonlinear classifiers Probabilistic classification Gaussians, mixtures
More informationSTAT 200C: High-dimensional Statistics
STAT 200C: High-dimensional Statistics Arash A. Amini May 30, 2018 1 / 59 Classical case: n d. Asymptotic assumption: d is fixed and n. Basic tools: LLN and CLT. High-dimensional setting: n d, e.g. n/d
More information