Probabilistic Graphical Models
|
|
- Lewis Barker
- 5 years ago
- Views:
Transcription
1 Probabilistic Graphical Models Lecture 9: Variational Inference Relaxations Volkan Cevher, Matthias Seeger Ecole Polytechnique Fédérale de Lausanne 24/10/2011 (EPFL) Graphical Models 24/10/ / 15
2 Announcement No assignment this week Deadline programming assignment: June 18 (next lecture) (EPFL) Graphical Models 24/10/ / 15
3 Outline 1 Structured Mean Field (Variational Bayes) 2 (EPFL) Graphical Models 24/10/ / 15
4 Structured Mean Field (Variational Bayes) Variational Mean Field log Z sup Q Q {E Q [Ψ(x )] + H[Q(x )] Q: Tractable subset of all distributions (factorization constraints) { Q = Q(x ) = Q k(x Sk ), S k disjoint k Tractable? For any k, N k : Factor nodes j connected to any i S k (S k C j ) ( ) Q k (x S k ) exp E Q(xCj j N \S k k )[Ψ j (x Cj )] tractable to handle F1 (EPFL) Graphical Models 24/10/ / 15
5 Structured Mean Field (Variational Bayes) Variational Mean Field log Z sup Q Q {E Q [Ψ(x )] + H[Q(x )] Q: Tractable subset of all distributions (factorization constraints) { Q = Q(x ) = Q k(x Sk ), S k disjoint k Tractable? For any k, N k : Factor nodes j connected to any i S k (S k C j ) tractable to handle ( ) Q k (x S k ) exp E Q(xCj j N \S k k )[Ψ j (x Cj )] Q(x ) completely factorized? Naive mean field Anything more elaborate? Structured mean field (EPFL) Graphical Models 24/10/ / 15
6 Structured Mean Field (Variational Bayes) Factorial Hidden Markov Model F2 (EPFL) Graphical Models 24/10/ / 15
7 Structured Mean Field (Variational Bayes) Factorial Hidden Markov Model (EPFL) Graphical Models 24/10/ / 15
8 Structured Mean Field (Variational Bayes) Factorial Hidden Markov Model S 1 = uppermost chain. Update? F3 (EPFL) Graphical Models 24/10/ / 15
9 Structured Mean Field (Variational Bayes) Factorial Hidden Markov Model S 1 = uppermost chain. Update? Q(x S1 ): Markov chain (variable single node potentials) Double node (transition) potentials of Q(x Sk )? Fixed up front! Forward-backward for single node marginals to update Q(x S1 ). Implementation reduces to single HMM code, called with changing evidence potentials Not magic, but as expected: If this does not happen, you made a mistake (EPFL) Graphical Models 24/10/ / 15
10 Structured Mean Field (Variational Bayes) Variational Bayes Another instance of re-naming game: Nothing else than structured mean field Often applied to P(x, θ y ) (y observed, x latent nuisance, θ latent parameters) (EPFL) Graphical Models 24/10/ / 15
11 Structured Mean Field (Variational Bayes) Variational Bayes Another instance of re-naming game: Nothing else than structured mean field Often applied to P(x, θ y ) (y observed, x latent nuisance, θ latent parameters) Expectation maximization max θ log P(y, x θ) dx log Variational Bayes P(y, x θ) dx dθ max θ,q(x ) {E Q [log P(y, x θ)] max Q(θ),Q(x ) {E Q [log P(y, x θ)] + H[Q(x )] + H[Q(x )] + H[Q(θ)] Factorization assumption: Q(x, θ) = Q(x )Q(θ) (EPFL) Graphical Models 24/10/ / 15
12 Structured Mean Field (Variational Bayes) Variational Bayes Another instance of re-naming game: Nothing else than structured mean field Often applied to P(x, θ y ) (y observed, x latent nuisance, θ latent parameters) Expectation maximization max θ log P(y, x θ) dx log Variational Bayes P(y, x θ) dx dθ max θ,q(x ) {E Q [log P(y, x θ)] + H[Q(x )] max Q(θ),Q(x ) {E Q [log P(y, x θ)] + H[Q(x )] + H[Q(θ)] Factorization assumption: Q(x, θ) = Q(x )Q(θ) Easy to write generic code (bit like MCMC Gibbs sampling) Good approximation? Can do better today for almost any well-studied model (EPFL) Graphical Models 24/10/ / 15
13 Moment Parameters log Z = sup Q {E Q [Ψ(x )] + H[Q(x )] (EPFL) Graphical Models 24/10/ / 15
14 Moment Parameters log Z sup Q Q {E Q [Ψ(x )] + H[Q(x )] Q: Tractable subset of all distributions (factorization constraints) Seems whole story. What else could there be? (EPFL) Graphical Models 24/10/ / 15
15 Moment Parameters log Z sup Q Q {E Q [Ψ(x )] + H[Q(x )] Q: Tractable subset of all distributions (factorization constraints) Seems whole story. What else could there be? Consider log-linear models: Ψ j (x Cj ) = θ T j f j (x Cj ), θ = (θ j ) F5 E Q [Ψ(x )] = j θt j µ j, µ j := E Q [f j (x Cj )], µ = (µ j ) (EPFL) Graphical Models 24/10/ / 15
16 Moment Parameters log Z sup Q Q {E Q [Ψ(x )] + H[Q(x )] Q: Tractable subset of all distributions (factorization constraints) Seems whole story. What else could there be? Consider log-linear models: Ψ j (x Cj ) = θ T j f j (x Cj ), θ = (θ j ) E Q [Ψ(x )] = j θt j µ j, µ j := E Q [f j (x Cj )], µ = (µ j ) Moment parameters: Under mild assumptions on f j (x Cj ): Just another way (instead of θ) of parameterizing P(x ) (EPFL) Graphical Models 24/10/ / 15
17 Moment Parameters: Examples P(x ; θ) = Z 1 e θt f (x ) θ Natural parameters f (x ) Statistics, representation µ = E θ [f (x )] Moment parameters Representation minimal: For every z 0, there is x : z T (f (x ) T 1) T 0 Otherwise: Representation overcomplete F6 (EPFL) Graphical Models 24/10/ / 15
18 Moment Parameters: Examples P(x ; θ) = Z 1 e θt f (x ) θ Natural parameters f (x ) Statistics, representation µ = E θ [f (x )] Moment parameters Representation minimal: For every z 0, there is x : z T (f (x ) T 1) T 0 Otherwise: Representation overcomplete 1 Multinomial on graph with cliques C j F6b Convenient overcomplete representation: Components of f (x ): Indicators on cliques C j, indicators on intersections of cliques, indicators on intersections of cliques, intersections,... Equality constraints for µ: Consistency on nonempty intersections Sum to one on smallest intersections (EPFL) Graphical Models 24/10/ / 15
19 Moment Parameters: Examples P(x ; θ) = Z 1 e θt f (x ) θ Natural parameters f (x ) Statistics, representation µ = E θ [f (x )] Moment parameters Representation minimal: For every z 0, there is x : z T (f (x ) T 1) T 0 Otherwise: Representation overcomplete 2 Gaussian MRF Overcomplete representation: ( x f (x ) = vec( x x T /2) ) (, θ = r vec(a) Not minimal: A symmetric. {ij E a ij = a ji = 0. ) F6c (EPFL) Graphical Models 24/10/ / 15
20 Variational Formulation of Bayesian Inference log Z = sup Q {θ T E Q [f (x )] + H[Q(x )], f (x ) = [f j (x Cj )] Transform to moment parameters (EPFL) Graphical Models 24/10/ / 15
21 Variational Formulation of Bayesian Inference log Z = sup µ M {θ T µ + H[Q(x )], µ j = E Q [f j (x Cj )] Transform to moment parameters { M = (µ j ) µ j = E Q [f j (x Cj )] for some Q(x ) Marginal polytope What about the entropy? F7 (EPFL) Graphical Models 24/10/ / 15
22 Variational Formulation of Bayesian Inference log Z = sup µ M {θ T µ + H[µ] Transform to moment parameters { M = (µ j ) µ j = E Q [f j (x Cj )] for some Q(x ) Marginal polytope What about the entropy? µ M Q(x ) unique: Entropy is function of µ Point of this exercise: M convex set of vectors, more useful relaxation target than set of distributions (EPFL) Graphical Models 24/10/ / 15
23 Variational Formulation of Bayesian Inference log Z = sup µ M {θ T µ + H[µ] Transform to moment parameters { M = (µ j ) µ j = E Q [f j (x Cj )] for some Q(x ) Marginal polytope What about the entropy? µ M Q(x ) unique: Entropy is function of µ Point of this exercise: M convex set of vectors, more useful relaxation target than set of distributions Close now: Exponential families, Fenchel duality, maximum entropy. Full story: Wainwright, Jordan: Graphical Models, Exponential Families, and Variational Inference Foundations and Trends in Machine Learning, 1(1 2), pp (EPFL) Graphical Models 24/10/ / 15
24 Bayesian Inference is Convex Optimization log Z = sup µ M {θ T µ + H[µ] Marginal polytope M: Convex set F8 (EPFL) Graphical Models 24/10/ / 15
25 Bayesian Inference is Convex Optimization { log Z = sup µ M θ T µ + H[µ] {{ M convex Marginal polytope M: Convex set Entropy µ H[µ]: Concave function on M F8b (EPFL) Graphical Models 24/10/ / 15
26 Bayesian Inference is Convex Optimization { log Z = sup µ M θ T µ + H[µ] {{{{ M convex concave Marginal polytope M: Convex set Entropy µ H[µ]: Concave function on M Posterior: Unique solution to convex optimization problem (EPFL) Graphical Models 24/10/ / 15
27 Bayesian Inference is Convex Optimization { log Z = sup µ M θ T µ + H[µ] {{{{ M convex concave Marginal polytope M: Convex set Entropy µ H[µ]: Concave function on M Posterior: Unique solution to convex optimization problem Convex optimization can be intractable M can be hard to fence in θ µ can be hard to compute H[µ] can be hard to compute F8c (EPFL) Graphical Models 24/10/ / 15
28 Bayesian Inference is Convex Optimization { log Z = sup µ M θ T µ + H[µ] {{{{ M convex concave Marginal polytope M: Convex set Entropy µ H[µ]: Concave function on M Posterior: Unique solution to convex optimization problem Convex optimization can be intractable M can be hard to fence in θ µ can be hard to compute H[µ] can be hard to compute Took some steps. But worth it: Rich literature on relaxations of hard convex problems (EPFL) Graphical Models 24/10/ / 15
29 Variational Mean Field Revisited log Z = sup µ M {θ T µ + H[µ] Have to approximate M, H[µ]. One way you already know... (EPFL) Graphical Models 24/10/ / 15
30 Variational Mean Field Revisited log Z = sup µ M {θ T µ + H[µ] Have to approximate M, H[µ]. One way you already know... { M M NMF := µ µ Cj (x Cj ) = ( ) Q(x i ) f j (x Cj ) x Cj i C j Inner approximation, induced by factorized distributions Entropy decomposes just as distribution: H[µ] = i H[µ i] log Z sup µ MNMF {θ T µ + H[µ i] i (EPFL) Graphical Models 24/10/ / 15
31 Variational Mean Field Revisited log Z = sup µ M {θ T µ + H[µ] Have to approximate M, H[µ]. One way you already know... { M M NMF := µ µ Cj (x Cj ) = ( ) Q(x i ) f j (x Cj ) x Cj i C j Inner approximation, induced by factorized distributions Entropy decomposes just as distribution: H[µ] = i H[µ i] log Z sup µ MNMF {θ T µ + H[µ i] i Non-convex relaxation: M NMF not convex F9 (EPFL) Graphical Models 24/10/ / 15
32 The Marginal Polytope { M = (µ j ) µ j = E Q [f j (x Cj )] for some Q(x ) Multinomial on graph. Minimal representation. M convex polytope: Described by finite number inequalities. Complexity of M: Number of inequalities F10 (EPFL) Graphical Models 24/10/ / 15
33 The Marginal Polytope { M = (µ j ) µ j = E Q [f j (x Cj )] for some Q(x ) Multinomial on graph. Minimal representation. M convex polytope: Described by finite number inequalities. Complexity of M: Number of inequalities Complexity of M complexity of exact inference [we ll see why] G tree: M described by O(n) inequalities [next lecture] (EPFL) Graphical Models 24/10/ / 15
34 The Marginal Polytope { M = (µ j ) µ j = E Q [f j (x Cj )] for some Q(x ) Multinomial on graph. Minimal representation. M convex polytope: Described by finite number inequalities. Complexity of M: Number of inequalities Complexity of M complexity of exact inference [we ll see why] G tree: M described by O(n) inequalities [next lecture] Many graphs G with cycles: M polytope description provably hard (poly(n) inequalities would imply P=NP) (EPFL) Graphical Models 24/10/ / 15
35 The Marginal Polytope { M = (µ j ) µ j = E Q [f j (x Cj )] for some Q(x ) Gaussian MRF. Minimal representation (upper triangle of A). M exactly characterized by Σ = A 1 0. Convex cone (not polytope): Tractable to describe G tree: M described by O(n) inequalities General sparse G: Approximate inference still of interest, if exact cost O(n 3 ) too high F10b (EPFL) Graphical Models 24/10/ / 15
36 Wrap-Up Structured Mean Field: Q(x ) product of tractable, disjoint factors Variational Bayes: Another name for structured mean field Bayesian (marginal) inference is a convex optimization problem Variational approximations: Inner / outer bounds to marginal polytope (EPFL) Graphical Models 24/10/ / 15
13: Variational inference II
10-708: Probabilistic Graphical Models, Spring 2015 13: Variational inference II Lecturer: Eric P. Xing Scribes: Ronghuo Zheng, Zhiting Hu, Yuntian Deng 1 Introduction We started to talk about variational
More informationBayesian Machine Learning - Lecture 7
Bayesian Machine Learning - Lecture 7 Guido Sanguinetti Institute for Adaptive and Neural Computation School of Informatics University of Edinburgh gsanguin@inf.ed.ac.uk March 4, 2015 Today s lecture 1
More informationProbabilistic Graphical Models
School of Computer Science Probabilistic Graphical Models Variational Inference II: Mean Field Method and Variational Principle Junming Yin Lecture 15, March 7, 2012 X 1 X 1 X 1 X 1 X 2 X 3 X 2 X 2 X 3
More information14 : Theory of Variational Inference: Inner and Outer Approximation
10-708: Probabilistic Graphical Models 10-708, Spring 2017 14 : Theory of Variational Inference: Inner and Outer Approximation Lecturer: Eric P. Xing Scribes: Maria Ryskina, Yen-Chia Hsu 1 Introduction
More informationJunction Tree, BP and Variational Methods
Junction Tree, BP and Variational Methods Adrian Weller MLSALT4 Lecture Feb 21, 2018 With thanks to David Sontag (MIT) and Tony Jebara (Columbia) for use of many slides and illustrations For more information,
More informationVariational Inference (11/04/13)
STA561: Probabilistic machine learning Variational Inference (11/04/13) Lecturer: Barbara Engelhardt Scribes: Matt Dickenson, Alireza Samany, Tracy Schifeling 1 Introduction In this lecture we will further
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 11 Project
More informationProbabilistic Graphical Models
Probabilistic Graphical Models Introduction. Basic Probability and Bayes Volkan Cevher, Matthias Seeger Ecole Polytechnique Fédérale de Lausanne 26/9/2011 (EPFL) Graphical Models 26/9/2011 1 / 28 Outline
More informationLecture 13 : Variational Inference: Mean Field Approximation
10-708: Probabilistic Graphical Models 10-708, Spring 2017 Lecture 13 : Variational Inference: Mean Field Approximation Lecturer: Willie Neiswanger Scribes: Xupeng Tong, Minxing Liu 1 Problem Setup 1.1
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 7 Approximate
More information14 : Theory of Variational Inference: Inner and Outer Approximation
10-708: Probabilistic Graphical Models 10-708, Spring 2014 14 : Theory of Variational Inference: Inner and Outer Approximation Lecturer: Eric P. Xing Scribes: Yu-Hsin Kuo, Amos Ng 1 Introduction Last lecture
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistical Sciences! rsalakhu@cs.toronto.edu! h0p://www.cs.utoronto.ca/~rsalakhu/ Lecture 7 Approximate
More informationGraphical Models for Collaborative Filtering
Graphical Models for Collaborative Filtering Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012 Sequence modeling HMM, Kalman Filter, etc.: Similarity: the same graphical model topology,
More informationDiscrete Markov Random Fields the Inference story. Pradeep Ravikumar
Discrete Markov Random Fields the Inference story Pradeep Ravikumar Graphical Models, The History How to model stochastic processes of the world? I want to model the world, and I like graphs... 2 Mid to
More informationGraphical Models and Kernel Methods
Graphical Models and Kernel Methods Jerry Zhu Department of Computer Sciences University of Wisconsin Madison, USA MLSS June 17, 2014 1 / 123 Outline Graphical Models Probabilistic Inference Directed vs.
More informationSTA 414/2104: Machine Learning
STA 414/2104: Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistics! rsalakhu@cs.toronto.edu! http://www.cs.toronto.edu/~rsalakhu/ Lecture 9 Sequential Data So far
More informationProbabilistic Graphical Models. Theory of Variational Inference: Inner and Outer Approximation. Lecture 15, March 4, 2013
School of Computer Science Probabilistic Graphical Models Theory of Variational Inference: Inner and Outer Approximation Junming Yin Lecture 15, March 4, 2013 Reading: W & J Book Chapters 1 Roadmap Two
More informationECE521 Tutorial 11. Topic Review. ECE521 Winter Credits to Alireza Makhzani, Alex Schwing, Rich Zemel and TAs for slides. ECE521 Tutorial 11 / 4
ECE52 Tutorial Topic Review ECE52 Winter 206 Credits to Alireza Makhzani, Alex Schwing, Rich Zemel and TAs for slides ECE52 Tutorial ECE52 Winter 206 Credits to Alireza / 4 Outline K-means, PCA 2 Bayesian
More information6.867 Machine learning, lecture 23 (Jaakkola)
Lecture topics: Markov Random Fields Probabilistic inference Markov Random Fields We will briefly go over undirected graphical models or Markov Random Fields (MRFs) as they will be needed in the context
More informationProbabilistic Graphical Models
Probabilistic Graphical Models Lecture 11 CRFs, Exponential Family CS/CNS/EE 155 Andreas Krause Announcements Homework 2 due today Project milestones due next Monday (Nov 9) About half the work should
More informationLecture 9: PGM Learning
13 Oct 2014 Intro. to Stats. Machine Learning COMP SCI 4401/7401 Table of Contents I Learning parameters in MRFs 1 Learning parameters in MRFs Inference and Learning Given parameters (of potentials) and
More informationThe Particle Filter. PD Dr. Rudolph Triebel Computer Vision Group. Machine Learning for Computer Vision
The Particle Filter Non-parametric implementation of Bayes filter Represents the belief (posterior) random state samples. by a set of This representation is approximate. Can represent distributions that
More informationChapter 16. Structured Probabilistic Models for Deep Learning
Peng et al.: Deep Learning and Practice 1 Chapter 16 Structured Probabilistic Models for Deep Learning Peng et al.: Deep Learning and Practice 2 Structured Probabilistic Models way of using graphs to describe
More information9 Forward-backward algorithm, sum-product on factor graphs
Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.438 Algorithms For Inference Fall 2014 9 Forward-backward algorithm, sum-product on factor graphs The previous
More informationProbabilistic Graphical Models
Probabilistic Graphical Models Brown University CSCI 295-P, Spring 213 Prof. Erik Sudderth Lecture 11: Inference & Learning Overview, Gaussian Graphical Models Some figures courtesy Michael Jordan s draft
More informationUndirected Graphical Models
Outline Hong Chang Institute of Computing Technology, Chinese Academy of Sciences Machine Learning Methods (Fall 2012) Outline Outline I 1 Introduction 2 Properties Properties 3 Generative vs. Conditional
More informationDirected Probabilistic Graphical Models CMSC 678 UMBC
Directed Probabilistic Graphical Models CMSC 678 UMBC Announcement 1: Assignment 3 Due Wednesday April 11 th, 11:59 AM Any questions? Announcement 2: Progress Report on Project Due Monday April 16 th,
More informationGenerative and Discriminative Approaches to Graphical Models CMSC Topics in AI
Generative and Discriminative Approaches to Graphical Models CMSC 35900 Topics in AI Lecture 2 Yasemin Altun January 26, 2007 Review of Inference on Graphical Models Elimination algorithm finds single
More informationThe Ising model and Markov chain Monte Carlo
The Ising model and Markov chain Monte Carlo Ramesh Sridharan These notes give a short description of the Ising model for images and an introduction to Metropolis-Hastings and Gibbs Markov Chain Monte
More informationConditional Random Field
Introduction Linear-Chain General Specific Implementations Conclusions Corso di Elaborazione del Linguaggio Naturale Pisa, May, 2011 Introduction Linear-Chain General Specific Implementations Conclusions
More informationChris Bishop s PRML Ch. 8: Graphical Models
Chris Bishop s PRML Ch. 8: Graphical Models January 24, 2008 Introduction Visualize the structure of a probabilistic model Design and motivate new models Insights into the model s properties, in particular
More informationBasic math for biology
Basic math for biology Lei Li Florida State University, Feb 6, 2002 The EM algorithm: setup Parametric models: {P θ }. Data: full data (Y, X); partial data Y. Missing data: X. Likelihood and maximum likelihood
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 3 Linear
More informationProbabilistic Graphical Models
Probabilistic Graphical Models Brown University CSCI 2950-P, Spring 2013 Prof. Erik Sudderth Lecture 9: Expectation Maximiation (EM) Algorithm, Learning in Undirected Graphical Models Some figures courtesy
More informationLinear Dynamical Systems
Linear Dynamical Systems Sargur N. srihari@cedar.buffalo.edu Machine Learning Course: http://www.cedar.buffalo.edu/~srihari/cse574/index.html Two Models Described by Same Graph Latent variables Observations
More informationBased on slides by Richard Zemel
CSC 412/2506 Winter 2018 Probabilistic Learning and Reasoning Lecture 3: Directed Graphical Models and Latent Variables Based on slides by Richard Zemel Learning outcomes What aspects of a model can we
More informationBayesian Learning in Undirected Graphical Models
Bayesian Learning in Undirected Graphical Models Zoubin Ghahramani Gatsby Computational Neuroscience Unit University College London, UK http://www.gatsby.ucl.ac.uk/ Work with: Iain Murray and Hyun-Chul
More informationProbabilistic Machine Learning
Probabilistic Machine Learning Bayesian Nets, MCMC, and more Marek Petrik 4/18/2017 Based on: P. Murphy, K. (2012). Machine Learning: A Probabilistic Perspective. Chapter 10. Conditional Independence Independent
More information13 : Variational Inference: Loopy Belief Propagation and Mean Field
10-708: Probabilistic Graphical Models 10-708, Spring 2012 13 : Variational Inference: Loopy Belief Propagation and Mean Field Lecturer: Eric P. Xing Scribes: Peter Schulam and William Wang 1 Introduction
More informationProbabilistic Graphical Models
School of Computer Science Probabilistic Graphical Models Variational Inference III: Variational Principle I Junming Yin Lecture 16, March 19, 2012 X 1 X 1 X 1 X 1 X 2 X 3 X 2 X 2 X 3 X 3 Reading: X 4
More informationVariational Scoring of Graphical Model Structures
Variational Scoring of Graphical Model Structures Matthew J. Beal Work with Zoubin Ghahramani & Carl Rasmussen, Toronto. 15th September 2003 Overview Bayesian model selection Approximations using Variational
More informationDirected and Undirected Graphical Models
Directed and Undirected Graphical Models Adrian Weller MLSALT4 Lecture Feb 26, 2016 With thanks to David Sontag (NYU) and Tony Jebara (Columbia) for use of many slides and illustrations For more information,
More informationSampling Methods (11/30/04)
CS281A/Stat241A: Statistical Learning Theory Sampling Methods (11/30/04) Lecturer: Michael I. Jordan Scribe: Jaspal S. Sandhu 1 Gibbs Sampling Figure 1: Undirected and directed graphs, respectively, with
More informationProbabilistic Graphical Models (I)
Probabilistic Graphical Models (I) Hongxin Zhang zhx@cad.zju.edu.cn State Key Lab of CAD&CG, ZJU 2015-03-31 Probabilistic Graphical Models Modeling many real-world problems => a large number of random
More informationRandom Field Models for Applications in Computer Vision
Random Field Models for Applications in Computer Vision Nazre Batool Post-doctorate Fellow, Team AYIN, INRIA Sophia Antipolis Outline Graphical Models Generative vs. Discriminative Classifiers Markov Random
More informationProbabilistic Graphical Models
School of Computer Science Probabilistic Graphical Models Variational Inference IV: Variational Principle II Junming Yin Lecture 17, March 21, 2012 X 1 X 1 X 1 X 1 X 2 X 3 X 2 X 2 X 3 X 3 Reading: X 4
More informationUndirected Graphical Models
Undirected Graphical Models 1 Conditional Independence Graphs Let G = (V, E) be an undirected graph with vertex set V and edge set E, and let A, B, and C be subsets of vertices. We say that C separates
More informationDoes Better Inference mean Better Learning?
Does Better Inference mean Better Learning? Andrew E. Gelfand, Rina Dechter & Alexander Ihler Department of Computer Science University of California, Irvine {agelfand,dechter,ihler}@ics.uci.edu Abstract
More information13 : Variational Inference: Loopy Belief Propagation
10-708: Probabilistic Graphical Models 10-708, Spring 2014 13 : Variational Inference: Loopy Belief Propagation Lecturer: Eric P. Xing Scribes: Rajarshi Das, Zhengzhong Liu, Dishan Gupta 1 Introduction
More informationUnsupervised Learning
Unsupervised Learning Bayesian Model Comparison Zoubin Ghahramani zoubin@gatsby.ucl.ac.uk Gatsby Computational Neuroscience Unit, and MSc in Intelligent Systems, Dept Computer Science University College
More informationThe Origin of Deep Learning. Lili Mou Jan, 2015
The Origin of Deep Learning Lili Mou Jan, 2015 Acknowledgment Most of the materials come from G. E. Hinton s online course. Outline Introduction Preliminary Boltzmann Machines and RBMs Deep Belief Nets
More informationan introduction to bayesian inference
with an application to network analysis http://jakehofman.com january 13, 2010 motivation would like models that: provide predictive and explanatory power are complex enough to describe observed phenomena
More informationCS839: Probabilistic Graphical Models. Lecture 7: Learning Fully Observed BNs. Theo Rekatsinas
CS839: Probabilistic Graphical Models Lecture 7: Learning Fully Observed BNs Theo Rekatsinas 1 Exponential family: a basic building block For a numeric random variable X p(x ) =h(x)exp T T (x) A( ) = 1
More informationTwo Useful Bounds for Variational Inference
Two Useful Bounds for Variational Inference John Paisley Department of Computer Science Princeton University, Princeton, NJ jpaisley@princeton.edu Abstract We review and derive two lower bounds on the
More informationStatistical Learning
Statistical Learning Lecture 5: Bayesian Networks and Graphical Models Mário A. T. Figueiredo Instituto Superior Técnico & Instituto de Telecomunicações University of Lisbon, Portugal May 2018 Mário A.
More informationConditional Random Fields and beyond DANIEL KHASHABI CS 546 UIUC, 2013
Conditional Random Fields and beyond DANIEL KHASHABI CS 546 UIUC, 2013 Outline Modeling Inference Training Applications Outline Modeling Problem definition Discriminative vs. Generative Chain CRF General
More informationPattern Recognition and Machine Learning
Christopher M. Bishop Pattern Recognition and Machine Learning ÖSpri inger Contents Preface Mathematical notation Contents vii xi xiii 1 Introduction 1 1.1 Example: Polynomial Curve Fitting 4 1.2 Probability
More informationProbabilistic Graphical Models
Probabilistic Graphical Models Brown University CSCI 2950-P, Spring 2013 Prof. Erik Sudderth Lecture 13: Learning in Gaussian Graphical Models, Non-Gaussian Inference, Monte Carlo Methods Some figures
More informationExpectation Propagation Algorithm
Expectation Propagation Algorithm 1 Shuang Wang School of Electrical and Computer Engineering University of Oklahoma, Tulsa, OK, 74135 Email: {shuangwang}@ou.edu This note contains three parts. First,
More informationA graph contains a set of nodes (vertices) connected by links (edges or arcs)
BOLTZMANN MACHINES Generative Models Graphical Models A graph contains a set of nodes (vertices) connected by links (edges or arcs) In a probabilistic graphical model, each node represents a random variable,
More informationLecture 4 October 18th
Directed and undirected graphical models Fall 2017 Lecture 4 October 18th Lecturer: Guillaume Obozinski Scribe: In this lecture, we will assume that all random variables are discrete, to keep notations
More information1 Bayesian Linear Regression (BLR)
Statistical Techniques in Robotics (STR, S15) Lecture#10 (Wednesday, February 11) Lecturer: Byron Boots Gaussian Properties, Bayesian Linear Regression 1 Bayesian Linear Regression (BLR) In linear regression,
More information3 : Representation of Undirected GM
10-708: Probabilistic Graphical Models 10-708, Spring 2016 3 : Representation of Undirected GM Lecturer: Eric P. Xing Scribes: Longqi Cai, Man-Chia Chang 1 MRF vs BN There are two types of graphical models:
More informationGraphical Models. Outline. HMM in short. HMMs. What about continuous HMMs? p(o t q t ) ML 701. Anna Goldenberg ... t=1. !
Outline Graphical Models ML 701 nna Goldenberg! ynamic Models! Gaussian Linear Models! Kalman Filter! N! Undirected Models! Unification! Summary HMMs HMM in short! is a ayes Net hidden states! satisfies
More informationSequence labeling. Taking collective a set of interrelated instances x 1,, x T and jointly labeling them
HMM, MEMM and CRF 40-957 Special opics in Artificial Intelligence: Probabilistic Graphical Models Sharif University of echnology Soleymani Spring 2014 Sequence labeling aking collective a set of interrelated
More informationp L yi z n m x N n xi
y i z n x n N x i Overview Directed and undirected graphs Conditional independence Exact inference Latent variables and EM Variational inference Books statistical perspective Graphical Models, S. Lauritzen
More informationPart 1: Expectation Propagation
Chalmers Machine Learning Summer School Approximate message passing and biomedicine Part 1: Expectation Propagation Tom Heskes Machine Learning Group, Institute for Computing and Information Sciences Radboud
More informationVariational Inference. Sargur Srihari
Variational Inference Sargur srihari@cedar.buffalo.edu 1 Plan of discussion We first describe inference with PGMs and the intractability of exact inference Then give a taxonomy of inference algorithms
More informationProbabilistic Graphical Models Homework 2: Due February 24, 2014 at 4 pm
Probabilistic Graphical Models 10-708 Homework 2: Due February 24, 2014 at 4 pm Directions. This homework assignment covers the material presented in Lectures 4-8. You must complete all four problems to
More informationCSC 2541: Bayesian Methods for Machine Learning
CSC 2541: Bayesian Methods for Machine Learning Radford M. Neal, University of Toronto, 2011 Lecture 10 Alternatives to Monte Carlo Computation Since about 1990, Markov chain Monte Carlo has been the dominant
More informationCPSC 540: Machine Learning
CPSC 540: Machine Learning Undirected Graphical Models Mark Schmidt University of British Columbia Winter 2016 Admin Assignment 3: 2 late days to hand it in today, Thursday is final day. Assignment 4:
More informationProbabilistic and Bayesian Machine Learning
Probabilistic and Bayesian Machine Learning Day 4: Expectation and Belief Propagation Yee Whye Teh ywteh@gatsby.ucl.ac.uk Gatsby Computational Neuroscience Unit University College London http://www.gatsby.ucl.ac.uk/
More informationStatistical Machine Learning Lectures 4: Variational Bayes
1 / 29 Statistical Machine Learning Lectures 4: Variational Bayes Melih Kandemir Özyeğin University, İstanbul, Turkey 2 / 29 Synonyms Variational Bayes Variational Inference Variational Bayesian Inference
More informationLogistic Regression: Online, Lazy, Kernelized, Sequential, etc.
Logistic Regression: Online, Lazy, Kernelized, Sequential, etc. Harsha Veeramachaneni Thomson Reuter Research and Development April 1, 2010 Harsha Veeramachaneni (TR R&D) Logistic Regression April 1, 2010
More informationSequence Modelling with Features: Linear-Chain Conditional Random Fields. COMP-599 Oct 6, 2015
Sequence Modelling with Features: Linear-Chain Conditional Random Fields COMP-599 Oct 6, 2015 Announcement A2 is out. Due Oct 20 at 1pm. 2 Outline Hidden Markov models: shortcomings Generative vs. discriminative
More informationProbabilistic Graphical Models
2016 Robert Nowak Probabilistic Graphical Models 1 Introduction We have focused mainly on linear models for signals, in particular the subspace model x = Uθ, where U is a n k matrix and θ R k is a vector
More informationVCMC: Variational Consensus Monte Carlo
VCMC: Variational Consensus Monte Carlo Maxim Rabinovich, Elaine Angelino, Michael I. Jordan Berkeley Vision and Learning Center September 22, 2015 probabilistic models! sky fog bridge water grass object
More informationDirected and Undirected Graphical Models
Directed and Undirected Davide Bacciu Dipartimento di Informatica Università di Pisa bacciu@di.unipi.it Machine Learning: Neural Networks and Advanced Models (AA2) Last Lecture Refresher Lecture Plan Directed
More informationThe Expectation-Maximization Algorithm
1/29 EM & Latent Variable Models Gaussian Mixture Models EM Theory The Expectation-Maximization Algorithm Mihaela van der Schaar Department of Engineering Science University of Oxford MLE for Latent Variable
More informationCS Lecture 8 & 9. Lagrange Multipliers & Varitional Bounds
CS 6347 Lecture 8 & 9 Lagrange Multipliers & Varitional Bounds General Optimization subject to: min ff 0() R nn ff ii 0, h ii = 0, ii = 1,, mm ii = 1,, pp 2 General Optimization subject to: min ff 0()
More informationDensity Estimation. Seungjin Choi
Density Estimation Seungjin Choi Department of Computer Science and Engineering Pohang University of Science and Technology 77 Cheongam-ro, Nam-gu, Pohang 37673, Korea seungjin@postech.ac.kr http://mlg.postech.ac.kr/
More informationMachine Learning for Data Science (CS4786) Lecture 24
Machine Learning for Data Science (CS4786) Lecture 24 Graphical Models: Approximate Inference Course Webpage : http://www.cs.cornell.edu/courses/cs4786/2016sp/ BELIEF PROPAGATION OR MESSAGE PASSING Each
More informationLecture 7 and 8: Markov Chain Monte Carlo
Lecture 7 and 8: Markov Chain Monte Carlo 4F13: Machine Learning Zoubin Ghahramani and Carl Edward Rasmussen Department of Engineering University of Cambridge http://mlg.eng.cam.ac.uk/teaching/4f13/ Ghahramani
More informationLecture 6: Graphical Models: Learning
Lecture 6: Graphical Models: Learning 4F13: Machine Learning Zoubin Ghahramani and Carl Edward Rasmussen Department of Engineering, University of Cambridge February 3rd, 2010 Ghahramani & Rasmussen (CUED)
More informationCSC2535: Computation in Neural Networks Lecture 7: Variational Bayesian Learning & Model Selection
CSC2535: Computation in Neural Networks Lecture 7: Variational Bayesian Learning & Model Selection (non-examinable material) Matthew J. Beal February 27, 2004 www.variational-bayes.org Bayesian Model Selection
More informationChapter 4 Dynamic Bayesian Networks Fall Jin Gu, Michael Zhang
Chapter 4 Dynamic Bayesian Networks 2016 Fall Jin Gu, Michael Zhang Reviews: BN Representation Basic steps for BN representations Define variables Define the preliminary relations between variables Check
More informationCS Lecture 19. Exponential Families & Expectation Propagation
CS 6347 Lecture 19 Exponential Families & Expectation Propagation Discrete State Spaces We have been focusing on the case of MRFs over discrete state spaces Probability distributions over discrete spaces
More informationProbabilistic Graphical Models: MRFs and CRFs. CSE628: Natural Language Processing Guest Lecturer: Veselin Stoyanov
Probabilistic Graphical Models: MRFs and CRFs CSE628: Natural Language Processing Guest Lecturer: Veselin Stoyanov Why PGMs? PGMs can model joint probabilities of many events. many techniques commonly
More informationSum-Product Networks. STAT946 Deep Learning Guest Lecture by Pascal Poupart University of Waterloo October 17, 2017
Sum-Product Networks STAT946 Deep Learning Guest Lecture by Pascal Poupart University of Waterloo October 17, 2017 Introduction Outline What is a Sum-Product Network? Inference Applications In more depth
More informationDynamic Approaches: The Hidden Markov Model
Dynamic Approaches: The Hidden Markov Model Davide Bacciu Dipartimento di Informatica Università di Pisa bacciu@di.unipi.it Machine Learning: Neural Networks and Advanced Models (AA2) Inference as Message
More informationLECTURE 15 Markov chain Monte Carlo
LECTURE 15 Markov chain Monte Carlo There are many settings when posterior computation is a challenge in that one does not have a closed form expression for the posterior distribution. Markov chain Monte
More information10 : HMM and CRF. 1 Case Study: Supervised Part-of-Speech Tagging
10-708: Probabilistic Graphical Models 10-708, Spring 2018 10 : HMM and CRF Lecturer: Kayhan Batmanghelich Scribes: Ben Lengerich, Michael Kleyman 1 Case Study: Supervised Part-of-Speech Tagging We will
More informationCOS402- Artificial Intelligence Fall Lecture 10: Bayesian Networks & Exact Inference
COS402- Artificial Intelligence Fall 2015 Lecture 10: Bayesian Networks & Exact Inference Outline Logical inference and probabilistic inference Independence and conditional independence Bayes Nets Semantics
More informationCollapsed Variational Inference for Sum-Product Networks
for Sum-Product Networks Han Zhao 1, Tameem Adel 2, Geoff Gordon 1, Brandon Amos 1 Presented by: Han Zhao Carnegie Mellon University 1, University of Amsterdam 2 June. 20th, 2016 1 / 26 Outline Background
More informationCSci 8980: Advanced Topics in Graphical Models Gaussian Processes
CSci 8980: Advanced Topics in Graphical Models Gaussian Processes Instructor: Arindam Banerjee November 15, 2007 Gaussian Processes Outline Gaussian Processes Outline Parametric Bayesian Regression Gaussian
More information6.047 / Computational Biology: Genomes, Networks, Evolution Fall 2008
MIT OpenCourseWare http://ocw.mit.edu 6.047 / 6.878 Computational Biology: Genomes, Networks, Evolution Fall 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.
More informationIntelligent Systems:
Intelligent Systems: Undirected Graphical models (Factor Graphs) (2 lectures) Carsten Rother 15/01/2015 Intelligent Systems: Probabilistic Inference in DGM and UGM Roadmap for next two lectures Definition
More information4.1 Notation and probability review
Directed and undirected graphical models Fall 2015 Lecture 4 October 21st Lecturer: Simon Lacoste-Julien Scribe: Jaime Roquero, JieYing Wu 4.1 Notation and probability review 4.1.1 Notations Let us recall
More informationAn Introduction to Bayesian Machine Learning
1 An Introduction to Bayesian Machine Learning José Miguel Hernández-Lobato Department of Engineering, Cambridge University April 8, 2013 2 What is Machine Learning? The design of computational systems
More informationLecture 15. Probabilistic Models on Graph
Lecture 15. Probabilistic Models on Graph Prof. Alan Yuille Spring 2014 1 Introduction We discuss how to define probabilistic models that use richly structured probability distributions and describe how
More information