Fiedler s Theorems on Nodal Domains

Similar documents
Fiedler s Theorems on Nodal Domains

Specral Graph Theory and its Applications September 7, Lecture 2 L G1,2 = 1 1.

Spectral Graph Theory Lecture 2. The Laplacian. Daniel A. Spielman September 4, x T M x. ψ i = arg min

Effective Resistance and Schur Complements

Walks, Springs, and Resistor Networks

Spectral Graph Theory Lecture 3. Fundamental Graphs. Daniel A. Spielman September 5, 2018

Rings, Paths, and Paley Graphs

Linear algebra and applications to graphs Part 1

The effect on the algebraic connectivity of a tree by grafting or collapsing of edges

Matching Polynomials of Graphs

Note on deleting a vertex and weak interlacing of the Laplacian spectrum

Physical Metaphors for Graphs

Lecture 1 and 2: Random Spanning Trees

ORIE 6334 Spectral Graph Theory September 8, Lecture 6. In order to do the first proof, we need to use the following fact.

Markov Chains, Random Walks on Graphs, and the Laplacian

Spectral Theory of Unsigned and Signed Graphs Applications to Graph Clustering. Some Slides

Laplacian Integral Graphs with Maximum Degree 3

(a) If A is a 3 by 4 matrix, what does this tell us about its nullspace? Solution: dim N(A) 1, since rank(a) 3. Ax =

SVD, Power method, and Planted Graph problems (+ eigenvalues of random matrices)

Lecture 10. Lecturer: Aleksander Mądry Scribes: Mani Bastani Parizi and Christos Kalaitzis

Kernels of Directed Graph Laplacians. J. S. Caughman and J.J.P. Veerman

Bipartite Ramanujan Graphs of Every Degree

17.1 Directed Graphs, Undirected Graphs, Incidence Matrices, Adjacency Matrices, Weighted Graphs

Z-Pencils. November 20, Abstract

Recall the convention that, for us, all vectors are column vectors.

Notes on the Matrix-Tree theorem and Cayley s tree enumerator

Chapter 3 Transformations

Spectral Analysis of Random Walks

1 Matrix notation and preliminaries from spectral graph theory

Spectra of Adjacency and Laplacian Matrices

Iterative solvers for linear equations

Lecture 7: Positive Semidefinite Matrices

Graph fundamentals. Matrices associated with a graph

An Algorithmist s Toolkit September 10, Lecture 1

Rings, Paths, and Cayley Graphs

Econ Slides from Lecture 7

Definition 2.3. We define addition and multiplication of matrices as follows.

Intrinsic products and factorizations of matrices

A lower bound for the Laplacian eigenvalues of a graph proof of a conjecture by Guo

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2

Spectral Graph Theory and You: Matrix Tree Theorem and Centrality Metrics

Algebraic Methods in Combinatorics

Linear Algebra and its Applications

7. Symmetric Matrices and Quadratic Forms

Iterative solvers for linear equations

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.

Math 408 Advanced Linear Algebra

Graphs, Vectors, and Matrices Daniel A. Spielman Yale University. AMS Josiah Willard Gibbs Lecture January 6, 2016

An Interlacing Property of Eigenvalues of Strictly Totally Positive Matrices

The Adjacency Matrix, Standard Laplacian, and Normalized Laplacian, and Some Eigenvalue Interlacing Results

U.C. Berkeley Better-than-Worst-Case Analysis Handout 3 Luca Trevisan May 24, 2018

Linear Algebra- Final Exam Review

Iowa State University and American Institute of Mathematics

COMPSCI 514: Algorithms for Data Science

The third smallest eigenvalue of the Laplacian matrix

Ramanujan Graphs of Every Size

The Singular Value Decomposition and Least Squares Problems

Ma/CS 6b Class 23: Eigenvalues in Regular Graphs

Problem Set 1. Homeworks will graded based on content and clarity. Please show your work clearly for full credit.

Iterative solvers for linear equations

On the second Laplacian eigenvalues of trees of odd order

Mathematical foundations - linear algebra

Math Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88

No class on Thursday, October 1. No office hours on Tuesday, September 29 and Thursday, October 1.

MATH 5720: Unconstrained Optimization Hung Phan, UMass Lowell September 13, 2018

Conductance, the Normalized Laplacian, and Cheeger s Inequality

1 Adjacency matrix and eigenvalues

The Distance Spectrum

CSC Linear Programming and Combinatorial Optimization Lecture 10: Semidefinite Programming

An Introduction to Spectral Graph Theory

Background on Linear Algebra - Lecture 2

1 T 1 = where 1 is the all-ones vector. For the upper bound, let v 1 be the eigenvector corresponding. u:(u,v) E v 1(u)

Quadrature for the Finite Free Convolution

Large Scale Data Analysis Using Deep Learning

Convergence of Random Walks

Lecture 14: SVD, Power method, and Planted Graph problems (+ eigenvalues of random matrices) Lecturer: Sanjeev Arora

Lecture 24: Element-wise Sampling of Graphs and Linear Equation Solving. 22 Element-wise Sampling of Graphs and Linear Equation Solving

sublinear time low-rank approximation of positive semidefinite matrices Cameron Musco (MIT) and David P. Woodru (CMU)

Lecture notes: Applied linear algebra Part 1. Version 2

1 Positive definiteness and semidefiniteness

Econ Slides from Lecture 8

AMS526: Numerical Analysis I (Numerical Linear Algebra)

Lecture 3: graph theory

Lecture Introduction. 2 Brief Recap of Lecture 10. CS-621 Theory Gems October 24, 2012

2. Every linear system with the same number of equations as unknowns has a unique solution.

New feasibility conditions for directed strongly regular graphs

Math Matrix Algebra

Elementary linear algebra

Math 443/543 Graph Theory Notes 5: Graphs as matrices, spectral graph theory, and PageRank

U.C. Berkeley CS270: Algorithms Lecture 21 Professor Vazirani and Professor Rao Last revised. Lecture 21

Inverse Eigenvalue Problems for Two Special Acyclic Matrices

Sparsification of Graphs and Matrices

Laplacian eigenvalues and optimality: II. The Laplacian of a graph. R. A. Bailey and Peter Cameron

13-2 Text: 28-30; AB: 1.3.3, 3.2.3, 3.4.2, 3.5, 3.6.2; GvL Eigen2

MTH5112 Linear Algebra I MTH5212 Applied Linear Algebra (2017/2018)

Simultaneous Diagonalization of Positive Semi-definite Matrices

An Algorithmist s Toolkit September 15, Lecture 2

On the adjacency matrix of a block graph

THE SPECTRUM OF THE LAPLACIAN MATRIX OF A BALANCED 2 p -ARY TREE

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 11 Luca Trevisan February 29, 2016

Transcription:

Spectral Graph Theory Lecture 7 Fiedler s Theorems on Nodal Domains Daniel A Spielman September 9, 202 7 About these notes These notes are not necessarily an accurate representation of what happened in class The notes written before class say what I think I should say The notes written after class way what I wish I said I think that these notes are mostly correct 72 Overview Nodal domains are the connected parts of a graph on which an eigenvector is negative or positive In this lecture, we will cover some of the fundamental theorems of Fiedler on nodal domains of the Laplacian The first theorem that I will present says that the kth eigenvector of a weighted path graph changes sign k times So, the alternation that we observed when we derived the eigenvectors of the path holds even if the path is weighted In fact, the theorem is stronger A similar fact holds for trees Next lecture, I hope to use this theorem to show how eigenvectors can be used to reconstruct tree metrics The second theorem in this lecture will be one of our best extensions of this fact to general graphs 73 Sylverter s Law of Interia When I introduced the normalized Laplacian last lecture, I assumed but did not prove that it is positive semidefinite Since no one complained, I assumed that it was obvious But, just to be safe I will tell you why Claim 73 If A is positive semidefinite, then so is B T AB for any matrix B Proof For any x, since A is positive semidefinite x T B T ABx =(Bx) T A(Bx) 0, In this lecture, we will make use of Sylvester s law of intertia, which is a powerful generalization of this fact I will state and prove it now 7-

Lecture 7: September 9, 202 7-2 Theorem 732 (Sylvester s Law of Intertia) Let A be any symmetric matrix and let B be any non-singular matrix Then, the matrix BAB T has the same number of positive, negative and zero eigenvalues as A Proof It is clear that A and BAB T eigenvalues have the same rank, and thus the same number of zero We will prove that A has at least as many positive eigenvalues as BAB T One can similarly prove that that A has at least as many negative eigenvalues, which proves the theorem Let,, k be the positive eigenvalues of BAB T and let Y k be the span of the corresponding eigenvectors Now, let S k be the span of the vectors B T y, for y 2 Y k As B is non-singluar, S k has dimension k By the Courant-Fischer Theorem, we have k = x T Ax max min S IR n x 2S x T x dim(s)=k x T Ax min x 2S k x T x =min y2y k y T BAB T y y T BB T y > 0 So, A has at least k positive eigenvalues (The point here is that the denominators are always positive, so we only need to think about the numerators) 74 Weighted Trees We will now prove a theorem of Fiedler [Fie75] Theorem 74 Let T be a weighted tree graph on n vertices, let L T have eigenvalues 0= < 2 apple n, and let k be an eigenvector of k If there is no vertex u for which k(u) =0, then there are exactly k edges for which k(u) k(v) < 0 In the case of a path graph, this means that the eigenvector changes sign k path We will consider eigenvectors with zero entries in the next problem set times along the Our analysis will rest on an understanding of Laplacians of trees that are allowed to have negative edges weights Lemma 742 Let T =(V,E) be a tree, and let M = (u,v)2e w u,v L u,v, where the weights w u,v are non-zero and we recall that L u,v is the Laplacian of the edge (u, v) The number of negative eigenvalues of M equals the number of negative edge weights Proof Note that x T Mx = w u,v (x (u) x (v)) 2 (u,v)2e

Lecture 7: September 9, 202 7-3 We now perform a change of variables that will diagonalize the matrix M Begin by re-numbering the vertices so that for every vertex v there is a path from vertex to vertex v in which the numbers of vertices encountered are increasing Under such and ordering, for every vertex v there will be exactly one edge (u, v) withu<v Let () = x (), and for every node v let (v) =x (v) x (u) where (u, v) is the edge with u<v Every variable x (),,x(n) can be expressed as a linear combination of the variables (),, (n) To see this, let v be any vertex and let,u,,u k,v be the vertices on the path from to v, in order Then, x (v) = () + (u )+ + (u k )+ (v) So, there is a square matrix L of full rank such that By Sylvester s law of intertia, we know that x = L L T ML has the same number of positive, negative, and zero eigenvalues as M On the other hand, T L T ML = w u,v ( (v)) 2 (u,v)2e,u<v So, this matrix clearly has one zero eigenvalue, and as many negative eigenvalues as there are negative w u,v Proof of Theorem 74 Let k denote the diagonal matrix with k on the diagonal, and let be the corresponding eigenvalue Consider the matrix k M = k(l P k I ) k The matrix L P k I has one zero eigenvalue and k negative eigenvalues As we have assumed that k has no zero entries, k is non-singular, and so we may apply Sylvester s Law of Intertia to show that the same is true of M I claim that M = (u,v)2e w u,v k(u) k(v)l u,v To see this, first check that this agrees with the previous definition on the o -diagonal entries To verify that these expression agree on the diagonal entries, we will show that the sum of the entries in each row of both expressions agree As we know that all the o -diagonal entries agree, this implies that the diagonal entries agree We compute k(l P k I ) k = k(l P k I ) k = k( k k k k) =0 As L u,v = 0, the row sums agree Lemma 742 now tells us that the matrix M has as many negative eigenvalues as there are edges (u, v) for which k(u) k(v) < 0

Lecture 7: September 9, 202 7-4 75 More linear algebra There are a few more facts from linear algebra that we will need for the rest of this lecture We stop to prove them now 75 The Perron-Frobenius Theorem for Laplacians In Lecture 3, we proved the Perron-Frobenius Theorem for non-negative matrices I wish to quickly observe that this theory may also be applied to Laplacian matrices, to principal sub-matrices of Laplacian matrices, and to any matrix with non-positive o -diagonal entries The di erence is that it then involves the eigenvector of the smallest eigenvalue, rather than the largest eigenvalue Corollary 75 Let M be a matrix with non-positive o -diagonal entries, such that the graph of the non-zero o -diagonally entries is connected Let be the smallest eigenvalue of M and let v be the corresponding eigenvector Then v may be taken to be strictly positive, and has multiplicity Proof Consider the matrix A = I M, for some large For su ciently large, this matrix will be non-negative, and the graph of its non-zero entries is connected So, we may apply the Perron-Frobenius theory to A to conclude that its largest eigenvalue has multiplicity, and the corresponding eigenvector v may be assumed to be strictly positive We then have =, and v is an eigenvector of 752 Eigenvalue Interlacing We will often use the following elementary consequence of the Courant-Fischer Theorem I recommend deriving it for yourself Theorem 752 (Eigenvalue Interlacing) Let A be an n-by-n symmetric matrix and let B be a principal submatrix of A of dimension n (that is, B is obtained by deleting the same row and column from A) Then, 2 2 n n n, where 2 n and 2 n are the eigenvalues of A and B, respectively 76 Fiedler s Nodal Domain Theorem Given a graph G =(V,E) and a subset of vertices, W V, recall that the graph induced by G on W is the graph with vertex set W and edge set This graph is sometimes denoted G(W ) {(i, j) 2 E,i 2 W and j 2 W }

Lecture 7: September 9, 202 7-5 Theorem 76 ([Fie75]) Let G =(V,E,w) be a weighted connected graph, and let L G be its Laplacian matrix Let 0= < 2 apple apple n be the eigenvalues of L G and let v,,v n be the corresponding eigenvectors For any k 2, let W k = {i 2 V : v k (i) 0} Then, the graph induced by G on W k has at most k connected components Proof To see that W k is non-empty, recall that v = and that v k is orthogonal v So, v k must have both positive and negative entries Assume that G(W k ) has t connected components After re-ordering the vertices so that the vertices in one connected component of G(W k ) appear first, and so on, we may assume that L G and v k have the forms 2 3 0 B 0 0 C x 0 B 2 0 C 2 x 2 L G = 6 7 v k = B C, 6 4 0 0 B t C t C T C2 T Ct T D and 2 3 0 B 0 0 C 0 B 2 0 C 2 6 7 B 4 0 0 B t C t 5 @ x t C T C2 T Ct T D y 7 5 x x 2 C A = k B @ 0 x t y x x 2 B @ x t y The first t sets of rows and columns correspond to the t connected components So, x i 0 for apple i apple t and y < 0 (when I write this for a vector, I mean it holds for each entry) We also know that the graph of non-zero entries in each B i is connected, and that each C i is non-positive, and has at least one non-zero entry (otherwise the graph G would be disconnected) We will now prove that the smallest eigenvalue of B i is smaller than B i x i + C i y = k x i C A C A k We know that As each entry in C i is non-positive and y is strictly negative, each entry of C i y is non-negative and some entry of C i y is positive Thus, x i cannot be all zeros, and B i x i = k x i C i y apple k x i x T i B i x i apple k x T i x i If x i has any zero entries, then the Perron-Frobenius theorem tells us that x i cannot be an eigenvector of smallest eigenvalue, and so the smallest eigenvalue of B i is less than k On the other hand, if x i is strictly positive, then x T i C iy > 0, and x T i B i x i = k x T i x i x T i C i y < k x T i x i

Lecture 7: September 9, 202 7-6 Thus, the matrix 2 3 B 0 0 0 B 2 0 6 4 7 5 0 0 B t has at least t eigenvalues less than k By the eigenvalue interlacing theorem, this implies that L G has at least t eigenvalues less than k We may conclude that t, the number of connected components of G(W k ), is at most k We remark that Fiedler actually proved a somewhat stronger theorem He showed that the same holds for W = {i : v k (i) t}, for every t apple 0 This theorem breaks down if we instead consider the set The star graphs provide counter-examples W = {i : v k (i) > 0} 0 3 Figure 7: The star graph on 5 vertices, with an eigenvector of 2 = References [Fie75] M Fiedler A property of eigenvectors of nonnegative symmetric matrices and its applications to graph theory Czechoslovak Mathematical Journal, 25(00):68 633, 975