The Laplacian and Signless Laplacian Matrices

We first define the incidence matrix of a graph.
Let be a graph where and . The incidence matrix of is the matrix such that
Hence, the rows of are indexed by the vertices of and the columns of are indexed by the edges of . The only non-zero entries of column (there are only two non-zero entries) correspond to the indices of the vertices incident with edge . Similarly, the non-zero entries of the row correspond to all the edges incident to vertex . Hence, .
Find the incidence matrix of the graphs given below.
figures/incidence-matrix.svg
Two graphs
The signless Laplacian matrix of is the matrix defined as When no confusion arises we write instead of . Notice that and thus is a symmetric matrix. We now find an alternative expression for . Let be the diagonal matrix whose th diagonal entry is . The matrix is called the degree matrix of .
For any graph it holds that .
We have that If then On the other hand, if then is the product of the th row and the th row of , and the only possibly non-zero product is when and have a non-zero entry in the same column, which corresponds to and incident with the same edge.
Before we can define the Laplacian matrix of a graph we need the notion of an orientation on a graph. An orientation of is an assignment of a direction to each edge by declaring one vertex incident with as the head and the other vertex as the tail. Formally, an orientation of is a function such that is equal to one of or . If then we say that is the tail and is the head of the edge .
Let be a graph where and , and let be an orientation of . The oriented incidence matrix of is the matrix defined by
The Laplacian matrix of relative to the orientation is the matrix As with the signless Laplacian matrix, the Laplacian matrix is a symmetric matrix. When no confusion arises, we write instead of .
Assign an orientation to the left graph in Figure 4.1 and compute the associated oriented incidence matrix . Then compute .
For any graph it holds that . Consequently, is independent of the orientation chosen.
The proof is similar to the that of the signless Laplacian matrix. That is independent of the orientation follows since and are independent of any orientation.
Let be the all ones vector. Then Therefore is an eigenvalue of with corresponding eigenvector . We now show that and have non-negative eigenvalues. To that end, we say that a symmetric matrix is positive semi-definite if for all non-zero and is positive definite if for all non-zero .
A symmetric matrix is positive definite if and only if every eigenvalue of is positive. Similarly, is positive semi-definite if and only if every eigenvalue of is non-negative.
Since is symmetric, there exists an orthonormal basis of consisting of eigenvectors of . Thus, if and . Let denote the corresponding eigenvalues, that is, . Suppose that is positive definite (the proof for positive semi-definiteness is identical). Then for all non-zero . Now, Therefore, is positive. This shows that if is positive definite then all eigenvalues of are positive. Conversely, suppose that has all positive eigenvalues and let be an arbitrary non-zero vector. Since is a basis for , there are constants , not all zero, such that . Then, and since at least one is non-zero and all eigenvalues are positive, we conclude that .
The Laplacian and signless Laplacian matrices are positive semi-definite.
Recall that and thus . Now, by definition of , for any vector we have We conclude that for all , and therefore is positive semi-definite. The proof for is identical.
Since is a symmetric matrix, and as we have just shown is positive semi-definite, the eigenvalues of can be ordered as The Laplacian matrix reveals many useful connectivity properties of a graph.
A graph is connected if and only if is a simple eigenvalue of . Moreover, the algebraic multiplicity of is the number of components of .
We first recall that is an eigenvector of with eigenvalue . Suppose that . For any vector we have Since (where denotes disjoint union) we can write Suppose now that , that is, is an eigenvector of with eigenvalue . Then and from our computation above we deduce that for each component of . Hence, the entries of are equal on each component of . If is connected then has all entries equal and thus is a multiple of . This proves that the geometric multiplicity, and thus the algebraic multiplicity, of is one and thus is a simple eigenvalue. Conversely, assume that is disconnected with components where , and let . Let be the vector with entries equal to 1 on each vertex of component and zero elsewhere. Then and therefore . Since is a linearly independent set of vectors, this proves that the multiplicity of is at least . However, since each component is by definition connected and we have proved that a connected graph has as a simple eigenvalue, has algebraic multiplicity exactly .
Since is a symmetric matrix and is semi-positive definite, the eigenvalues of can be ordered as Note that in general we can only say that .
The signless Laplacian matrix of the graph on the left in Figure 4.1 is and . Hence, .
Suppose that is connected. The least eigenvalue of is if and only if is bipartite. In this case, 0 is a simple eigenvalue.
As in the proof for the Laplacian matrix, for any we have Suppose that is an eigenvector of with eigenvalue . Then and therefore for every edge . Let , , and . Since is a non-zero vector, and are non-empty, and moreover . Any vertex in is not adjacent to any vertex in or . Indeed, if and then necessarily and thus . Since is connected this implies that . This proves that and is a partition of . Moreover, if and then necessarily , and vice-versa. This proves that is a bipartition of , and thus is bipartite. Now suppose that is bipartite and let be a bipartition of . Let and let be the vector whose entries on are and on are . Thus, if denotes the incidence matrix of then . Therefore and thus is an eigenvector of with eigenvalue . Now suppose that is another eigenvector of with eigenvalue . Then implies that for . Since is connected, is completely determined by its value at since there is a path from to any vertex in . Thus is a multiple of , and this proves that is a simple eigenvalue.
For any graph , the multiplicity of as an eigenvalue of is the number of bipartite components of .
Prove that and use it to show that if then where is the Laplacian of .
Suppose that the adjacency matrix of has eigenvalues . If is a -regular graph, find the eigenvalues of and .
Find the Laplacian and signless Laplacian eigenvalues of the complete graph .

Exercises

Label the vertices of so that for . Find the Laplacian matrix of . Do the same for . What about for for arbitrary ?
Recall that for any matrix with eigenvalues , if is the characteristic polynomial of then Using this fact, find the coefficient of of the characteristic polynomial for any Laplacian matrix . What about the constant term of ?
Let be a graph with vertices and Laplacian eigenvalues , and let be a graph with vertices and Laplacian eigenvalues . In this problem you are going to find the Laplacian eigenvalues of . Recall that is obtained by taking the union of and and then connecting each vertex in to every vertex in . Hence and .
  1. Suppose that the vertices of are labelled so that the first vertices are from and the next vertices are from . Let and , and we note that is a matrix and is a matrix. Explain why where as usual is the identity matrix and is the all ones matrix, each of appropriate size.
  2. Consider the vector where appears times and appears times. Note that can be written as where is the all ones vector of appropriate size. Show that is an eigenvector of and find the corresponding eigenvalue.
  3. Suppose that is an eigenvector of with eigenvalue for . Let where is the zero vector in . Using the fact that , show that is an eigenvector of with eigenvalue . Hence, this shows that are eigenvalues of .
  4. Suppose that is an eigenvector of with eigenvalue for . Let where is the zero vector in . Using the fact that , show that is an eigenvector of with eigenvalue . Hence, this shows that are eigenvalues of .
  5. Parts (a), (b), (c) produce eigenvalues of . What is the missing eigenvalue of ?

The Matrix Tree Theorem

Recall that is a subgraph of if and . A subgraph of is a spanning subgraph of if . Hence, a spanning subgraph of is obtained by deleting some of the edges of but keeping all vertices. If is a spanning subgraph of and is a tree then we say that is a spanning tree of . The proof of the following lemma is left as an exercise.
A graph is connected if and only if has a spanning tree.
If has a spanning tree then clearly is connected since any path in is a path in . Now suppose that is connected. If then and then clearly has a spanning tree. Assume that every connected graph with edges has a spanning tree. Let be a connected graph with edges. If is a tree we are done so suppose is not a tree. Pick any cycle in and delete any edge in . Then is connected and has edges. By induction, has a spanning tree, say , and is then a spanning tree for .
Find all of the spanning trees of the graph shown below.
figures/find-spanning-trees.svg
The Matrix Tree theorem provides a way to count the number of spanning trees in a graph using the cofactors of the Laplacian matrix . Recall that for any matrix , the -cofactor of is where is the matrix obtained by deleting the th row and the th column of . Clearly, if is an integer matrix then each cofactor is an integer. The cofactor matrix of is the matrix with entries . Using the definition of the determinant, one can show that Moreover, if is symmetric then is also symmetric.
For any graph , there exists an integer such that , in other words, for all .
Using the fact that and we obtain . Suppose that is connected. Then any vector in the kernel of is a multiple of . Now since , it follows that each row of is a multiple of the all ones vector , i.e., each row of is constant. Since is symmetric, this implies that is a constant matrix, i.e., for some integer . If is disconnected, then the kernel of is at least two-dimensional and therefore . This implies that every cofactor of is zero. Hence, in this case .
For any graph , is the number of spanning trees of .