The Miracles of Tropical Spectral Theory

Size: px
Start display at page:

Download "The Miracles of Tropical Spectral Theory"

Transcription

1 The Miracles of Tropical Spectral Theory Emmanuel Tsukerman University of California, Berkeley July 31, / 110

2 Motivation One of the most important results in max-algebra [is] that for every matrix the maximum cycle mean is the greatest eigenvalue [But10] 2 / 110

3 Motivation One of the most important results in max-algebra [is] that for every matrix the maximum cycle mean is the greatest eigenvalue [But10] - Tensor spectral theory is flourishing, so let us study its tropicalization 3 / 110

4 Motivation One of the most important results in max-algebra [is] that for every matrix the maximum cycle mean is the greatest eigenvalue [But10] - Tensor spectral theory is flourishing, so let us study its tropicalization Credit goes to Bernd Sturmfels for suggesting this avenue of research 4 / 110

5 Outline 1 Preliminaries Basic Tropical Geometry Tropical Spectral Theory of Matrices Classical Tensor Eigenpairs 2 Tropical Spectral Theory of Tensors 5 / 110

6 Outline 1 Preliminaries Basic Tropical Geometry Tropical Spectral Theory of Matrices Classical Tensor Eigenpairs 2 Tropical Spectral Theory of Tensors 6 / 110

7 Basic Tropical Geometry 7 / 110

8 Tropical Arithmetic Replace ordinary addition and multiplication with: x y = x y = minimum of x and y x + y 8 / 110

9 Tropical Arithmetic Replace ordinary addition and multiplication with: x y = x y = minimum of x and y x + y Example: 3 (4 5) = 3 4 = 7 9 / 110

10 Tropical Arithmetic Replace ordinary addition and multiplication with: x y = x y = minimum of x and y x + y Example: 3 (4 5) = 3 4 = 7 3 (4 5) = = 7 8 = 7 10 / 110

11 Tropical Arithmetic Replace ordinary addition and multiplication with: x y = x y = minimum of x and y x + y Example: 3 (4 5) = 3 4 = 7 3 (4 5) = = 7 8 = 7 Associative, distributive, commutative 11 / 110

12 Tropical Arithmetic There is also an additive identity 12 / 110

13 Tropical Arithmetic There is also an additive identity x = x for any x 13 / 110

14 Tropical Arithmetic Matrix times vector multiplication: 14 / 110

15 Tropical Arithmetic Matrix times vector multiplication: ( ) ( ) ( a11 a 12 x a11 x a = 12 y a 21 a 22 y... ) 15 / 110

16 Tropical Arithmetic Matrix times vector multiplication: ( ) ( ) ( a11 a 12 x a11 x a = 12 y a 21 a 22 y... ( ) min(a11 + x, a = 12 + y)... ) 16 / 110

17 Tropical Arithmetic Matrix times vector multiplication: ( ) ( ) ( a11 a 12 x a11 x a = 12 y a 21 a 22 y... Scalar times matrix multiplitication: ( ) min(a11 + x, a = 12 + y)... ) 17 / 110

18 Tropical Arithmetic Matrix times vector multiplication: ( ) ( ) ( a11 a 12 x a11 x a = 12 y a 21 a 22 y... ( ) min(a11 + x, a = 12 + y)... Scalar times matrix multiplitication: ( ) ( ) a11 a λ 12 λ a11 λ a = 12 a 21 a 22 λ a 21 λ a 22 ) 18 / 110

19 Tropical Arithmetic Matrix times vector multiplication: ( ) ( ) ( a11 a 12 x a11 x a = 12 y a 21 a 22 y... ( ) min(a11 + x, a = 12 + y)... Scalar times matrix multiplitication: ( ) ( ) a11 a λ 12 λ a11 λ a = 12 a 21 a 22 λ a 21 λ a 22 ( ) λ + a11 λ + a = 12 λ + a 21 λ + a 22 ) 19 / 110

20 Outline 1 Preliminaries Basic Tropical Geometry Tropical Spectral Theory of Matrices Classical Tensor Eigenpairs 2 Tropical Spectral Theory of Tensors 20 / 110

21 Tropical Spectral Theory of Matrices 21 / 110

22 Tropical Eigenpair An eigenvalue of an n n matrix A is a number λ such that A v = λ v 22 / 110

23 Tropical Eigenpair An eigenvalue of an n n matrix A is a number λ such that A v = λ v A vector v as above is called an eigenvector. 23 / 110

24 Tropical Eigenpair An eigenvalue of an n n matrix A is a number λ such that A v = λ v A vector v as above is called an eigenvector. Example: n = 2 ( ) min(a11 + x, a 12 + y) = min(a 21 + x, a 22 + y) ( λ + x λ + y ) 24 / 110

25 Directed Graph of a Square Matrix Associate to an n n matrix A = (a ij ) a weighted directed graph G(A) as follows. The nodes are 1, 2,..., n 25 / 110

26 Directed Graph of a Square Matrix Associate to an n n matrix A = (a ij ) a weighted directed graph G(A) as follows. The nodes are 1, 2,..., n There is an edge from i to j iff a ij <. 26 / 110

27 Directed Graph of a Square Matrix Associate to an n n matrix A = (a ij ) a weighted directed graph G(A) as follows. The nodes are 1, 2,..., n There is an edge from i to j iff a ij <. Edge (i, j) gets weight a ij 27 / 110

28 Directed Graph of a Square Matrix Associate to an n n matrix A = (a ij ) a weighted directed graph G(A) as follows. The nodes are 1, 2,..., n There is an edge from i to j iff a ij <. Edge (i, j) gets weight a ij A directed path i 0, i 1,..., i k gets a weight: a i0 i 1 + a i1 i a ik 1 i k. 28 / 110

29 Directed Graph of a Square Matrix Associate to an n n matrix A = (a ij ) a weighted directed graph G(A) as follows. The nodes are 1, 2,..., n There is an edge from i to j iff a ij <. Edge (i, j) gets weight a ij A directed path i 0, i 1,..., i k gets a weight: The normalized weight a i0 i 1 + a i1 i a ik 1 i k. a i0 i 1 + a i1 i a ik 1 i k k is called the normalized length of the path. 29 / 110

30 Directed Graph of a Square Matrix Associate to an n n matrix A = (a ij ) a weighted directed graph G(A) as follows. The nodes are 1, 2,..., n There is an edge from i to j iff a ij <. Edge (i, j) gets weight a ij A directed path i 0, i 1,..., i k gets a weight: The normalized weight a i0 i 1 + a i1 i a ik 1 i k. a i0 i 1 + a i1 i a ik 1 i k k is called the normalized length of the path. Directed cycles are paths for which i 0 = i k. 30 / 110

31 Tropical Eigenvalue and the Directed Graph Theorem [CG62, Cuninghame-Green] If the graph G(A) is strongly connected, then A has precisely one eigenvalue. This eigenvalue is equal to the minimal normalized length of any directed cycle of G(A). 31 / 110

32 Tropical Eigenvalue and the Directed Graph Theorem [CG62, Cuninghame-Green] If the graph G(A) is strongly connected, then A has precisely one eigenvalue. This eigenvalue is equal to the minimal normalized length of any directed cycle of G(A). It appears then that in order to find λ(a) we must inspect all cycles of G(A) 32 / 110

33 Tropical Eigenvalue and the Directed Graph Theorem [CG62, Cuninghame-Green] If the graph G(A) is strongly connected, then A has precisely one eigenvalue. This eigenvalue is equal to the minimal normalized length of any directed cycle of G(A). It appears then that in order to find λ(a) we must inspect all cycles of G(A) However, there is an efficient algorithm based on linear programming given by Karp [Kar78]: 33 / 110

34 Tropical Eigenvalue via LP λ(a) = [ maximize λ subject to a ij + x j λ + x i, i, j [n] ] 34 / 110

35 Tropical Eigenvalue via LP λ(a) = [ maximize λ subject to a ij + x j λ + x i, i, j [n] This is surprising because the constraints are obvious necessary conditions and no equalities are enforced ] 35 / 110

36 Tropical Eigenvalue via LP λ(a) = [ maximize λ subject to a ij + x j λ + x i, i, j [n] This is surprising because the constraints are obvious necessary conditions and no equalities are enforced Example: n = 2 min(a 11 + x 1, a 12 + x 2 ) = λ + x 1 min(a 21 + x 1, a 22 + x 2 ) = λ + x 2 ] 36 / 110

37 Classical and Tropical Eigenvalues 37 / 110

38 Classical and Tropical Eigenvalues Let X be a positive matrix over a field with valuation. 38 / 110

39 Classical and Tropical Eigenvalues Let X be a positive matrix over a field with valuation. Let X (k) be its kth Hadamard power. 39 / 110

40 Classical and Tropical Eigenvalues Let X be a positive matrix over a field with valuation. Let X (k) be its kth Hadamard power.let ρ denote the Perron-Frobenius eigenvalue and λ the tropical eigenvalue. 40 / 110

41 Classical and Tropical Eigenvalues Let X be a positive matrix over a field with valuation. Let X (k) be its kth Hadamard power.let ρ denote the Perron-Frobenius eigenvalue and λ the tropical eigenvalue. lim ρ(x (k) ) 1 k = λ(x ). k 41 / 110

42 Outline 1 Preliminaries Basic Tropical Geometry Tropical Spectral Theory of Matrices Classical Tensor Eigenpairs 2 Tropical Spectral Theory of Tensors 42 / 110

43 Classical Tensor Eigenpairs 43 / 110

44 Tensor times a vector Take A = (a i1 i 2 i m ) to be an } n. {{.. n } tensor. Let x be an n-vector. m times 44 / 110

45 Tensor times a vector Take A = (a i1 i 2 i m ) to be an n... n }{{} We define the product Ax m 1 := m times tensor. Let x be an n-vector. n i 2,...,i m=1 a 1i 2 i m x i2 x im n i 2,...,i m=1 a 2i 2 i m x i2 x im. n i 2,...,i m=1 a ni 2 i m x i2 x im. 45 / 110

46 Tensor eigenpairs There are several variants of eigenpairs: 46 / 110

47 Tensor eigenpairs There are several variants of eigenpairs: x m 1 1 Ax m 1 = λx [m 1] x m 1 = λ 2. xn m 1 (H-eigenpair) 47 / 110

48 Tensor eigenpairs There are several variants of eigenpairs: x m 1 1 Ax m 1 = λx [m 1] x m 1 = λ 2. xn m 1 Ax m 1 = λx (H-eigenpair) (E-eigenpair) 48 / 110

49 Tensor eigenpairs There are several variants of eigenpairs: x m 1 1 Ax m 1 = λx [m 1] x m 1 = λ 2. xn m 1 and others which I will not discuss. Ax m 1 = λx (H-eigenpair) (E-eigenpair) 49 / 110

50 Outline 1 Preliminaries Basic Tropical Geometry Tropical Spectral Theory of Matrices Classical Tensor Eigenpairs 2 Tropical Spectral Theory of Tensors 50 / 110

51 Tropical Spectral Theory of Tensors 51 / 110

52 Tropical Eigenpairs The tropicalization of Ax m 1 := n i 2,...,i m=1 a 1i 2 i m x i2 x im n i 2,...,i m=1 a 2i 2 i m x i2 x im. n i 2,...,i m=1 a ni 2 i m x i2 x im should be n i 2,...,i m=1 a 1i 2 i m x i2 x im n i 2,...,i m=1 a 2i 2 i m x i2 x im. n i 2,...,i m=1 a ni 2 i m x i2 x im 52 / 110

53 Tropical Eigenpairs Similarly, replace the classical operations on the right-hand side of the eigenpair equation by the tropical ones: 53 / 110

54 Tropical Eigenpairs Similarly, replace the classical operations on the right-hand side of the eigenpair equation by the tropical ones: x m 1 x (m 1) 1 λx [m 1] x m 1 1 = λ 2. λ x (m 1) 2 (H-eigenpair). xn m 1 xn (m 1) 54 / 110

55 Tropical Eigenpairs Similarly, replace the classical operations on the right-hand side of the eigenpair equation by the tropical ones: x m 1 x (m 1) 1 λx [m 1] x m 1 1 = λ 2. λ x (m 1) 2 (H-eigenpair). xn m 1 xn (m 1) and λx λ x (E-eigenpair) 55 / 110

56 Definition A tropical H-eigenpair for a tensor (a i1 i m ) R nm (x, λ) R n /R(1, 1,..., 1) R such that is a pair n i 2,...,i m=1 a ii2 i m x i2 x im = λ x m 1 i, i = 1, 2,..., n. We call x a tropical H-eigenvector and λ a tropical H-eigenvalue. Basically, Ax m 1 = λx [m 1] in tropical arithmetic. 56 / 110

57 Definition A tropical H-eigenpair for a tensor (a i1 i m ) R nm (x, λ) R n /R(1, 1,..., 1) R such that is a pair n i 2,...,i m=1 a ii2 i m x i2 x im = λ x m 1 i, i = 1, 2,..., n. We call x a tropical H-eigenvector and λ a tropical H-eigenvalue. Basically, Ax m 1 = λx [m 1] in tropical arithmetic. Similarly, a tropical E-eigenpair satisfies n i 2,...,i m=1 a ii2 i m x i2 x im = λ x i, i = 1, 2,..., n. 57 / 110

58 Definition A tropical H-eigenpair for a tensor (a i1 i m ) R nm (x, λ) R n /R(1, 1,..., 1) R such that is a pair n i 2,...,i m=1 a ii2 i m x i2 x im = λ x m 1 i, i = 1, 2,..., n. We call x a tropical H-eigenvector and λ a tropical H-eigenvalue. Basically, Ax m 1 = λx [m 1] in tropical arithmetic. Similarly, a tropical E-eigenpair satisfies n i 2,...,i m=1 a ii2 i m x i2 x im = λ x i, i = 1, 2,..., n. From now on, I may use E-eigenpairs and H-eigenpairs to shorten for tropical E-eigenpairs and H-eigenpairs when there is no danger of confusion 58 / 110

59 Example Take n = 2 and m = 3. Then a tropical H-eigenpair (x, λ) satisfies min{a x 1, a x 1 + x 2, a x 2 + x 1, a x 2 } = λ + 2x 1 min{a x 1, a x 1 + x 2, a x 2 + x 1, a x 2 } = λ + 2x / 110

60 Example Take n = 2 and m = 3. Then a tropical H-eigenpair (x, λ) satisfies min{a x 1, a x 1 + x 2, a x 2 + x 1, a x 2 } = λ + 2x 1 min{a x 1, a x 1 + x 2, a x 2 + x 1, a x 2 } = λ + 2x 2. Notice that the tensor can be assumed to be symmetric in its last m 1 coordinates 60 / 110

61 Example Take n = 2 and m = 3. Then a tropical H-eigenpair (x, λ) satisfies min{a x 1, a x 1 + x 2, a x 2 + x 1, a x 2 } = λ + 2x 1 min{a x 1, a x 1 + x 2, a x 2 + x 1, a x 2 } = λ + 2x 2. Notice that the tensor can be assumed to be symmetric in its last m 1 coordinates Example Take n = 3 and m = 3. Then a tropical H-eigenpair (x, λ) satisfies min{a x 1,a 112 +x 1 +x 2,a 113 +x 1 +x 3,a x 2,a 123 +x 2 +x 3,a x 3 }=λ+2x 1 min{a x 1,a 212 +x 1 +x 2,a 213 +x 1 +x 3,a x 2,a 223 +x 2 +x 3,a x 3 }=λ+2x 2 min{a x 1,a 312 +x 1 +x 2,a 313 +x 1 +x 3,a x 2,a 323 +x 2 +x 3,a x 3 }=λ+2x / 110

62 Example Take n = 2 and m = 3. Then a tropical H-eigenpair (x, λ) satisfies min{a x 1, a x 1 + x 2, a x 2 + x 1, a x 2 } = λ + 2x 1 min{a x 1, a x 1 + x 2, a x 2 + x 1, a x 2 } = λ + 2x 2. Notice that the tensor can be assumed to be symmetric in its last m 1 coordinates Example Take n = 3 and m = 3. Then a tropical H-eigenpair (x, λ) satisfies min{a x 1,a 112 +x 1 +x 2,a 113 +x 1 +x 3,a x 2,a 123 +x 2 +x 3,a x 3 }=λ+2x 1 min{a x 1,a 212 +x 1 +x 2,a 213 +x 1 +x 3,a x 2,a 223 +x 2 +x 3,a x 3 }=λ+2x 2 min{a x 1,a 312 +x 1 +x 2,a 313 +x 1 +x 3,a x 2,a 323 +x 2 +x 3,a x 3 }=λ+2x 3. For E-eigenpairs, we would replace 2x 1, 2x 2, 2x 3 on the right with x 1, x 2, x / 110

63 Tropical E-Eigenpairs Initially, I focused on E-eigenpairs. Professor Sturmfels and I ran some experiments: 63 / 110

64 Tropical E-Eigenpairs Initially, I focused on E-eigenpairs. Professor Sturmfels and I ran some experiments: For randomly generated symmetric 3x3x3-tensors, we obtained the following distribution of tensors by number of tropical E-eigenpairs (from 0 eigenpairs to 7): 64 / 110

65 Tropical E-Eigenpairs Initially, I focused on E-eigenpairs. Professor Sturmfels and I ran some experiments: For randomly generated symmetric 3x3x3-tensors, we obtained the following distribution of tensors by number of tropical E-eigenpairs (from 0 eigenpairs to 7): [0, 80.1, 0.14, 19, 0, 0.12, 0.02, 0.58]% 65 / 110

66 Tropical E-Eigenpairs Initially, I focused on E-eigenpairs. Professor Sturmfels and I ran some experiments: For randomly generated symmetric 3x3x3-tensors, we obtained the following distribution of tensors by number of tropical E-eigenpairs (from 0 eigenpairs to 7): [0, 80.1, 0.14, 19, 0, 0.12, 0.02, 0.58]% Conclusion: different (generic) tensors have a different number of E-eigenpairs and it is not obvious what the pattern of possible numbers of E-eigenpairs is. 66 / 110

67 Tropical E-Eigenpairs Initially, I focused on E-eigenpairs. Professor Sturmfels and I ran some experiments: For randomly generated symmetric 3x3x3-tensors, we obtained the following distribution of tensors by number of tropical E-eigenpairs (from 0 eigenpairs to 7): [0, 80.1, 0.14, 19, 0, 0.12, 0.02, 0.58]% Conclusion: different (generic) tensors have a different number of E-eigenpairs and it is not obvious what the pattern of possible numbers of E-eigenpairs is. In contrast, we have the following result for H-eigenpairs 67 / 110

68 Tropical H-Eigenpairs Theorem A tensor A R nm has a unique tropical H-eigenvalue λ(a) R. 68 / 110

69 Tropical H-Eigenpairs Theorem A tensor A R nm has a unique tropical H-eigenvalue λ(a) R. Proof idea: 69 / 110

70 Tropical H-Eigenpairs Theorem A tensor A R nm has a unique tropical H-eigenvalue λ(a) R. Proof idea: Existence: tropical analogue of proof of Perron-Frobenius Theorem. 70 / 110

71 Tropical H-Eigenpairs Theorem A tensor A R nm has a unique tropical H-eigenvalue λ(a) R. Proof idea: Existence: tropical analogue of proof of Perron-Frobenius Theorem. Proof of existence works for E-eigenpairs as well 71 / 110

72 Tropical H-Eigenpairs Theorem A tensor A R nm has a unique tropical H-eigenvalue λ(a) R. Proof idea: Existence: tropical analogue of proof of Perron-Frobenius Theorem. Proof of existence works for E-eigenpairs as well Uniqueness: Gordan s Theorem (a theorem of the alternative) 72 / 110

73 Tropical H-Eigenpairs The H-eigenvalue is also a solution to an LP 73 / 110

74 Tropical H-Eigenpairs The H-eigenvalue is also a solution to an LP This LP simply requires λ to be a subeigenvalue: 74 / 110

75 Tropical H-Eigenpairs The H-eigenvalue is also a solution to an LP This LP simply requires λ to be a subeigenvalue: Theorem λ(a) = [ maximize λ subject to a i1 i 2 i m + x i x im λ + (m 1)x i1 ] 75 / 110

76 Tropical H-Eigenpairs The H-eigenvalue is also a solution to an LP This LP simply requires λ to be a subeigenvalue: Theorem λ(a) = [ maximize λ subject to a i1 i 2 i m + x i x im λ + (m 1)x i1 Dually, the H-eigenvalue of A is given by minimize (i 1,i 2,...,i m) [n] a m i1 i 2 i m y i1 i 2 i m subject to (i 1,i 2,...,i m) [n] y m i1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] y m i1 i 2 i m = 1 y i1 i 2 i m 0. ] 76 / 110

77 Interpreting the Dual We associate to a tensor A a weighted directed hypergraph H(A). The nodes are [n] = {1, 2,..., n} 77 / 110

78 Interpreting the Dual We associate to a tensor A a weighted directed hypergraph H(A). The nodes are [n] = {1, 2,..., n} The hyperedges are pairs (i 1, {i 2,..., i m }) 78 / 110

79 Interpreting the Dual We associate to a tensor A a weighted directed hypergraph H(A). The nodes are [n] = {1, 2,..., n} The hyperedges are pairs (i 1, {i 2,..., i m }) (we think of i 1 as having multiplicity (m 1)) 79 / 110

80 Interpreting the Dual We associate to a tensor A a weighted directed hypergraph H(A). The nodes are [n] = {1, 2,..., n} The hyperedges are pairs (i 1, {i 2,..., i m }) (we think of i 1 as having multiplicity (m 1)) 80 / 110

81 Interpreting the Dual We associate to a tensor A a weighted directed hypergraph H(A). The nodes are [n] = {1, 2,..., n} The hyperedges are pairs (i 1, {i 2,..., i m }) (we think of i 1 as having multiplicity (m 1)) Each hyperedge (i 1, {i 2,..., i m }) receives a weight a i1 i 2 i m. 81 / 110

82 The dual problem is minimize (i 1,i 2,...,i m) [n] m a i 1 i 2 i m y i1 i 2 i m subject to (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m / 110

83 The dual problem is minimize (i 1,i 2,...,i m) [n] m a i 1 i 2 i m y i1 i 2 i m subject to (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m 0. We think of y i1 i 2 i m as the amout of flow through edge (i 1, {i 2,..., i m }) 83 / 110

84 The dual problem is minimize (i 1,i 2,...,i m) [n] m a i 1 i 2 i m y i1 i 2 i m subject to (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m 0. We think of y i1 i 2 i m as the amout of flow through edge (i 1, {i 2,..., i m }) The term y i1 i 2 i m ((m 1)e i1 e i2... e im ) accounts for the amount of flow entering each of i 2,..., i m and leaving i 1 84 / 110

85 The dual problem is minimize (i 1,i 2,...,i m) [n] m a i 1 i 2 i m y i1 i 2 i m subject to (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m 0. We think of y i1 i 2 i m as the amout of flow through edge (i 1, {i 2,..., i m }) The term y i1 i 2 i m ((m 1)e i1 e i2... e im ) accounts for the amount of flow entering each of i 2,..., i m and leaving i 1 Condition 1 then states that we have a circulation (conservation of flow) 85 / 110

86 The dual problem is minimize (i 1,i 2,...,i m) [n] m a i 1 i 2 i m y i1 i 2 i m subject to (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m 0. We think of y i1 i 2 i m as the amout of flow through edge (i 1, {i 2,..., i m }) The term y i1 i 2 i m ((m 1)e i1 e i2... e im ) accounts for the amount of flow entering each of i 2,..., i m and leaving i 1 Condition 1 then states that we have a circulation (conservation of flow) The a s (tensor entries) give a weight to each edge 86 / 110

87 The dual problem is minimize (i 1,i 2,...,i m) [n] m a i 1 i 2 i m y i1 i 2 i m subject to (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m 0. We think of y i1 i 2 i m as the amout of flow through edge (i 1, {i 2,..., i m }) The term y i1 i 2 i m ((m 1)e i1 e i2... e im ) accounts for the amount of flow entering each of i 2,..., i m and leaving i 1 Condition 1 then states that we have a circulation (conservation of flow) The a s (tensor entries) give a weight to each edge Interpretation: we seek to find a nontrivial circulation with least A-weight 87 / 110

88 Interpreting the Dual Definition The circulation polytope H n,m is the polytope defined by the inequalities (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m / 110

89 Interpreting the Dual Definition The circulation polytope H n,m is the polytope defined by the inequalities (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m 0. The H-cycles are the vertices of H n,m. 89 / 110

90 Interpreting the Dual Definition The circulation polytope H n,m is the polytope defined by the inequalities (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m 0. The H-cycles are the vertices of H n,m. The H-eigenvalue is the minimum A-weighted H-cycle 90 / 110

91 Interpreting the Dual Definition The circulation polytope H n,m is the polytope defined by the inequalities (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m 0. The H-cycles are the vertices of H n,m. The H-eigenvalue is the minimum A-weighted H-cycle For matrices, the circulation polytope is called the normalized cycle polytope 91 / 110

92 H-cycles The H-cycles become more complicated for tensors compared with matrices 92 / 110

93 H-cycles The H-cycles become more complicated for tensors compared with matrices In particular, the vertices of the circulation polytope are no longer normalized characteristic functions of subsets of the edges 93 / 110

94 H-cycles The H-cycles become more complicated for tensors compared with matrices In particular, the vertices of the circulation polytope are no longer normalized characteristic functions of subsets of the edges Example The tensor whose entries are all zero except for a 132 = a 213 = a 322 = 1 is extremized on the vertex y 132 = 2 9, y 213 = 4 9, y 322 = 3 9, y ijk = 0 for remaining indices The edges here are 2 (1, {2, 3}), 4 (2, {1, 3}), 3 (3, {2, 2}) 94 / 110

95 Summary 95 / 110

96 Summary There exists a unique tropical H-eigenvalue 96 / 110

97 Summary There exists a unique tropical H-eigenvalue not at all the case for tropical E-eigenvalues 97 / 110

98 Summary There exists a unique tropical H-eigenvalue not at all the case for tropical E-eigenvalues it is equal to the minimum A-weighted H-cycle 98 / 110

99 Summary There exists a unique tropical H-eigenvalue not at all the case for tropical E-eigenvalues it is equal to the minimum A-weighted H-cycle can be found efficiently (LP) 99 / 110

100 Summary There exists a unique tropical H-eigenvalue not at all the case for tropical E-eigenvalues it is equal to the minimum A-weighted H-cycle can be found efficiently (LP) To a tensor there is an associated directed weighted hypergraph 100 / 110

101 Summary There exists a unique tropical H-eigenvalue not at all the case for tropical E-eigenvalues it is equal to the minimum A-weighted H-cycle can be found efficiently (LP) To a tensor there is an associated directed weighted hypergraph We have seen the circulation polytope, which is the polytope formed from the H-cycles 101 / 110

102 Summary There exists a unique tropical H-eigenvalue not at all the case for tropical E-eigenvalues it is equal to the minimum A-weighted H-cycle can be found efficiently (LP) To a tensor there is an associated directed weighted hypergraph We have seen the circulation polytope, which is the polytope formed from the H-cycles its vertices are complicated for tensors 102 / 110

103 Summary There exists a unique tropical H-eigenvalue not at all the case for tropical E-eigenvalues it is equal to the minimum A-weighted H-cycle can be found efficiently (LP) To a tensor there is an associated directed weighted hypergraph We have seen the circulation polytope, which is the polytope formed from the H-cycles its vertices are complicated for tensors tensors correspond to linear functionals on this polytope, and extrema correspond to tropical H-eigenvalues 103 / 110

104 Future Directions 104 / 110

105 Future Directions Describe the tropical H-eigenvectors of a tensor 105 / 110

106 Future Directions Describe the tropical H-eigenvectors of a tensor Relate classical and tropical tensor spectral theories 106 / 110

107 Thank you Questions? 107 / 110

108 Existence and Uniqueness Theorem Let A R nm and assume that for each i = 1, 2,..., n, the sets S i := {{i (i) 2,..., i (i) m } : a ii (i) 2 i (i) m } are nonempty and mutually equal. Then A has a unique tropical H-eigenvalue λ(a) R. 108 / 110

109 Properties of H-cycle Polytope Theorem Let y R nm be a vertex of the H-cycle polytope H n,m. Then y has at most one nonzero entry of the form y ji2 i m for each j = 1, 2,..., n. There exist vertices with n nonzero entries. 109 / 110

110 Peter Butkovič. Max-linear systems: theory and algorithms. Springer Monographs in Mathematics. Springer-Verlag London, Ltd., London, R. A. Cuninghame-Green. Describing industrial processes with interference and approximating their steady-state behaviour. OR, 13(1):pp , Richard M. Karp. A characterization of the minimum cycle mean in a digraph. Discrete Math., 23(3): , / 110

Combinatorial Types of Tropical Eigenvector

Combinatorial Types of Tropical Eigenvector Combinatorial Types of Tropical Eigenvector arxiv:1105.55504 Ngoc Mai Tran Department of Statistics, UC Berkeley Joint work with Bernd Sturmfels 2 / 13 Tropical eigenvalues and eigenvectors Max-plus: (R,,

More information

Eigenvalues of the Adjacency Tensor on Products of Hypergraphs

Eigenvalues of the Adjacency Tensor on Products of Hypergraphs Int. J. Contemp. Math. Sciences, Vol. 8, 201, no. 4, 151-158 HIKARI Ltd, www.m-hikari.com Eigenvalues of the Adjacency Tensor on Products of Hypergraphs Kelly J. Pearson Department of Mathematics and Statistics

More information

Ma/CS 6b Class 20: Spectral Graph Theory

Ma/CS 6b Class 20: Spectral Graph Theory Ma/CS 6b Class 20: Spectral Graph Theory By Adam Sheffer Eigenvalues and Eigenvectors A an n n matrix of real numbers. The eigenvalues of A are the numbers λ such that Ax = λx for some nonzero vector x

More information

Ma/CS 6b Class 20: Spectral Graph Theory

Ma/CS 6b Class 20: Spectral Graph Theory Ma/CS 6b Class 20: Spectral Graph Theory By Adam Sheffer Recall: Parity of a Permutation S n the set of permutations of 1,2,, n. A permutation σ S n is even if it can be written as a composition of an

More information

Section 1.7: Properties of the Leslie Matrix

Section 1.7: Properties of the Leslie Matrix Section 1.7: Properties of the Leslie Matrix Definition: A matrix A whose entries are nonnegative (positive) is called a nonnegative (positive) matrix, denoted as A 0 (A > 0). Definition: A square m m

More information

Spectral Properties of Matrix Polynomials in the Max Algebra

Spectral Properties of Matrix Polynomials in the Max Algebra Spectral Properties of Matrix Polynomials in the Max Algebra Buket Benek Gursoy 1,1, Oliver Mason a,1, a Hamilton Institute, National University of Ireland, Maynooth Maynooth, Co Kildare, Ireland Abstract

More information

Z-Pencils. November 20, Abstract

Z-Pencils. November 20, Abstract Z-Pencils J. J. McDonald D. D. Olesky H. Schneider M. J. Tsatsomeros P. van den Driessche November 20, 2006 Abstract The matrix pencil (A, B) = {tb A t C} is considered under the assumptions that A is

More information

Combinatorial types of tropical eigenvectors

Combinatorial types of tropical eigenvectors Bull. London Math. Soc. 45 (2013) 27 36 C 2012 London Mathematical Society doi:10.1112/blms/bds058 Combinatorial types of tropical eigenvectors Bernd Sturmfels and Ngoc Mai Tran Abstract The map which

More information

A Tropical Extremal Problem with Nonlinear Objective Function and Linear Inequality Constraints

A Tropical Extremal Problem with Nonlinear Objective Function and Linear Inequality Constraints A Tropical Extremal Problem with Nonlinear Objective Function and Linear Inequality Constraints NIKOLAI KRIVULIN Faculty of Mathematics and Mechanics St. Petersburg State University 28 Universitetsky Ave.,

More information

Tropical Algebra. Notes by Bernd Sturmfels for the lecture on May 22, 2018, in the IMPRS Ringvorlesung Introduction to Nonlinear Algebra

Tropical Algebra. Notes by Bernd Sturmfels for the lecture on May 22, 2018, in the IMPRS Ringvorlesung Introduction to Nonlinear Algebra Tropical Algebra Notes by Bernd Sturmfels for the lecture on May 22, 2018, in the IMPRS Ringvorlesung Introduction to Nonlinear Algebra The tropical semiring (R { },, ) consists of the real numbers R,

More information

THE PERTURBATION BOUND FOR THE SPECTRAL RADIUS OF A NON-NEGATIVE TENSOR

THE PERTURBATION BOUND FOR THE SPECTRAL RADIUS OF A NON-NEGATIVE TENSOR THE PERTURBATION BOUND FOR THE SPECTRAL RADIUS OF A NON-NEGATIVE TENSOR WEN LI AND MICHAEL K. NG Abstract. In this paper, we study the perturbation bound for the spectral radius of an m th - order n-dimensional

More information

Properties of Linear Transformations from R n to R m

Properties of Linear Transformations from R n to R m Properties of Linear Transformations from R n to R m MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Topic Overview Relationship between the properties of a matrix transformation

More information

arxiv: v2 [math.oc] 28 Nov 2015

arxiv: v2 [math.oc] 28 Nov 2015 Rating Alternatives from Pairwise Comparisons by Solving Tropical Optimization Problems arxiv:1504.00800v2 [math.oc] 28 Nov 2015 N. Krivulin Abstract We consider problems of rating alternatives based on

More information

Perron Frobenius Theory

Perron Frobenius Theory Perron Frobenius Theory Oskar Perron Georg Frobenius (1880 1975) (1849 1917) Stefan Güttel Perron Frobenius Theory 1 / 10 Positive and Nonnegative Matrices Let A, B R m n. A B if a ij b ij i, j, A > B

More information

Linear Algebra Practice Problems

Linear Algebra Practice Problems Math 7, Professor Ramras Linear Algebra Practice Problems () Consider the following system of linear equations in the variables x, y, and z, in which the constants a and b are real numbers. x y + z = a

More information

MATH36001 Perron Frobenius Theory 2015

MATH36001 Perron Frobenius Theory 2015 MATH361 Perron Frobenius Theory 215 In addition to saying something useful, the Perron Frobenius theory is elegant. It is a testament to the fact that beautiful mathematics eventually tends to be useful,

More information

PREFERENCE MATRICES IN TROPICAL ALGEBRA

PREFERENCE MATRICES IN TROPICAL ALGEBRA PREFERENCE MATRICES IN TROPICAL ALGEBRA 1 Introduction Hana Tomášková University of Hradec Králové, Faculty of Informatics and Management, Rokitanského 62, 50003 Hradec Králové, Czech Republic e-mail:

More information

Computational Complexity of Tensor Problems

Computational Complexity of Tensor Problems Computational Complexity of Tensor Problems Chris Hillar Redwood Center for Theoretical Neuroscience (UC Berkeley) Joint work with Lek-Heng Lim (with L-H Lim) Most tensor problems are NP-hard, Journal

More information

Applications to network analysis: Eigenvector centrality indices Lecture notes

Applications to network analysis: Eigenvector centrality indices Lecture notes Applications to network analysis: Eigenvector centrality indices Lecture notes Dario Fasino, University of Udine (Italy) Lecture notes for the second part of the course Nonnegative and spectral matrix

More information

Newcriteria for H-tensors and an application

Newcriteria for H-tensors and an application Wang and Sun Journal of Inequalities and Applications (016) 016:96 DOI 10.1186/s13660-016-1041-0 R E S E A R C H Open Access Newcriteria for H-tensors and an application Feng Wang * and De-shu Sun * Correspondence:

More information

CSC Linear Programming and Combinatorial Optimization Lecture 10: Semidefinite Programming

CSC Linear Programming and Combinatorial Optimization Lecture 10: Semidefinite Programming CSC2411 - Linear Programming and Combinatorial Optimization Lecture 10: Semidefinite Programming Notes taken by Mike Jamieson March 28, 2005 Summary: In this lecture, we introduce semidefinite programming

More information

Spectrum and Pseudospectrum of a Tensor

Spectrum and Pseudospectrum of a Tensor Spectrum and Pseudospectrum of a Tensor Lek-Heng Lim University of California, Berkeley July 11, 2008 L.-H. Lim (Berkeley) Spectrum and Pseudospectrum of a Tensor July 11, 2008 1 / 27 Matrix eigenvalues

More information

Conjugate Gradient (CG) Method

Conjugate Gradient (CG) Method Conjugate Gradient (CG) Method by K. Ozawa 1 Introduction In the series of this lecture, I will introduce the conjugate gradient method, which solves efficiently large scale sparse linear simultaneous

More information

2. Matrix Algebra and Random Vectors

2. Matrix Algebra and Random Vectors 2. Matrix Algebra and Random Vectors 2.1 Introduction Multivariate data can be conveniently display as array of numbers. In general, a rectangular array of numbers with, for instance, n rows and p columns

More information

Spectra of Adjacency and Laplacian Matrices

Spectra of Adjacency and Laplacian Matrices Spectra of Adjacency and Laplacian Matrices Definition: University of Alicante (Spain) Matrix Computing (subject 3168 Degree in Maths) 30 hours (theory)) + 15 hours (practical assignment) Contents 1. Spectra

More information

CS 246 Review of Linear Algebra 01/17/19

CS 246 Review of Linear Algebra 01/17/19 1 Linear algebra In this section we will discuss vectors and matrices. We denote the (i, j)th entry of a matrix A as A ij, and the ith entry of a vector as v i. 1.1 Vectors and vector operations A vector

More information

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2018 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing

More information

Perron-Frobenius theorem for nonnegative multilinear forms and extensions

Perron-Frobenius theorem for nonnegative multilinear forms and extensions Perron-Frobenius theorem for nonnegative multilinear forms and extensions Shmuel Friedland Univ. Illinois at Chicago ensors 18 December, 2010, Hong-Kong Overview 1 Perron-Frobenius theorem for irreducible

More information

Lecture 15 Perron-Frobenius Theory

Lecture 15 Perron-Frobenius Theory EE363 Winter 2005-06 Lecture 15 Perron-Frobenius Theory Positive and nonnegative matrices and vectors Perron-Frobenius theorems Markov chains Economic growth Population dynamics Max-min and min-max characterization

More information

Notes on Linear Algebra and Matrix Theory

Notes on Linear Algebra and Matrix Theory Massimo Franceschet featuring Enrico Bozzo Scalar product The scalar product (a.k.a. dot product or inner product) of two real vectors x = (x 1,..., x n ) and y = (y 1,..., y n ) is not a vector but a

More information

Tropical Optimization Framework for Analytical Hierarchy Process

Tropical Optimization Framework for Analytical Hierarchy Process Tropical Optimization Framework for Analytical Hierarchy Process Nikolai Krivulin 1 Sergeĭ Sergeev 2 1 Faculty of Mathematics and Mechanics Saint Petersburg State University, Russia 2 School of Mathematics

More information

Vladimir Kirichenko and Makar Plakhotnyk

Vladimir Kirichenko and Makar Plakhotnyk São Paulo Journal of Mathematical Sciences 4, 1 (2010), 109 120 Gorenstein Quivers Vladimir Kirichenko and Makar Plakhotnyk Faculty of Mechanics and Mathematics, Kyiv National Taras Shevchenko University,

More information

WEIGHTED LIMITS FOR POINCARÉ DIFFERENCE EQUATIONS. Rotchana Chieocan

WEIGHTED LIMITS FOR POINCARÉ DIFFERENCE EQUATIONS. Rotchana Chieocan WEIGHTED LIMITS FOR POINCARÉ DIFFERENCE EQUATIONS Rotchana Chieocan Department of Mathematics, Faculty of Science, Khon Kaen University, 40002 Khon Kaen, Thail rotchana@kku.ac.th Mihály Pituk* Department

More information

A Solution of a Tropical Linear Vector Equation

A Solution of a Tropical Linear Vector Equation A Solution of a Tropical Linear Vector Equation NIKOLAI KRIVULIN Faculty of Mathematics and Mechanics St. Petersburg State University 28 Universitetsky Ave., St. Petersburg, 198504 RUSSIA nkk@math.spbu.ru

More information

DETECTION OF FXM ARBITRAGE AND ITS SENSITIVITY

DETECTION OF FXM ARBITRAGE AND ITS SENSITIVITY DETECTION OF FXM ARBITRAGE AND ITS SENSITIVITY SFI FINANCIAL ALGEBRA PROJECT AT UCC: BH, AM & EO S 1. Definitions and basics In this working paper we have n currencies, labeled 1 through n inclusive and

More information

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing

More information

2.3. VECTOR SPACES 25

2.3. VECTOR SPACES 25 2.3. VECTOR SPACES 25 2.3 Vector Spaces MATH 294 FALL 982 PRELIM # 3a 2.3. Let C[, ] denote the space of continuous functions defined on the interval [,] (i.e. f(x) is a member of C[, ] if f(x) is continuous

More information

Math Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88

Math Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88 Math Camp 2010 Lecture 4: Linear Algebra Xiao Yu Wang MIT Aug 2010 Xiao Yu Wang (MIT) Math Camp 2010 08/10 1 / 88 Linear Algebra Game Plan Vector Spaces Linear Transformations and Matrices Determinant

More information

Calculating Web Page Authority Using the PageRank Algorithm

Calculating Web Page Authority Using the PageRank Algorithm Jacob Miles Prystowsky and Levi Gill Math 45, Fall 2005 1 Introduction 1.1 Abstract In this document, we examine how the Google Internet search engine uses the PageRank algorithm to assign quantitatively

More information

1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i )

1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i ) Direct Methods for Linear Systems Chapter Direct Methods for Solving Linear Systems Per-Olof Persson persson@berkeleyedu Department of Mathematics University of California, Berkeley Math 18A Numerical

More information

On the Adjacency Spectra of Hypertrees

On the Adjacency Spectra of Hypertrees On the Adjacency Spectra of Hypertrees arxiv:1711.01466v1 [math.sp] 4 Nov 2017 Gregory J. Clark and Joshua N. Cooper Department of Mathematics University of South Carolina November 7, 2017 Abstract We

More information

Math 2331 Linear Algebra

Math 2331 Linear Algebra 5. Eigenvectors & Eigenvalues Math 233 Linear Algebra 5. Eigenvectors & Eigenvalues Shang-Huan Chiu Department of Mathematics, University of Houston schiu@math.uh.edu math.uh.edu/ schiu/ Shang-Huan Chiu,

More information

The Nearest Doubly Stochastic Matrix to a Real Matrix with the same First Moment

The Nearest Doubly Stochastic Matrix to a Real Matrix with the same First Moment he Nearest Doubly Stochastic Matrix to a Real Matrix with the same First Moment William Glunt 1, homas L. Hayden 2 and Robert Reams 2 1 Department of Mathematics and Computer Science, Austin Peay State

More information

c c c c c c c c c c a 3x3 matrix C= has a determinant determined by

c c c c c c c c c c a 3x3 matrix C= has a determinant determined by Linear Algebra Determinants and Eigenvalues Introduction: Many important geometric and algebraic properties of square matrices are associated with a single real number revealed by what s known as the determinant.

More information

The following definition is fundamental.

The following definition is fundamental. 1. Some Basics from Linear Algebra With these notes, I will try and clarify certain topics that I only quickly mention in class. First and foremost, I will assume that you are familiar with many basic

More information

Learning from Sensor Data: Set II. Behnaam Aazhang J.S. Abercombie Professor Electrical and Computer Engineering Rice University

Learning from Sensor Data: Set II. Behnaam Aazhang J.S. Abercombie Professor Electrical and Computer Engineering Rice University Learning from Sensor Data: Set II Behnaam Aazhang J.S. Abercombie Professor Electrical and Computer Engineering Rice University 1 6. Data Representation The approach for learning from data Probabilistic

More information

Markov Chains and Spectral Clustering

Markov Chains and Spectral Clustering Markov Chains and Spectral Clustering Ning Liu 1,2 and William J. Stewart 1,3 1 Department of Computer Science North Carolina State University, Raleigh, NC 27695-8206, USA. 2 nliu@ncsu.edu, 3 billy@ncsu.edu

More information

Fiedler s Theorems on Nodal Domains

Fiedler s Theorems on Nodal Domains Spectral Graph Theory Lecture 7 Fiedler s Theorems on Nodal Domains Daniel A Spielman September 9, 202 7 About these notes These notes are not necessarily an accurate representation of what happened in

More information

Linear Algebra for Machine Learning. Sargur N. Srihari

Linear Algebra for Machine Learning. Sargur N. Srihari Linear Algebra for Machine Learning Sargur N. srihari@cedar.buffalo.edu 1 Overview Linear Algebra is based on continuous math rather than discrete math Computer scientists have little experience with it

More information

THE EIGENVALUE PROBLEM

THE EIGENVALUE PROBLEM THE EIGENVALUE PROBLEM Let A be an n n square matrix. If there is a number λ and a column vector v 0 for which Av = λv then we say λ is an eigenvalue of A and v is an associated eigenvector. Note that

More information

Lecture 15, 16: Diagonalization

Lecture 15, 16: Diagonalization Lecture 15, 16: Diagonalization Motivation: Eigenvalues and Eigenvectors are easy to compute for diagonal matrices. Hence, we would like (if possible) to convert matrix A into a diagonal matrix. Suppose

More information

Detailed Proof of The PerronFrobenius Theorem

Detailed Proof of The PerronFrobenius Theorem Detailed Proof of The PerronFrobenius Theorem Arseny M Shur Ural Federal University October 30, 2016 1 Introduction This famous theorem has numerous applications, but to apply it you should understand

More information

A NEW EFFECTIVE PRECONDITIONED METHOD FOR L-MATRICES

A NEW EFFECTIVE PRECONDITIONED METHOD FOR L-MATRICES Journal of Mathematical Sciences: Advances and Applications Volume, Number 2, 2008, Pages 3-322 A NEW EFFECTIVE PRECONDITIONED METHOD FOR L-MATRICES Department of Mathematics Taiyuan Normal University

More information

Review of Some Concepts from Linear Algebra: Part 2

Review of Some Concepts from Linear Algebra: Part 2 Review of Some Concepts from Linear Algebra: Part 2 Department of Mathematics Boise State University January 16, 2019 Math 566 Linear Algebra Review: Part 2 January 16, 2019 1 / 22 Vector spaces A set

More information

ON SUM OF SQUARES DECOMPOSITION FOR A BIQUADRATIC MATRIX FUNCTION

ON SUM OF SQUARES DECOMPOSITION FOR A BIQUADRATIC MATRIX FUNCTION Annales Univ. Sci. Budapest., Sect. Comp. 33 (2010) 273-284 ON SUM OF SQUARES DECOMPOSITION FOR A BIQUADRATIC MATRIX FUNCTION L. László (Budapest, Hungary) Dedicated to Professor Ferenc Schipp on his 70th

More information

MATH 240 Spring, Chapter 1: Linear Equations and Matrices

MATH 240 Spring, Chapter 1: Linear Equations and Matrices MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear

More information

Permutation transformations of tensors with an application

Permutation transformations of tensors with an application DOI 10.1186/s40064-016-3720-1 RESEARCH Open Access Permutation transformations of tensors with an application Yao Tang Li *, Zheng Bo Li, Qi Long Liu and Qiong Liu *Correspondence: liyaotang@ynu.edu.cn

More information

Eigenvalues of tensors

Eigenvalues of tensors Eigenvalues of tensors and some very basic spectral hypergraph theory Lek-Heng Lim Matrix Computations and Scientific Computing Seminar April 16, 2008 Lek-Heng Lim (MCSC Seminar) Eigenvalues of tensors

More information

Math Introduction to Numerical Analysis - Class Notes. Fernando Guevara Vasquez. Version Date: January 17, 2012.

Math Introduction to Numerical Analysis - Class Notes. Fernando Guevara Vasquez. Version Date: January 17, 2012. Math 5620 - Introduction to Numerical Analysis - Class Notes Fernando Guevara Vasquez Version 1990. Date: January 17, 2012. 3 Contents 1. Disclaimer 4 Chapter 1. Iterative methods for solving linear systems

More information

Nonnegative and spectral matrix theory Lecture notes

Nonnegative and spectral matrix theory Lecture notes Nonnegative and spectral matrix theory Lecture notes Dario Fasino, University of Udine (Italy) Lecture notes for the first part of the course Nonnegative and spectral matrix theory with applications to

More information

An Introduction to Spectral Graph Theory

An Introduction to Spectral Graph Theory An Introduction to Spectral Graph Theory Mackenzie Wheeler Supervisor: Dr. Gary MacGillivray University of Victoria WheelerM@uvic.ca Outline Outline 1. How many walks are there from vertices v i to v j

More information

Strictly nonnegative tensors and nonnegative tensor partition

Strictly nonnegative tensors and nonnegative tensor partition SCIENCE CHINA Mathematics. ARTICLES. January 2012 Vol. 55 No. 1: 1 XX doi: Strictly nonnegative tensors and nonnegative tensor partition Hu Shenglong 1, Huang Zheng-Hai 2,3, & Qi Liqun 4 1 Department of

More information

Lab 8: Measuring Graph Centrality - PageRank. Monday, November 5 CompSci 531, Fall 2018

Lab 8: Measuring Graph Centrality - PageRank. Monday, November 5 CompSci 531, Fall 2018 Lab 8: Measuring Graph Centrality - PageRank Monday, November 5 CompSci 531, Fall 2018 Outline Measuring Graph Centrality: Motivation Random Walks, Markov Chains, and Stationarity Distributions Google

More information

Iterative Methods for Solving A x = b

Iterative Methods for Solving A x = b Iterative Methods for Solving A x = b A good (free) online source for iterative methods for solving A x = b is given in the description of a set of iterative solvers called templates found at netlib: http

More information

REVIEW OF DIFFERENTIAL CALCULUS

REVIEW OF DIFFERENTIAL CALCULUS REVIEW OF DIFFERENTIAL CALCULUS DONU ARAPURA 1. Limits and continuity To simplify the statements, we will often stick to two variables, but everything holds with any number of variables. Let f(x, y) be

More information

COMPSCI 514: Algorithms for Data Science

COMPSCI 514: Algorithms for Data Science COMPSCI 514: Algorithms for Data Science Arya Mazumdar University of Massachusetts at Amherst Fall 2018 Lecture 8 Spectral Clustering Spectral clustering Curse of dimensionality Dimensionality Reduction

More information

Eigenvalue analysis of constrained minimization problem for homogeneous polynomial

Eigenvalue analysis of constrained minimization problem for homogeneous polynomial J Glob Optim 2016) 64:563 575 DOI 10.1007/s10898-015-0343-y Eigenvalue analysis of constrained minimization problem for homogeneous polynomial Yisheng Song 1,2 Liqun Qi 2 Received: 31 May 2014 / Accepted:

More information

Invertibility and stability. Irreducibly diagonally dominant. Invertibility and stability, stronger result. Reducible matrices

Invertibility and stability. Irreducibly diagonally dominant. Invertibility and stability, stronger result. Reducible matrices Geršgorin circles Lecture 8: Outline Chapter 6 + Appendix D: Location and perturbation of eigenvalues Some other results on perturbed eigenvalue problems Chapter 8: Nonnegative matrices Geršgorin s Thm:

More information

LINEAR ALGEBRA REVIEW

LINEAR ALGEBRA REVIEW LINEAR ALGEBRA REVIEW JC Stuff you should know for the exam. 1. Basics on vector spaces (1) F n is the set of all n-tuples (a 1,... a n ) with a i F. It forms a VS with the operations of + and scalar multiplication

More information

Review of Basic Concepts in Linear Algebra

Review of Basic Concepts in Linear Algebra Review of Basic Concepts in Linear Algebra Grady B Wright Department of Mathematics Boise State University September 7, 2017 Math 565 Linear Algebra Review September 7, 2017 1 / 40 Numerical Linear Algebra

More information

AN ELEMENTARY PROOF OF THE SPECTRAL RADIUS FORMULA FOR MATRICES

AN ELEMENTARY PROOF OF THE SPECTRAL RADIUS FORMULA FOR MATRICES AN ELEMENTARY PROOF OF THE SPECTRAL RADIUS FORMULA FOR MATRICES JOEL A. TROPP Abstract. We present an elementary proof that the spectral radius of a matrix A may be obtained using the formula ρ(a) lim

More information

Nonnegative Matrices I

Nonnegative Matrices I Nonnegative Matrices I Daisuke Oyama Topics in Economic Theory September 26, 2017 References J. L. Stuart, Digraphs and Matrices, in Handbook of Linear Algebra, Chapter 29, 2006. R. A. Brualdi and H. J.

More information

MATH 583A REVIEW SESSION #1

MATH 583A REVIEW SESSION #1 MATH 583A REVIEW SESSION #1 BOJAN DURICKOVIC 1. Vector Spaces Very quick review of the basic linear algebra concepts (see any linear algebra textbook): (finite dimensional) vector space (or linear space),

More information

arxiv: v1 [math.ra] 11 Aug 2014

arxiv: v1 [math.ra] 11 Aug 2014 Double B-tensors and quasi-double B-tensors Chaoqian Li, Yaotang Li arxiv:1408.2299v1 [math.ra] 11 Aug 2014 a School of Mathematics and Statistics, Yunnan University, Kunming, Yunnan, P. R. China 650091

More information

Networks and Matrices

Networks and Matrices Bowen-Lanford Zeta function, Math table talk Oliver Knill, 10/18/2016 Networks and Matrices Assume you have three friends who do not know each other. This defines a network containing 4 nodes in which

More information

Recitation 8: Graphs and Adjacency Matrices

Recitation 8: Graphs and Adjacency Matrices Math 1b TA: Padraic Bartlett Recitation 8: Graphs and Adjacency Matrices Week 8 Caltech 2011 1 Random Question Suppose you take a large triangle XY Z, and divide it up with straight line segments into

More information

First, we review some important facts on the location of eigenvalues of matrices.

First, we review some important facts on the location of eigenvalues of matrices. BLOCK NORMAL MATRICES AND GERSHGORIN-TYPE DISCS JAKUB KIERZKOWSKI AND ALICJA SMOKTUNOWICZ Abstract The block analogues of the theorems on inclusion regions for the eigenvalues of normal matrices are given

More information

A Potpourri of Nonlinear Algebra

A Potpourri of Nonlinear Algebra a a 2 a 3 + c c 2 c 3 =2, a a 3 b 2 + c c 3 d 2 =0, a 2 a 3 b + c 2 c 3 d =0, a 3 b b 2 + c 3 d d 2 = 4, a a 2 b 3 + c c 2 d 3 =0, a b 2 b 3 + c d 2 d 3 = 4, a 2 b b 3 + c 2 d 3 d =4, b b 2 b 3 + d d 2

More information

MATH 581D FINAL EXAM Autumn December 12, 2016

MATH 581D FINAL EXAM Autumn December 12, 2016 MATH 58D FINAL EXAM Autumn 206 December 2, 206 NAME: SIGNATURE: Instructions: there are 6 problems on the final. Aim for solving 4 problems, but do as much as you can. Partial credit will be given on all

More information

Spectral Graph Theory

Spectral Graph Theory Spectral Graph Theory Aaron Mishtal April 27, 2016 1 / 36 Outline Overview Linear Algebra Primer History Theory Applications Open Problems Homework Problems References 2 / 36 Outline Overview Linear Algebra

More information

Fiedler s Theorems on Nodal Domains

Fiedler s Theorems on Nodal Domains Spectral Graph Theory Lecture 7 Fiedler s Theorems on Nodal Domains Daniel A. Spielman September 19, 2018 7.1 Overview In today s lecture we will justify some of the behavior we observed when using eigenvectors

More information

Knowledge Discovery and Data Mining 1 (VO) ( )

Knowledge Discovery and Data Mining 1 (VO) ( ) Knowledge Discovery and Data Mining 1 (VO) (707.003) Review of Linear Algebra Denis Helic KTI, TU Graz Oct 9, 2014 Denis Helic (KTI, TU Graz) KDDM1 Oct 9, 2014 1 / 74 Big picture: KDDM Probability Theory

More information

Convex Optimization of Graph Laplacian Eigenvalues

Convex Optimization of Graph Laplacian Eigenvalues Convex Optimization of Graph Laplacian Eigenvalues Stephen Boyd Stanford University (Joint work with Persi Diaconis, Arpita Ghosh, Seung-Jean Kim, Sanjay Lall, Pablo Parrilo, Amin Saberi, Jun Sun, Lin

More information

The Google Markov Chain: convergence speed and eigenvalues

The Google Markov Chain: convergence speed and eigenvalues U.U.D.M. Project Report 2012:14 The Google Markov Chain: convergence speed and eigenvalues Fredrik Backåker Examensarbete i matematik, 15 hp Handledare och examinator: Jakob Björnberg Juni 2012 Department

More information

Introduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX

Introduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX Introduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX September 2007 MSc Sep Intro QT 1 Who are these course for? The September

More information

Remark By definition, an eigenvector must be a nonzero vector, but eigenvalue could be zero.

Remark By definition, an eigenvector must be a nonzero vector, but eigenvalue could be zero. Sec 6 Eigenvalues and Eigenvectors Definition An eigenvector of an n n matrix A is a nonzero vector x such that A x λ x for some scalar λ A scalar λ is called an eigenvalue of A if there is a nontrivial

More information

The Singular Value Decomposition

The Singular Value Decomposition The Singular Value Decomposition Philippe B. Laval KSU Fall 2015 Philippe B. Laval (KSU) SVD Fall 2015 1 / 13 Review of Key Concepts We review some key definitions and results about matrices that will

More information

MATH 5720: Unconstrained Optimization Hung Phan, UMass Lowell September 13, 2018

MATH 5720: Unconstrained Optimization Hung Phan, UMass Lowell September 13, 2018 MATH 57: Unconstrained Optimization Hung Phan, UMass Lowell September 13, 18 1 Global and Local Optima Let a function f : S R be defined on a set S R n Definition 1 (minimizers and maximizers) (i) x S

More information

Quick Tour of Linear Algebra and Graph Theory

Quick Tour of Linear Algebra and Graph Theory Quick Tour of Linear Algebra and Graph Theory CS224W: Social and Information Network Analysis Fall 2014 David Hallac Based on Peter Lofgren, Yu Wayne Wu, and Borja Pelato s previous versions Matrices and

More information

Delsarte s linear programming bound

Delsarte s linear programming bound 15-859 Coding Theory, Fall 14 December 5, 2014 Introduction For all n, q, and d, Delsarte s linear program establishes a series of linear constraints that every code in F n q with distance d must satisfy.

More information

Mathematical Optimisation, Chpt 2: Linear Equations and inequalities

Mathematical Optimisation, Chpt 2: Linear Equations and inequalities Mathematical Optimisation, Chpt 2: Linear Equations and inequalities Peter J.C. Dickinson p.j.c.dickinson@utwente.nl http://dickinson.website version: 12/02/18 Monday 5th February 2018 Peter J.C. Dickinson

More information

Chapter 2. Vectors and Vector Spaces

Chapter 2. Vectors and Vector Spaces 2.1. Operations on Vectors 1 Chapter 2. Vectors and Vector Spaces Section 2.1. Operations on Vectors Note. In this section, we define several arithmetic operations on vectors (especially, vector addition

More information

A TOUR OF LINEAR ALGEBRA FOR JDEP 384H

A TOUR OF LINEAR ALGEBRA FOR JDEP 384H A TOUR OF LINEAR ALGEBRA FOR JDEP 384H Contents Solving Systems 1 Matrix Arithmetic 3 The Basic Rules of Matrix Arithmetic 4 Norms and Dot Products 5 Norms 5 Dot Products 6 Linear Programming 7 Eigenvectors

More information

1 Overview. 2 Extreme Points. AM 221: Advanced Optimization Spring 2016

1 Overview. 2 Extreme Points. AM 221: Advanced Optimization Spring 2016 AM 22: Advanced Optimization Spring 206 Prof. Yaron Singer Lecture 7 February 7th Overview In the previous lectures we saw applications of duality to game theory and later to learning theory. In this lecture

More information

Math.3336: Discrete Mathematics. Chapter 9 Relations

Math.3336: Discrete Mathematics. Chapter 9 Relations Math.3336: Discrete Mathematics Chapter 9 Relations Instructor: Dr. Blerina Xhabli Department of Mathematics, University of Houston https://www.math.uh.edu/ blerina Email: blerina@math.uh.edu Fall 2018

More information

Modeling and Stability Analysis of a Communication Network System

Modeling and Stability Analysis of a Communication Network System Modeling and Stability Analysis of a Communication Network System Zvi Retchkiman Königsberg Instituto Politecnico Nacional e-mail: mzvi@cic.ipn.mx Abstract In this work, the modeling and stability problem

More information

1 T 1 = where 1 is the all-ones vector. For the upper bound, let v 1 be the eigenvector corresponding. u:(u,v) E v 1(u)

1 T 1 = where 1 is the all-ones vector. For the upper bound, let v 1 be the eigenvector corresponding. u:(u,v) E v 1(u) CME 305: Discrete Mathematics and Algorithms Instructor: Reza Zadeh (rezab@stanford.edu) Final Review Session 03/20/17 1. Let G = (V, E) be an unweighted, undirected graph. Let λ 1 be the maximum eigenvalue

More information

Jordan Journal of Mathematics and Statistics (JJMS) 5(3), 2012, pp A NEW ITERATIVE METHOD FOR SOLVING LINEAR SYSTEMS OF EQUATIONS

Jordan Journal of Mathematics and Statistics (JJMS) 5(3), 2012, pp A NEW ITERATIVE METHOD FOR SOLVING LINEAR SYSTEMS OF EQUATIONS Jordan Journal of Mathematics and Statistics JJMS) 53), 2012, pp.169-184 A NEW ITERATIVE METHOD FOR SOLVING LINEAR SYSTEMS OF EQUATIONS ADEL H. AL-RABTAH Abstract. The Jacobi and Gauss-Seidel iterative

More information

Spectral directed hypergraph theory via tensors

Spectral directed hypergraph theory via tensors Linear and Multilinear Algebra ISSN: 0308-1087 (Print) 1563-5139 (Online) Journal homepage: http://www.tandfonline.com/loi/glma20 Spectral directed hypergraph theory via tensors Jinshan Xie & Liqun Qi

More information

Quantum Computing Lecture 2. Review of Linear Algebra

Quantum Computing Lecture 2. Review of Linear Algebra Quantum Computing Lecture 2 Review of Linear Algebra Maris Ozols Linear algebra States of a quantum system form a vector space and their transformations are described by linear operators Vector spaces

More information