The Miracles of Tropical Spectral Theory
|
|
- Zoe Reeves
- 5 years ago
- Views:
Transcription
1 The Miracles of Tropical Spectral Theory Emmanuel Tsukerman University of California, Berkeley July 31, / 110
2 Motivation One of the most important results in max-algebra [is] that for every matrix the maximum cycle mean is the greatest eigenvalue [But10] 2 / 110
3 Motivation One of the most important results in max-algebra [is] that for every matrix the maximum cycle mean is the greatest eigenvalue [But10] - Tensor spectral theory is flourishing, so let us study its tropicalization 3 / 110
4 Motivation One of the most important results in max-algebra [is] that for every matrix the maximum cycle mean is the greatest eigenvalue [But10] - Tensor spectral theory is flourishing, so let us study its tropicalization Credit goes to Bernd Sturmfels for suggesting this avenue of research 4 / 110
5 Outline 1 Preliminaries Basic Tropical Geometry Tropical Spectral Theory of Matrices Classical Tensor Eigenpairs 2 Tropical Spectral Theory of Tensors 5 / 110
6 Outline 1 Preliminaries Basic Tropical Geometry Tropical Spectral Theory of Matrices Classical Tensor Eigenpairs 2 Tropical Spectral Theory of Tensors 6 / 110
7 Basic Tropical Geometry 7 / 110
8 Tropical Arithmetic Replace ordinary addition and multiplication with: x y = x y = minimum of x and y x + y 8 / 110
9 Tropical Arithmetic Replace ordinary addition and multiplication with: x y = x y = minimum of x and y x + y Example: 3 (4 5) = 3 4 = 7 9 / 110
10 Tropical Arithmetic Replace ordinary addition and multiplication with: x y = x y = minimum of x and y x + y Example: 3 (4 5) = 3 4 = 7 3 (4 5) = = 7 8 = 7 10 / 110
11 Tropical Arithmetic Replace ordinary addition and multiplication with: x y = x y = minimum of x and y x + y Example: 3 (4 5) = 3 4 = 7 3 (4 5) = = 7 8 = 7 Associative, distributive, commutative 11 / 110
12 Tropical Arithmetic There is also an additive identity 12 / 110
13 Tropical Arithmetic There is also an additive identity x = x for any x 13 / 110
14 Tropical Arithmetic Matrix times vector multiplication: 14 / 110
15 Tropical Arithmetic Matrix times vector multiplication: ( ) ( ) ( a11 a 12 x a11 x a = 12 y a 21 a 22 y... ) 15 / 110
16 Tropical Arithmetic Matrix times vector multiplication: ( ) ( ) ( a11 a 12 x a11 x a = 12 y a 21 a 22 y... ( ) min(a11 + x, a = 12 + y)... ) 16 / 110
17 Tropical Arithmetic Matrix times vector multiplication: ( ) ( ) ( a11 a 12 x a11 x a = 12 y a 21 a 22 y... Scalar times matrix multiplitication: ( ) min(a11 + x, a = 12 + y)... ) 17 / 110
18 Tropical Arithmetic Matrix times vector multiplication: ( ) ( ) ( a11 a 12 x a11 x a = 12 y a 21 a 22 y... ( ) min(a11 + x, a = 12 + y)... Scalar times matrix multiplitication: ( ) ( ) a11 a λ 12 λ a11 λ a = 12 a 21 a 22 λ a 21 λ a 22 ) 18 / 110
19 Tropical Arithmetic Matrix times vector multiplication: ( ) ( ) ( a11 a 12 x a11 x a = 12 y a 21 a 22 y... ( ) min(a11 + x, a = 12 + y)... Scalar times matrix multiplitication: ( ) ( ) a11 a λ 12 λ a11 λ a = 12 a 21 a 22 λ a 21 λ a 22 ( ) λ + a11 λ + a = 12 λ + a 21 λ + a 22 ) 19 / 110
20 Outline 1 Preliminaries Basic Tropical Geometry Tropical Spectral Theory of Matrices Classical Tensor Eigenpairs 2 Tropical Spectral Theory of Tensors 20 / 110
21 Tropical Spectral Theory of Matrices 21 / 110
22 Tropical Eigenpair An eigenvalue of an n n matrix A is a number λ such that A v = λ v 22 / 110
23 Tropical Eigenpair An eigenvalue of an n n matrix A is a number λ such that A v = λ v A vector v as above is called an eigenvector. 23 / 110
24 Tropical Eigenpair An eigenvalue of an n n matrix A is a number λ such that A v = λ v A vector v as above is called an eigenvector. Example: n = 2 ( ) min(a11 + x, a 12 + y) = min(a 21 + x, a 22 + y) ( λ + x λ + y ) 24 / 110
25 Directed Graph of a Square Matrix Associate to an n n matrix A = (a ij ) a weighted directed graph G(A) as follows. The nodes are 1, 2,..., n 25 / 110
26 Directed Graph of a Square Matrix Associate to an n n matrix A = (a ij ) a weighted directed graph G(A) as follows. The nodes are 1, 2,..., n There is an edge from i to j iff a ij <. 26 / 110
27 Directed Graph of a Square Matrix Associate to an n n matrix A = (a ij ) a weighted directed graph G(A) as follows. The nodes are 1, 2,..., n There is an edge from i to j iff a ij <. Edge (i, j) gets weight a ij 27 / 110
28 Directed Graph of a Square Matrix Associate to an n n matrix A = (a ij ) a weighted directed graph G(A) as follows. The nodes are 1, 2,..., n There is an edge from i to j iff a ij <. Edge (i, j) gets weight a ij A directed path i 0, i 1,..., i k gets a weight: a i0 i 1 + a i1 i a ik 1 i k. 28 / 110
29 Directed Graph of a Square Matrix Associate to an n n matrix A = (a ij ) a weighted directed graph G(A) as follows. The nodes are 1, 2,..., n There is an edge from i to j iff a ij <. Edge (i, j) gets weight a ij A directed path i 0, i 1,..., i k gets a weight: The normalized weight a i0 i 1 + a i1 i a ik 1 i k. a i0 i 1 + a i1 i a ik 1 i k k is called the normalized length of the path. 29 / 110
30 Directed Graph of a Square Matrix Associate to an n n matrix A = (a ij ) a weighted directed graph G(A) as follows. The nodes are 1, 2,..., n There is an edge from i to j iff a ij <. Edge (i, j) gets weight a ij A directed path i 0, i 1,..., i k gets a weight: The normalized weight a i0 i 1 + a i1 i a ik 1 i k. a i0 i 1 + a i1 i a ik 1 i k k is called the normalized length of the path. Directed cycles are paths for which i 0 = i k. 30 / 110
31 Tropical Eigenvalue and the Directed Graph Theorem [CG62, Cuninghame-Green] If the graph G(A) is strongly connected, then A has precisely one eigenvalue. This eigenvalue is equal to the minimal normalized length of any directed cycle of G(A). 31 / 110
32 Tropical Eigenvalue and the Directed Graph Theorem [CG62, Cuninghame-Green] If the graph G(A) is strongly connected, then A has precisely one eigenvalue. This eigenvalue is equal to the minimal normalized length of any directed cycle of G(A). It appears then that in order to find λ(a) we must inspect all cycles of G(A) 32 / 110
33 Tropical Eigenvalue and the Directed Graph Theorem [CG62, Cuninghame-Green] If the graph G(A) is strongly connected, then A has precisely one eigenvalue. This eigenvalue is equal to the minimal normalized length of any directed cycle of G(A). It appears then that in order to find λ(a) we must inspect all cycles of G(A) However, there is an efficient algorithm based on linear programming given by Karp [Kar78]: 33 / 110
34 Tropical Eigenvalue via LP λ(a) = [ maximize λ subject to a ij + x j λ + x i, i, j [n] ] 34 / 110
35 Tropical Eigenvalue via LP λ(a) = [ maximize λ subject to a ij + x j λ + x i, i, j [n] This is surprising because the constraints are obvious necessary conditions and no equalities are enforced ] 35 / 110
36 Tropical Eigenvalue via LP λ(a) = [ maximize λ subject to a ij + x j λ + x i, i, j [n] This is surprising because the constraints are obvious necessary conditions and no equalities are enforced Example: n = 2 min(a 11 + x 1, a 12 + x 2 ) = λ + x 1 min(a 21 + x 1, a 22 + x 2 ) = λ + x 2 ] 36 / 110
37 Classical and Tropical Eigenvalues 37 / 110
38 Classical and Tropical Eigenvalues Let X be a positive matrix over a field with valuation. 38 / 110
39 Classical and Tropical Eigenvalues Let X be a positive matrix over a field with valuation. Let X (k) be its kth Hadamard power. 39 / 110
40 Classical and Tropical Eigenvalues Let X be a positive matrix over a field with valuation. Let X (k) be its kth Hadamard power.let ρ denote the Perron-Frobenius eigenvalue and λ the tropical eigenvalue. 40 / 110
41 Classical and Tropical Eigenvalues Let X be a positive matrix over a field with valuation. Let X (k) be its kth Hadamard power.let ρ denote the Perron-Frobenius eigenvalue and λ the tropical eigenvalue. lim ρ(x (k) ) 1 k = λ(x ). k 41 / 110
42 Outline 1 Preliminaries Basic Tropical Geometry Tropical Spectral Theory of Matrices Classical Tensor Eigenpairs 2 Tropical Spectral Theory of Tensors 42 / 110
43 Classical Tensor Eigenpairs 43 / 110
44 Tensor times a vector Take A = (a i1 i 2 i m ) to be an } n. {{.. n } tensor. Let x be an n-vector. m times 44 / 110
45 Tensor times a vector Take A = (a i1 i 2 i m ) to be an n... n }{{} We define the product Ax m 1 := m times tensor. Let x be an n-vector. n i 2,...,i m=1 a 1i 2 i m x i2 x im n i 2,...,i m=1 a 2i 2 i m x i2 x im. n i 2,...,i m=1 a ni 2 i m x i2 x im. 45 / 110
46 Tensor eigenpairs There are several variants of eigenpairs: 46 / 110
47 Tensor eigenpairs There are several variants of eigenpairs: x m 1 1 Ax m 1 = λx [m 1] x m 1 = λ 2. xn m 1 (H-eigenpair) 47 / 110
48 Tensor eigenpairs There are several variants of eigenpairs: x m 1 1 Ax m 1 = λx [m 1] x m 1 = λ 2. xn m 1 Ax m 1 = λx (H-eigenpair) (E-eigenpair) 48 / 110
49 Tensor eigenpairs There are several variants of eigenpairs: x m 1 1 Ax m 1 = λx [m 1] x m 1 = λ 2. xn m 1 and others which I will not discuss. Ax m 1 = λx (H-eigenpair) (E-eigenpair) 49 / 110
50 Outline 1 Preliminaries Basic Tropical Geometry Tropical Spectral Theory of Matrices Classical Tensor Eigenpairs 2 Tropical Spectral Theory of Tensors 50 / 110
51 Tropical Spectral Theory of Tensors 51 / 110
52 Tropical Eigenpairs The tropicalization of Ax m 1 := n i 2,...,i m=1 a 1i 2 i m x i2 x im n i 2,...,i m=1 a 2i 2 i m x i2 x im. n i 2,...,i m=1 a ni 2 i m x i2 x im should be n i 2,...,i m=1 a 1i 2 i m x i2 x im n i 2,...,i m=1 a 2i 2 i m x i2 x im. n i 2,...,i m=1 a ni 2 i m x i2 x im 52 / 110
53 Tropical Eigenpairs Similarly, replace the classical operations on the right-hand side of the eigenpair equation by the tropical ones: 53 / 110
54 Tropical Eigenpairs Similarly, replace the classical operations on the right-hand side of the eigenpair equation by the tropical ones: x m 1 x (m 1) 1 λx [m 1] x m 1 1 = λ 2. λ x (m 1) 2 (H-eigenpair). xn m 1 xn (m 1) 54 / 110
55 Tropical Eigenpairs Similarly, replace the classical operations on the right-hand side of the eigenpair equation by the tropical ones: x m 1 x (m 1) 1 λx [m 1] x m 1 1 = λ 2. λ x (m 1) 2 (H-eigenpair). xn m 1 xn (m 1) and λx λ x (E-eigenpair) 55 / 110
56 Definition A tropical H-eigenpair for a tensor (a i1 i m ) R nm (x, λ) R n /R(1, 1,..., 1) R such that is a pair n i 2,...,i m=1 a ii2 i m x i2 x im = λ x m 1 i, i = 1, 2,..., n. We call x a tropical H-eigenvector and λ a tropical H-eigenvalue. Basically, Ax m 1 = λx [m 1] in tropical arithmetic. 56 / 110
57 Definition A tropical H-eigenpair for a tensor (a i1 i m ) R nm (x, λ) R n /R(1, 1,..., 1) R such that is a pair n i 2,...,i m=1 a ii2 i m x i2 x im = λ x m 1 i, i = 1, 2,..., n. We call x a tropical H-eigenvector and λ a tropical H-eigenvalue. Basically, Ax m 1 = λx [m 1] in tropical arithmetic. Similarly, a tropical E-eigenpair satisfies n i 2,...,i m=1 a ii2 i m x i2 x im = λ x i, i = 1, 2,..., n. 57 / 110
58 Definition A tropical H-eigenpair for a tensor (a i1 i m ) R nm (x, λ) R n /R(1, 1,..., 1) R such that is a pair n i 2,...,i m=1 a ii2 i m x i2 x im = λ x m 1 i, i = 1, 2,..., n. We call x a tropical H-eigenvector and λ a tropical H-eigenvalue. Basically, Ax m 1 = λx [m 1] in tropical arithmetic. Similarly, a tropical E-eigenpair satisfies n i 2,...,i m=1 a ii2 i m x i2 x im = λ x i, i = 1, 2,..., n. From now on, I may use E-eigenpairs and H-eigenpairs to shorten for tropical E-eigenpairs and H-eigenpairs when there is no danger of confusion 58 / 110
59 Example Take n = 2 and m = 3. Then a tropical H-eigenpair (x, λ) satisfies min{a x 1, a x 1 + x 2, a x 2 + x 1, a x 2 } = λ + 2x 1 min{a x 1, a x 1 + x 2, a x 2 + x 1, a x 2 } = λ + 2x / 110
60 Example Take n = 2 and m = 3. Then a tropical H-eigenpair (x, λ) satisfies min{a x 1, a x 1 + x 2, a x 2 + x 1, a x 2 } = λ + 2x 1 min{a x 1, a x 1 + x 2, a x 2 + x 1, a x 2 } = λ + 2x 2. Notice that the tensor can be assumed to be symmetric in its last m 1 coordinates 60 / 110
61 Example Take n = 2 and m = 3. Then a tropical H-eigenpair (x, λ) satisfies min{a x 1, a x 1 + x 2, a x 2 + x 1, a x 2 } = λ + 2x 1 min{a x 1, a x 1 + x 2, a x 2 + x 1, a x 2 } = λ + 2x 2. Notice that the tensor can be assumed to be symmetric in its last m 1 coordinates Example Take n = 3 and m = 3. Then a tropical H-eigenpair (x, λ) satisfies min{a x 1,a 112 +x 1 +x 2,a 113 +x 1 +x 3,a x 2,a 123 +x 2 +x 3,a x 3 }=λ+2x 1 min{a x 1,a 212 +x 1 +x 2,a 213 +x 1 +x 3,a x 2,a 223 +x 2 +x 3,a x 3 }=λ+2x 2 min{a x 1,a 312 +x 1 +x 2,a 313 +x 1 +x 3,a x 2,a 323 +x 2 +x 3,a x 3 }=λ+2x / 110
62 Example Take n = 2 and m = 3. Then a tropical H-eigenpair (x, λ) satisfies min{a x 1, a x 1 + x 2, a x 2 + x 1, a x 2 } = λ + 2x 1 min{a x 1, a x 1 + x 2, a x 2 + x 1, a x 2 } = λ + 2x 2. Notice that the tensor can be assumed to be symmetric in its last m 1 coordinates Example Take n = 3 and m = 3. Then a tropical H-eigenpair (x, λ) satisfies min{a x 1,a 112 +x 1 +x 2,a 113 +x 1 +x 3,a x 2,a 123 +x 2 +x 3,a x 3 }=λ+2x 1 min{a x 1,a 212 +x 1 +x 2,a 213 +x 1 +x 3,a x 2,a 223 +x 2 +x 3,a x 3 }=λ+2x 2 min{a x 1,a 312 +x 1 +x 2,a 313 +x 1 +x 3,a x 2,a 323 +x 2 +x 3,a x 3 }=λ+2x 3. For E-eigenpairs, we would replace 2x 1, 2x 2, 2x 3 on the right with x 1, x 2, x / 110
63 Tropical E-Eigenpairs Initially, I focused on E-eigenpairs. Professor Sturmfels and I ran some experiments: 63 / 110
64 Tropical E-Eigenpairs Initially, I focused on E-eigenpairs. Professor Sturmfels and I ran some experiments: For randomly generated symmetric 3x3x3-tensors, we obtained the following distribution of tensors by number of tropical E-eigenpairs (from 0 eigenpairs to 7): 64 / 110
65 Tropical E-Eigenpairs Initially, I focused on E-eigenpairs. Professor Sturmfels and I ran some experiments: For randomly generated symmetric 3x3x3-tensors, we obtained the following distribution of tensors by number of tropical E-eigenpairs (from 0 eigenpairs to 7): [0, 80.1, 0.14, 19, 0, 0.12, 0.02, 0.58]% 65 / 110
66 Tropical E-Eigenpairs Initially, I focused on E-eigenpairs. Professor Sturmfels and I ran some experiments: For randomly generated symmetric 3x3x3-tensors, we obtained the following distribution of tensors by number of tropical E-eigenpairs (from 0 eigenpairs to 7): [0, 80.1, 0.14, 19, 0, 0.12, 0.02, 0.58]% Conclusion: different (generic) tensors have a different number of E-eigenpairs and it is not obvious what the pattern of possible numbers of E-eigenpairs is. 66 / 110
67 Tropical E-Eigenpairs Initially, I focused on E-eigenpairs. Professor Sturmfels and I ran some experiments: For randomly generated symmetric 3x3x3-tensors, we obtained the following distribution of tensors by number of tropical E-eigenpairs (from 0 eigenpairs to 7): [0, 80.1, 0.14, 19, 0, 0.12, 0.02, 0.58]% Conclusion: different (generic) tensors have a different number of E-eigenpairs and it is not obvious what the pattern of possible numbers of E-eigenpairs is. In contrast, we have the following result for H-eigenpairs 67 / 110
68 Tropical H-Eigenpairs Theorem A tensor A R nm has a unique tropical H-eigenvalue λ(a) R. 68 / 110
69 Tropical H-Eigenpairs Theorem A tensor A R nm has a unique tropical H-eigenvalue λ(a) R. Proof idea: 69 / 110
70 Tropical H-Eigenpairs Theorem A tensor A R nm has a unique tropical H-eigenvalue λ(a) R. Proof idea: Existence: tropical analogue of proof of Perron-Frobenius Theorem. 70 / 110
71 Tropical H-Eigenpairs Theorem A tensor A R nm has a unique tropical H-eigenvalue λ(a) R. Proof idea: Existence: tropical analogue of proof of Perron-Frobenius Theorem. Proof of existence works for E-eigenpairs as well 71 / 110
72 Tropical H-Eigenpairs Theorem A tensor A R nm has a unique tropical H-eigenvalue λ(a) R. Proof idea: Existence: tropical analogue of proof of Perron-Frobenius Theorem. Proof of existence works for E-eigenpairs as well Uniqueness: Gordan s Theorem (a theorem of the alternative) 72 / 110
73 Tropical H-Eigenpairs The H-eigenvalue is also a solution to an LP 73 / 110
74 Tropical H-Eigenpairs The H-eigenvalue is also a solution to an LP This LP simply requires λ to be a subeigenvalue: 74 / 110
75 Tropical H-Eigenpairs The H-eigenvalue is also a solution to an LP This LP simply requires λ to be a subeigenvalue: Theorem λ(a) = [ maximize λ subject to a i1 i 2 i m + x i x im λ + (m 1)x i1 ] 75 / 110
76 Tropical H-Eigenpairs The H-eigenvalue is also a solution to an LP This LP simply requires λ to be a subeigenvalue: Theorem λ(a) = [ maximize λ subject to a i1 i 2 i m + x i x im λ + (m 1)x i1 Dually, the H-eigenvalue of A is given by minimize (i 1,i 2,...,i m) [n] a m i1 i 2 i m y i1 i 2 i m subject to (i 1,i 2,...,i m) [n] y m i1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] y m i1 i 2 i m = 1 y i1 i 2 i m 0. ] 76 / 110
77 Interpreting the Dual We associate to a tensor A a weighted directed hypergraph H(A). The nodes are [n] = {1, 2,..., n} 77 / 110
78 Interpreting the Dual We associate to a tensor A a weighted directed hypergraph H(A). The nodes are [n] = {1, 2,..., n} The hyperedges are pairs (i 1, {i 2,..., i m }) 78 / 110
79 Interpreting the Dual We associate to a tensor A a weighted directed hypergraph H(A). The nodes are [n] = {1, 2,..., n} The hyperedges are pairs (i 1, {i 2,..., i m }) (we think of i 1 as having multiplicity (m 1)) 79 / 110
80 Interpreting the Dual We associate to a tensor A a weighted directed hypergraph H(A). The nodes are [n] = {1, 2,..., n} The hyperedges are pairs (i 1, {i 2,..., i m }) (we think of i 1 as having multiplicity (m 1)) 80 / 110
81 Interpreting the Dual We associate to a tensor A a weighted directed hypergraph H(A). The nodes are [n] = {1, 2,..., n} The hyperedges are pairs (i 1, {i 2,..., i m }) (we think of i 1 as having multiplicity (m 1)) Each hyperedge (i 1, {i 2,..., i m }) receives a weight a i1 i 2 i m. 81 / 110
82 The dual problem is minimize (i 1,i 2,...,i m) [n] m a i 1 i 2 i m y i1 i 2 i m subject to (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m / 110
83 The dual problem is minimize (i 1,i 2,...,i m) [n] m a i 1 i 2 i m y i1 i 2 i m subject to (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m 0. We think of y i1 i 2 i m as the amout of flow through edge (i 1, {i 2,..., i m }) 83 / 110
84 The dual problem is minimize (i 1,i 2,...,i m) [n] m a i 1 i 2 i m y i1 i 2 i m subject to (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m 0. We think of y i1 i 2 i m as the amout of flow through edge (i 1, {i 2,..., i m }) The term y i1 i 2 i m ((m 1)e i1 e i2... e im ) accounts for the amount of flow entering each of i 2,..., i m and leaving i 1 84 / 110
85 The dual problem is minimize (i 1,i 2,...,i m) [n] m a i 1 i 2 i m y i1 i 2 i m subject to (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m 0. We think of y i1 i 2 i m as the amout of flow through edge (i 1, {i 2,..., i m }) The term y i1 i 2 i m ((m 1)e i1 e i2... e im ) accounts for the amount of flow entering each of i 2,..., i m and leaving i 1 Condition 1 then states that we have a circulation (conservation of flow) 85 / 110
86 The dual problem is minimize (i 1,i 2,...,i m) [n] m a i 1 i 2 i m y i1 i 2 i m subject to (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m 0. We think of y i1 i 2 i m as the amout of flow through edge (i 1, {i 2,..., i m }) The term y i1 i 2 i m ((m 1)e i1 e i2... e im ) accounts for the amount of flow entering each of i 2,..., i m and leaving i 1 Condition 1 then states that we have a circulation (conservation of flow) The a s (tensor entries) give a weight to each edge 86 / 110
87 The dual problem is minimize (i 1,i 2,...,i m) [n] m a i 1 i 2 i m y i1 i 2 i m subject to (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m 0. We think of y i1 i 2 i m as the amout of flow through edge (i 1, {i 2,..., i m }) The term y i1 i 2 i m ((m 1)e i1 e i2... e im ) accounts for the amount of flow entering each of i 2,..., i m and leaving i 1 Condition 1 then states that we have a circulation (conservation of flow) The a s (tensor entries) give a weight to each edge Interpretation: we seek to find a nontrivial circulation with least A-weight 87 / 110
88 Interpreting the Dual Definition The circulation polytope H n,m is the polytope defined by the inequalities (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m / 110
89 Interpreting the Dual Definition The circulation polytope H n,m is the polytope defined by the inequalities (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m 0. The H-cycles are the vertices of H n,m. 89 / 110
90 Interpreting the Dual Definition The circulation polytope H n,m is the polytope defined by the inequalities (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m 0. The H-cycles are the vertices of H n,m. The H-eigenvalue is the minimum A-weighted H-cycle 90 / 110
91 Interpreting the Dual Definition The circulation polytope H n,m is the polytope defined by the inequalities (i 1,i 2,...,i m) [n] m y i 1 i 2 i m ((m 1)e i1 e i2... e im ) = 0 (i 1,i 2,...,i m) [n] m y i 1 i 2 i m = 1 y i1 i 2 i m 0. The H-cycles are the vertices of H n,m. The H-eigenvalue is the minimum A-weighted H-cycle For matrices, the circulation polytope is called the normalized cycle polytope 91 / 110
92 H-cycles The H-cycles become more complicated for tensors compared with matrices 92 / 110
93 H-cycles The H-cycles become more complicated for tensors compared with matrices In particular, the vertices of the circulation polytope are no longer normalized characteristic functions of subsets of the edges 93 / 110
94 H-cycles The H-cycles become more complicated for tensors compared with matrices In particular, the vertices of the circulation polytope are no longer normalized characteristic functions of subsets of the edges Example The tensor whose entries are all zero except for a 132 = a 213 = a 322 = 1 is extremized on the vertex y 132 = 2 9, y 213 = 4 9, y 322 = 3 9, y ijk = 0 for remaining indices The edges here are 2 (1, {2, 3}), 4 (2, {1, 3}), 3 (3, {2, 2}) 94 / 110
95 Summary 95 / 110
96 Summary There exists a unique tropical H-eigenvalue 96 / 110
97 Summary There exists a unique tropical H-eigenvalue not at all the case for tropical E-eigenvalues 97 / 110
98 Summary There exists a unique tropical H-eigenvalue not at all the case for tropical E-eigenvalues it is equal to the minimum A-weighted H-cycle 98 / 110
99 Summary There exists a unique tropical H-eigenvalue not at all the case for tropical E-eigenvalues it is equal to the minimum A-weighted H-cycle can be found efficiently (LP) 99 / 110
100 Summary There exists a unique tropical H-eigenvalue not at all the case for tropical E-eigenvalues it is equal to the minimum A-weighted H-cycle can be found efficiently (LP) To a tensor there is an associated directed weighted hypergraph 100 / 110
101 Summary There exists a unique tropical H-eigenvalue not at all the case for tropical E-eigenvalues it is equal to the minimum A-weighted H-cycle can be found efficiently (LP) To a tensor there is an associated directed weighted hypergraph We have seen the circulation polytope, which is the polytope formed from the H-cycles 101 / 110
102 Summary There exists a unique tropical H-eigenvalue not at all the case for tropical E-eigenvalues it is equal to the minimum A-weighted H-cycle can be found efficiently (LP) To a tensor there is an associated directed weighted hypergraph We have seen the circulation polytope, which is the polytope formed from the H-cycles its vertices are complicated for tensors 102 / 110
103 Summary There exists a unique tropical H-eigenvalue not at all the case for tropical E-eigenvalues it is equal to the minimum A-weighted H-cycle can be found efficiently (LP) To a tensor there is an associated directed weighted hypergraph We have seen the circulation polytope, which is the polytope formed from the H-cycles its vertices are complicated for tensors tensors correspond to linear functionals on this polytope, and extrema correspond to tropical H-eigenvalues 103 / 110
104 Future Directions 104 / 110
105 Future Directions Describe the tropical H-eigenvectors of a tensor 105 / 110
106 Future Directions Describe the tropical H-eigenvectors of a tensor Relate classical and tropical tensor spectral theories 106 / 110
107 Thank you Questions? 107 / 110
108 Existence and Uniqueness Theorem Let A R nm and assume that for each i = 1, 2,..., n, the sets S i := {{i (i) 2,..., i (i) m } : a ii (i) 2 i (i) m } are nonempty and mutually equal. Then A has a unique tropical H-eigenvalue λ(a) R. 108 / 110
109 Properties of H-cycle Polytope Theorem Let y R nm be a vertex of the H-cycle polytope H n,m. Then y has at most one nonzero entry of the form y ji2 i m for each j = 1, 2,..., n. There exist vertices with n nonzero entries. 109 / 110
110 Peter Butkovič. Max-linear systems: theory and algorithms. Springer Monographs in Mathematics. Springer-Verlag London, Ltd., London, R. A. Cuninghame-Green. Describing industrial processes with interference and approximating their steady-state behaviour. OR, 13(1):pp , Richard M. Karp. A characterization of the minimum cycle mean in a digraph. Discrete Math., 23(3): , / 110
Combinatorial Types of Tropical Eigenvector
Combinatorial Types of Tropical Eigenvector arxiv:1105.55504 Ngoc Mai Tran Department of Statistics, UC Berkeley Joint work with Bernd Sturmfels 2 / 13 Tropical eigenvalues and eigenvectors Max-plus: (R,,
More informationEigenvalues of the Adjacency Tensor on Products of Hypergraphs
Int. J. Contemp. Math. Sciences, Vol. 8, 201, no. 4, 151-158 HIKARI Ltd, www.m-hikari.com Eigenvalues of the Adjacency Tensor on Products of Hypergraphs Kelly J. Pearson Department of Mathematics and Statistics
More informationMa/CS 6b Class 20: Spectral Graph Theory
Ma/CS 6b Class 20: Spectral Graph Theory By Adam Sheffer Eigenvalues and Eigenvectors A an n n matrix of real numbers. The eigenvalues of A are the numbers λ such that Ax = λx for some nonzero vector x
More informationMa/CS 6b Class 20: Spectral Graph Theory
Ma/CS 6b Class 20: Spectral Graph Theory By Adam Sheffer Recall: Parity of a Permutation S n the set of permutations of 1,2,, n. A permutation σ S n is even if it can be written as a composition of an
More informationSection 1.7: Properties of the Leslie Matrix
Section 1.7: Properties of the Leslie Matrix Definition: A matrix A whose entries are nonnegative (positive) is called a nonnegative (positive) matrix, denoted as A 0 (A > 0). Definition: A square m m
More informationSpectral Properties of Matrix Polynomials in the Max Algebra
Spectral Properties of Matrix Polynomials in the Max Algebra Buket Benek Gursoy 1,1, Oliver Mason a,1, a Hamilton Institute, National University of Ireland, Maynooth Maynooth, Co Kildare, Ireland Abstract
More informationZ-Pencils. November 20, Abstract
Z-Pencils J. J. McDonald D. D. Olesky H. Schneider M. J. Tsatsomeros P. van den Driessche November 20, 2006 Abstract The matrix pencil (A, B) = {tb A t C} is considered under the assumptions that A is
More informationCombinatorial types of tropical eigenvectors
Bull. London Math. Soc. 45 (2013) 27 36 C 2012 London Mathematical Society doi:10.1112/blms/bds058 Combinatorial types of tropical eigenvectors Bernd Sturmfels and Ngoc Mai Tran Abstract The map which
More informationA Tropical Extremal Problem with Nonlinear Objective Function and Linear Inequality Constraints
A Tropical Extremal Problem with Nonlinear Objective Function and Linear Inequality Constraints NIKOLAI KRIVULIN Faculty of Mathematics and Mechanics St. Petersburg State University 28 Universitetsky Ave.,
More informationTropical Algebra. Notes by Bernd Sturmfels for the lecture on May 22, 2018, in the IMPRS Ringvorlesung Introduction to Nonlinear Algebra
Tropical Algebra Notes by Bernd Sturmfels for the lecture on May 22, 2018, in the IMPRS Ringvorlesung Introduction to Nonlinear Algebra The tropical semiring (R { },, ) consists of the real numbers R,
More informationTHE PERTURBATION BOUND FOR THE SPECTRAL RADIUS OF A NON-NEGATIVE TENSOR
THE PERTURBATION BOUND FOR THE SPECTRAL RADIUS OF A NON-NEGATIVE TENSOR WEN LI AND MICHAEL K. NG Abstract. In this paper, we study the perturbation bound for the spectral radius of an m th - order n-dimensional
More informationProperties of Linear Transformations from R n to R m
Properties of Linear Transformations from R n to R m MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Topic Overview Relationship between the properties of a matrix transformation
More informationarxiv: v2 [math.oc] 28 Nov 2015
Rating Alternatives from Pairwise Comparisons by Solving Tropical Optimization Problems arxiv:1504.00800v2 [math.oc] 28 Nov 2015 N. Krivulin Abstract We consider problems of rating alternatives based on
More informationPerron Frobenius Theory
Perron Frobenius Theory Oskar Perron Georg Frobenius (1880 1975) (1849 1917) Stefan Güttel Perron Frobenius Theory 1 / 10 Positive and Nonnegative Matrices Let A, B R m n. A B if a ij b ij i, j, A > B
More informationLinear Algebra Practice Problems
Math 7, Professor Ramras Linear Algebra Practice Problems () Consider the following system of linear equations in the variables x, y, and z, in which the constants a and b are real numbers. x y + z = a
More informationMATH36001 Perron Frobenius Theory 2015
MATH361 Perron Frobenius Theory 215 In addition to saying something useful, the Perron Frobenius theory is elegant. It is a testament to the fact that beautiful mathematics eventually tends to be useful,
More informationPREFERENCE MATRICES IN TROPICAL ALGEBRA
PREFERENCE MATRICES IN TROPICAL ALGEBRA 1 Introduction Hana Tomášková University of Hradec Králové, Faculty of Informatics and Management, Rokitanského 62, 50003 Hradec Králové, Czech Republic e-mail:
More informationComputational Complexity of Tensor Problems
Computational Complexity of Tensor Problems Chris Hillar Redwood Center for Theoretical Neuroscience (UC Berkeley) Joint work with Lek-Heng Lim (with L-H Lim) Most tensor problems are NP-hard, Journal
More informationApplications to network analysis: Eigenvector centrality indices Lecture notes
Applications to network analysis: Eigenvector centrality indices Lecture notes Dario Fasino, University of Udine (Italy) Lecture notes for the second part of the course Nonnegative and spectral matrix
More informationNewcriteria for H-tensors and an application
Wang and Sun Journal of Inequalities and Applications (016) 016:96 DOI 10.1186/s13660-016-1041-0 R E S E A R C H Open Access Newcriteria for H-tensors and an application Feng Wang * and De-shu Sun * Correspondence:
More informationCSC Linear Programming and Combinatorial Optimization Lecture 10: Semidefinite Programming
CSC2411 - Linear Programming and Combinatorial Optimization Lecture 10: Semidefinite Programming Notes taken by Mike Jamieson March 28, 2005 Summary: In this lecture, we introduce semidefinite programming
More informationSpectrum and Pseudospectrum of a Tensor
Spectrum and Pseudospectrum of a Tensor Lek-Heng Lim University of California, Berkeley July 11, 2008 L.-H. Lim (Berkeley) Spectrum and Pseudospectrum of a Tensor July 11, 2008 1 / 27 Matrix eigenvalues
More informationConjugate Gradient (CG) Method
Conjugate Gradient (CG) Method by K. Ozawa 1 Introduction In the series of this lecture, I will introduce the conjugate gradient method, which solves efficiently large scale sparse linear simultaneous
More information2. Matrix Algebra and Random Vectors
2. Matrix Algebra and Random Vectors 2.1 Introduction Multivariate data can be conveniently display as array of numbers. In general, a rectangular array of numbers with, for instance, n rows and p columns
More informationSpectra of Adjacency and Laplacian Matrices
Spectra of Adjacency and Laplacian Matrices Definition: University of Alicante (Spain) Matrix Computing (subject 3168 Degree in Maths) 30 hours (theory)) + 15 hours (practical assignment) Contents 1. Spectra
More informationCS 246 Review of Linear Algebra 01/17/19
1 Linear algebra In this section we will discuss vectors and matrices. We denote the (i, j)th entry of a matrix A as A ij, and the ith entry of a vector as v i. 1.1 Vectors and vector operations A vector
More informationLinear Algebra review Powers of a diagonalizable matrix Spectral decomposition
Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2018 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing
More informationPerron-Frobenius theorem for nonnegative multilinear forms and extensions
Perron-Frobenius theorem for nonnegative multilinear forms and extensions Shmuel Friedland Univ. Illinois at Chicago ensors 18 December, 2010, Hong-Kong Overview 1 Perron-Frobenius theorem for irreducible
More informationLecture 15 Perron-Frobenius Theory
EE363 Winter 2005-06 Lecture 15 Perron-Frobenius Theory Positive and nonnegative matrices and vectors Perron-Frobenius theorems Markov chains Economic growth Population dynamics Max-min and min-max characterization
More informationNotes on Linear Algebra and Matrix Theory
Massimo Franceschet featuring Enrico Bozzo Scalar product The scalar product (a.k.a. dot product or inner product) of two real vectors x = (x 1,..., x n ) and y = (y 1,..., y n ) is not a vector but a
More informationTropical Optimization Framework for Analytical Hierarchy Process
Tropical Optimization Framework for Analytical Hierarchy Process Nikolai Krivulin 1 Sergeĭ Sergeev 2 1 Faculty of Mathematics and Mechanics Saint Petersburg State University, Russia 2 School of Mathematics
More informationVladimir Kirichenko and Makar Plakhotnyk
São Paulo Journal of Mathematical Sciences 4, 1 (2010), 109 120 Gorenstein Quivers Vladimir Kirichenko and Makar Plakhotnyk Faculty of Mechanics and Mathematics, Kyiv National Taras Shevchenko University,
More informationWEIGHTED LIMITS FOR POINCARÉ DIFFERENCE EQUATIONS. Rotchana Chieocan
WEIGHTED LIMITS FOR POINCARÉ DIFFERENCE EQUATIONS Rotchana Chieocan Department of Mathematics, Faculty of Science, Khon Kaen University, 40002 Khon Kaen, Thail rotchana@kku.ac.th Mihály Pituk* Department
More informationA Solution of a Tropical Linear Vector Equation
A Solution of a Tropical Linear Vector Equation NIKOLAI KRIVULIN Faculty of Mathematics and Mechanics St. Petersburg State University 28 Universitetsky Ave., St. Petersburg, 198504 RUSSIA nkk@math.spbu.ru
More informationDETECTION OF FXM ARBITRAGE AND ITS SENSITIVITY
DETECTION OF FXM ARBITRAGE AND ITS SENSITIVITY SFI FINANCIAL ALGEBRA PROJECT AT UCC: BH, AM & EO S 1. Definitions and basics In this working paper we have n currencies, labeled 1 through n inclusive and
More informationLinear Algebra review Powers of a diagonalizable matrix Spectral decomposition
Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing
More information2.3. VECTOR SPACES 25
2.3. VECTOR SPACES 25 2.3 Vector Spaces MATH 294 FALL 982 PRELIM # 3a 2.3. Let C[, ] denote the space of continuous functions defined on the interval [,] (i.e. f(x) is a member of C[, ] if f(x) is continuous
More informationMath Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88
Math Camp 2010 Lecture 4: Linear Algebra Xiao Yu Wang MIT Aug 2010 Xiao Yu Wang (MIT) Math Camp 2010 08/10 1 / 88 Linear Algebra Game Plan Vector Spaces Linear Transformations and Matrices Determinant
More informationCalculating Web Page Authority Using the PageRank Algorithm
Jacob Miles Prystowsky and Levi Gill Math 45, Fall 2005 1 Introduction 1.1 Abstract In this document, we examine how the Google Internet search engine uses the PageRank algorithm to assign quantitatively
More information1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i )
Direct Methods for Linear Systems Chapter Direct Methods for Solving Linear Systems Per-Olof Persson persson@berkeleyedu Department of Mathematics University of California, Berkeley Math 18A Numerical
More informationOn the Adjacency Spectra of Hypertrees
On the Adjacency Spectra of Hypertrees arxiv:1711.01466v1 [math.sp] 4 Nov 2017 Gregory J. Clark and Joshua N. Cooper Department of Mathematics University of South Carolina November 7, 2017 Abstract We
More informationMath 2331 Linear Algebra
5. Eigenvectors & Eigenvalues Math 233 Linear Algebra 5. Eigenvectors & Eigenvalues Shang-Huan Chiu Department of Mathematics, University of Houston schiu@math.uh.edu math.uh.edu/ schiu/ Shang-Huan Chiu,
More informationThe Nearest Doubly Stochastic Matrix to a Real Matrix with the same First Moment
he Nearest Doubly Stochastic Matrix to a Real Matrix with the same First Moment William Glunt 1, homas L. Hayden 2 and Robert Reams 2 1 Department of Mathematics and Computer Science, Austin Peay State
More informationc c c c c c c c c c a 3x3 matrix C= has a determinant determined by
Linear Algebra Determinants and Eigenvalues Introduction: Many important geometric and algebraic properties of square matrices are associated with a single real number revealed by what s known as the determinant.
More informationThe following definition is fundamental.
1. Some Basics from Linear Algebra With these notes, I will try and clarify certain topics that I only quickly mention in class. First and foremost, I will assume that you are familiar with many basic
More informationLearning from Sensor Data: Set II. Behnaam Aazhang J.S. Abercombie Professor Electrical and Computer Engineering Rice University
Learning from Sensor Data: Set II Behnaam Aazhang J.S. Abercombie Professor Electrical and Computer Engineering Rice University 1 6. Data Representation The approach for learning from data Probabilistic
More informationMarkov Chains and Spectral Clustering
Markov Chains and Spectral Clustering Ning Liu 1,2 and William J. Stewart 1,3 1 Department of Computer Science North Carolina State University, Raleigh, NC 27695-8206, USA. 2 nliu@ncsu.edu, 3 billy@ncsu.edu
More informationFiedler s Theorems on Nodal Domains
Spectral Graph Theory Lecture 7 Fiedler s Theorems on Nodal Domains Daniel A Spielman September 9, 202 7 About these notes These notes are not necessarily an accurate representation of what happened in
More informationLinear Algebra for Machine Learning. Sargur N. Srihari
Linear Algebra for Machine Learning Sargur N. srihari@cedar.buffalo.edu 1 Overview Linear Algebra is based on continuous math rather than discrete math Computer scientists have little experience with it
More informationTHE EIGENVALUE PROBLEM
THE EIGENVALUE PROBLEM Let A be an n n square matrix. If there is a number λ and a column vector v 0 for which Av = λv then we say λ is an eigenvalue of A and v is an associated eigenvector. Note that
More informationLecture 15, 16: Diagonalization
Lecture 15, 16: Diagonalization Motivation: Eigenvalues and Eigenvectors are easy to compute for diagonal matrices. Hence, we would like (if possible) to convert matrix A into a diagonal matrix. Suppose
More informationDetailed Proof of The PerronFrobenius Theorem
Detailed Proof of The PerronFrobenius Theorem Arseny M Shur Ural Federal University October 30, 2016 1 Introduction This famous theorem has numerous applications, but to apply it you should understand
More informationA NEW EFFECTIVE PRECONDITIONED METHOD FOR L-MATRICES
Journal of Mathematical Sciences: Advances and Applications Volume, Number 2, 2008, Pages 3-322 A NEW EFFECTIVE PRECONDITIONED METHOD FOR L-MATRICES Department of Mathematics Taiyuan Normal University
More informationReview of Some Concepts from Linear Algebra: Part 2
Review of Some Concepts from Linear Algebra: Part 2 Department of Mathematics Boise State University January 16, 2019 Math 566 Linear Algebra Review: Part 2 January 16, 2019 1 / 22 Vector spaces A set
More informationON SUM OF SQUARES DECOMPOSITION FOR A BIQUADRATIC MATRIX FUNCTION
Annales Univ. Sci. Budapest., Sect. Comp. 33 (2010) 273-284 ON SUM OF SQUARES DECOMPOSITION FOR A BIQUADRATIC MATRIX FUNCTION L. László (Budapest, Hungary) Dedicated to Professor Ferenc Schipp on his 70th
More informationMATH 240 Spring, Chapter 1: Linear Equations and Matrices
MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear
More informationPermutation transformations of tensors with an application
DOI 10.1186/s40064-016-3720-1 RESEARCH Open Access Permutation transformations of tensors with an application Yao Tang Li *, Zheng Bo Li, Qi Long Liu and Qiong Liu *Correspondence: liyaotang@ynu.edu.cn
More informationEigenvalues of tensors
Eigenvalues of tensors and some very basic spectral hypergraph theory Lek-Heng Lim Matrix Computations and Scientific Computing Seminar April 16, 2008 Lek-Heng Lim (MCSC Seminar) Eigenvalues of tensors
More informationMath Introduction to Numerical Analysis - Class Notes. Fernando Guevara Vasquez. Version Date: January 17, 2012.
Math 5620 - Introduction to Numerical Analysis - Class Notes Fernando Guevara Vasquez Version 1990. Date: January 17, 2012. 3 Contents 1. Disclaimer 4 Chapter 1. Iterative methods for solving linear systems
More informationNonnegative and spectral matrix theory Lecture notes
Nonnegative and spectral matrix theory Lecture notes Dario Fasino, University of Udine (Italy) Lecture notes for the first part of the course Nonnegative and spectral matrix theory with applications to
More informationAn Introduction to Spectral Graph Theory
An Introduction to Spectral Graph Theory Mackenzie Wheeler Supervisor: Dr. Gary MacGillivray University of Victoria WheelerM@uvic.ca Outline Outline 1. How many walks are there from vertices v i to v j
More informationStrictly nonnegative tensors and nonnegative tensor partition
SCIENCE CHINA Mathematics. ARTICLES. January 2012 Vol. 55 No. 1: 1 XX doi: Strictly nonnegative tensors and nonnegative tensor partition Hu Shenglong 1, Huang Zheng-Hai 2,3, & Qi Liqun 4 1 Department of
More informationLab 8: Measuring Graph Centrality - PageRank. Monday, November 5 CompSci 531, Fall 2018
Lab 8: Measuring Graph Centrality - PageRank Monday, November 5 CompSci 531, Fall 2018 Outline Measuring Graph Centrality: Motivation Random Walks, Markov Chains, and Stationarity Distributions Google
More informationIterative Methods for Solving A x = b
Iterative Methods for Solving A x = b A good (free) online source for iterative methods for solving A x = b is given in the description of a set of iterative solvers called templates found at netlib: http
More informationREVIEW OF DIFFERENTIAL CALCULUS
REVIEW OF DIFFERENTIAL CALCULUS DONU ARAPURA 1. Limits and continuity To simplify the statements, we will often stick to two variables, but everything holds with any number of variables. Let f(x, y) be
More informationCOMPSCI 514: Algorithms for Data Science
COMPSCI 514: Algorithms for Data Science Arya Mazumdar University of Massachusetts at Amherst Fall 2018 Lecture 8 Spectral Clustering Spectral clustering Curse of dimensionality Dimensionality Reduction
More informationEigenvalue analysis of constrained minimization problem for homogeneous polynomial
J Glob Optim 2016) 64:563 575 DOI 10.1007/s10898-015-0343-y Eigenvalue analysis of constrained minimization problem for homogeneous polynomial Yisheng Song 1,2 Liqun Qi 2 Received: 31 May 2014 / Accepted:
More informationInvertibility and stability. Irreducibly diagonally dominant. Invertibility and stability, stronger result. Reducible matrices
Geršgorin circles Lecture 8: Outline Chapter 6 + Appendix D: Location and perturbation of eigenvalues Some other results on perturbed eigenvalue problems Chapter 8: Nonnegative matrices Geršgorin s Thm:
More informationLINEAR ALGEBRA REVIEW
LINEAR ALGEBRA REVIEW JC Stuff you should know for the exam. 1. Basics on vector spaces (1) F n is the set of all n-tuples (a 1,... a n ) with a i F. It forms a VS with the operations of + and scalar multiplication
More informationReview of Basic Concepts in Linear Algebra
Review of Basic Concepts in Linear Algebra Grady B Wright Department of Mathematics Boise State University September 7, 2017 Math 565 Linear Algebra Review September 7, 2017 1 / 40 Numerical Linear Algebra
More informationAN ELEMENTARY PROOF OF THE SPECTRAL RADIUS FORMULA FOR MATRICES
AN ELEMENTARY PROOF OF THE SPECTRAL RADIUS FORMULA FOR MATRICES JOEL A. TROPP Abstract. We present an elementary proof that the spectral radius of a matrix A may be obtained using the formula ρ(a) lim
More informationNonnegative Matrices I
Nonnegative Matrices I Daisuke Oyama Topics in Economic Theory September 26, 2017 References J. L. Stuart, Digraphs and Matrices, in Handbook of Linear Algebra, Chapter 29, 2006. R. A. Brualdi and H. J.
More informationMATH 583A REVIEW SESSION #1
MATH 583A REVIEW SESSION #1 BOJAN DURICKOVIC 1. Vector Spaces Very quick review of the basic linear algebra concepts (see any linear algebra textbook): (finite dimensional) vector space (or linear space),
More informationarxiv: v1 [math.ra] 11 Aug 2014
Double B-tensors and quasi-double B-tensors Chaoqian Li, Yaotang Li arxiv:1408.2299v1 [math.ra] 11 Aug 2014 a School of Mathematics and Statistics, Yunnan University, Kunming, Yunnan, P. R. China 650091
More informationNetworks and Matrices
Bowen-Lanford Zeta function, Math table talk Oliver Knill, 10/18/2016 Networks and Matrices Assume you have three friends who do not know each other. This defines a network containing 4 nodes in which
More informationRecitation 8: Graphs and Adjacency Matrices
Math 1b TA: Padraic Bartlett Recitation 8: Graphs and Adjacency Matrices Week 8 Caltech 2011 1 Random Question Suppose you take a large triangle XY Z, and divide it up with straight line segments into
More informationFirst, we review some important facts on the location of eigenvalues of matrices.
BLOCK NORMAL MATRICES AND GERSHGORIN-TYPE DISCS JAKUB KIERZKOWSKI AND ALICJA SMOKTUNOWICZ Abstract The block analogues of the theorems on inclusion regions for the eigenvalues of normal matrices are given
More informationA Potpourri of Nonlinear Algebra
a a 2 a 3 + c c 2 c 3 =2, a a 3 b 2 + c c 3 d 2 =0, a 2 a 3 b + c 2 c 3 d =0, a 3 b b 2 + c 3 d d 2 = 4, a a 2 b 3 + c c 2 d 3 =0, a b 2 b 3 + c d 2 d 3 = 4, a 2 b b 3 + c 2 d 3 d =4, b b 2 b 3 + d d 2
More informationMATH 581D FINAL EXAM Autumn December 12, 2016
MATH 58D FINAL EXAM Autumn 206 December 2, 206 NAME: SIGNATURE: Instructions: there are 6 problems on the final. Aim for solving 4 problems, but do as much as you can. Partial credit will be given on all
More informationSpectral Graph Theory
Spectral Graph Theory Aaron Mishtal April 27, 2016 1 / 36 Outline Overview Linear Algebra Primer History Theory Applications Open Problems Homework Problems References 2 / 36 Outline Overview Linear Algebra
More informationFiedler s Theorems on Nodal Domains
Spectral Graph Theory Lecture 7 Fiedler s Theorems on Nodal Domains Daniel A. Spielman September 19, 2018 7.1 Overview In today s lecture we will justify some of the behavior we observed when using eigenvectors
More informationKnowledge Discovery and Data Mining 1 (VO) ( )
Knowledge Discovery and Data Mining 1 (VO) (707.003) Review of Linear Algebra Denis Helic KTI, TU Graz Oct 9, 2014 Denis Helic (KTI, TU Graz) KDDM1 Oct 9, 2014 1 / 74 Big picture: KDDM Probability Theory
More informationConvex Optimization of Graph Laplacian Eigenvalues
Convex Optimization of Graph Laplacian Eigenvalues Stephen Boyd Stanford University (Joint work with Persi Diaconis, Arpita Ghosh, Seung-Jean Kim, Sanjay Lall, Pablo Parrilo, Amin Saberi, Jun Sun, Lin
More informationThe Google Markov Chain: convergence speed and eigenvalues
U.U.D.M. Project Report 2012:14 The Google Markov Chain: convergence speed and eigenvalues Fredrik Backåker Examensarbete i matematik, 15 hp Handledare och examinator: Jakob Björnberg Juni 2012 Department
More informationIntroduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX
Introduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX September 2007 MSc Sep Intro QT 1 Who are these course for? The September
More informationRemark By definition, an eigenvector must be a nonzero vector, but eigenvalue could be zero.
Sec 6 Eigenvalues and Eigenvectors Definition An eigenvector of an n n matrix A is a nonzero vector x such that A x λ x for some scalar λ A scalar λ is called an eigenvalue of A if there is a nontrivial
More informationThe Singular Value Decomposition
The Singular Value Decomposition Philippe B. Laval KSU Fall 2015 Philippe B. Laval (KSU) SVD Fall 2015 1 / 13 Review of Key Concepts We review some key definitions and results about matrices that will
More informationMATH 5720: Unconstrained Optimization Hung Phan, UMass Lowell September 13, 2018
MATH 57: Unconstrained Optimization Hung Phan, UMass Lowell September 13, 18 1 Global and Local Optima Let a function f : S R be defined on a set S R n Definition 1 (minimizers and maximizers) (i) x S
More informationQuick Tour of Linear Algebra and Graph Theory
Quick Tour of Linear Algebra and Graph Theory CS224W: Social and Information Network Analysis Fall 2014 David Hallac Based on Peter Lofgren, Yu Wayne Wu, and Borja Pelato s previous versions Matrices and
More informationDelsarte s linear programming bound
15-859 Coding Theory, Fall 14 December 5, 2014 Introduction For all n, q, and d, Delsarte s linear program establishes a series of linear constraints that every code in F n q with distance d must satisfy.
More informationMathematical Optimisation, Chpt 2: Linear Equations and inequalities
Mathematical Optimisation, Chpt 2: Linear Equations and inequalities Peter J.C. Dickinson p.j.c.dickinson@utwente.nl http://dickinson.website version: 12/02/18 Monday 5th February 2018 Peter J.C. Dickinson
More informationChapter 2. Vectors and Vector Spaces
2.1. Operations on Vectors 1 Chapter 2. Vectors and Vector Spaces Section 2.1. Operations on Vectors Note. In this section, we define several arithmetic operations on vectors (especially, vector addition
More informationA TOUR OF LINEAR ALGEBRA FOR JDEP 384H
A TOUR OF LINEAR ALGEBRA FOR JDEP 384H Contents Solving Systems 1 Matrix Arithmetic 3 The Basic Rules of Matrix Arithmetic 4 Norms and Dot Products 5 Norms 5 Dot Products 6 Linear Programming 7 Eigenvectors
More information1 Overview. 2 Extreme Points. AM 221: Advanced Optimization Spring 2016
AM 22: Advanced Optimization Spring 206 Prof. Yaron Singer Lecture 7 February 7th Overview In the previous lectures we saw applications of duality to game theory and later to learning theory. In this lecture
More informationMath.3336: Discrete Mathematics. Chapter 9 Relations
Math.3336: Discrete Mathematics Chapter 9 Relations Instructor: Dr. Blerina Xhabli Department of Mathematics, University of Houston https://www.math.uh.edu/ blerina Email: blerina@math.uh.edu Fall 2018
More informationModeling and Stability Analysis of a Communication Network System
Modeling and Stability Analysis of a Communication Network System Zvi Retchkiman Königsberg Instituto Politecnico Nacional e-mail: mzvi@cic.ipn.mx Abstract In this work, the modeling and stability problem
More information1 T 1 = where 1 is the all-ones vector. For the upper bound, let v 1 be the eigenvector corresponding. u:(u,v) E v 1(u)
CME 305: Discrete Mathematics and Algorithms Instructor: Reza Zadeh (rezab@stanford.edu) Final Review Session 03/20/17 1. Let G = (V, E) be an unweighted, undirected graph. Let λ 1 be the maximum eigenvalue
More informationJordan Journal of Mathematics and Statistics (JJMS) 5(3), 2012, pp A NEW ITERATIVE METHOD FOR SOLVING LINEAR SYSTEMS OF EQUATIONS
Jordan Journal of Mathematics and Statistics JJMS) 53), 2012, pp.169-184 A NEW ITERATIVE METHOD FOR SOLVING LINEAR SYSTEMS OF EQUATIONS ADEL H. AL-RABTAH Abstract. The Jacobi and Gauss-Seidel iterative
More informationSpectral directed hypergraph theory via tensors
Linear and Multilinear Algebra ISSN: 0308-1087 (Print) 1563-5139 (Online) Journal homepage: http://www.tandfonline.com/loi/glma20 Spectral directed hypergraph theory via tensors Jinshan Xie & Liqun Qi
More informationQuantum Computing Lecture 2. Review of Linear Algebra
Quantum Computing Lecture 2 Review of Linear Algebra Maris Ozols Linear algebra States of a quantum system form a vector space and their transformations are described by linear operators Vector spaces
More information