arxiv: v1 [math.sp] 3 Nov 2011

Transcription

1 ON SOME PROPERTIES OF NONNEGATIVE WEAKLY IRREDUCIBLE TENSORS YUNING YANG AND QINGZHI YANG arxv: v1 [math.sp] 3 Nov 2011 Abstract. In ths paper, we manly focus on how to generalze some conclusons from nonnegatve rreducble tensors to nonnegatve weakly rreducble tensors. To do so, a basc lemma as Lemma 3.1 of [23] s proven usng new tools. Frst, we defne the stochastc tensor. Then we show that every nonnegatve weakly rreducble tensor wth spectral radus be 1 s dagonally smlar to a unque weakly rreducble stochastc tensor. Based on t, we prove some mportant lemmas, whch help us to generalze the results. Key words. nonnegatve rreducble tensor, nonnegatve weakly rreducble tensor, Perron- Frobnus Theorem, sngular value, stochastc tensor, convex programmng. AMS subject classfcatons. 74B99, 15A18, 15A69 1. Introducton. Egenvalue problems of hgher order tensors have become an mportant topc of study n a new appled mathematcs branch, numercal multlnear algebra, and they have a wde range of practcal applcatons, such as best-rank one approxmaton n data analyss [7, 9], hgher order Markov chans [12] and postve defnteness of even-order multvarate forms n automatcal control [14]. In ths paper, we manly focus on how to generalze some conclusons from nonnegatve rreducble tensors to nonnegatve weakly rreducble tensors. To do ths, we defne the stochastc tensor and show that every nonnegatve weakly rreducble tensor wth spectral radus be 1 s dagonally smlar to a unque weakly rreducble stochastc tensor. Based on the stochastc tensor, we prove some mportant lemmas, whch help us to generalze the results. Next, we pont out that the spectral radus of a nonnegatve weakly rreducble tensor wth postve trace s the unque egenvalue on the spectral crcle. From ths concluson, we show that a tensor beng prmtve s only a suffcent condton for that the spectral radus s the unque egenvalue on the spectral crcle, where the spectral crcle denotes the crcle wth center 0 and radus ρ(a). Ths paper s organzed as follows. In Secton 2 we recall the defntons and theorems concernng the egenvalue of the tensor. The stochastc tensor and the man results are dscussed n Secton 3. We frst add a comment on the notaton that s used n the sequel. Vectors are wrttenaslowercaseletters(x,y,...), matrcescorrespondtotalc captals(a,b,...), and tensors are wrtten as callgraphc captals (A,B, ). The entry wth row ndex andcolumnndexj namatrxa,.e. (A) j ssymbolzedbya j (also(a) 1 p,j 1 j q = a 1 p,j 1 j q ). The symbol used on a matrx A (or tensor A) means that ( A ) j = a j (or ( A ) 1 p,j 1 j q = a 1 p,j 1 j q ). R n +(R n ++) denotes the cone {x R n x (>)0, = 1,...,n}. The symbol A (>,,<)B means that a j (>,,<)b j for every,j and t s the same for rectangular tensors. R and C represents the real and Ths work was supported by the Natonal Natural Scence Foundaton of Chna (Grant No ) and Scentfc Research Foundaton for the Returned Overseas Chnese Scholars, State Educaton Mnstry. School of Mathematcs Scence and LPMC, Nanka Unversty, Tanjn , P.R. Chna, (nk @gmal.com). Correspondng author. School of Mathematcs Scence and LPMC, Nanka Unversty, Tanjn , P.R. Chna, (qz-yang@nanka.edu.cn). 1

2 2 Yunng Yang AND Qngzh Yang complex feld, respectvely. 2. Prelmnares and some conclusons concernng the egenvalue. Frst we recall the defnton of tensor: a tensor s a multdmensonal array, and a real order m dmenson n tensor A conssts of n m real entres: a 1 m R, where j = 1,...,nforj = 1,...,m. Lkethe squarematrx, thsclassoftensorcanbe regardedas square tensors. If there are a complex number λ and a nonzero complex vector x that are solutons of the followng homogeneous polynomal equatons: Ax = λx [], then λ s called the egenvalue of A and x the egenvector of A assocated wth λ, where Ax and x [] are vectors, whose th component are (Ax ) = n (x [] ) = x, a,2 m x 2 x m respectvely. Ths defnton was ntroduced by Q [8] where he supposed that A s an order m dmenson n symmetrc tensor and m s even. If λ and x are restrcted n the real feld, then (λ, x) s called H-egenpares. Independently, Lm [11] gave such a defnton but restrcted x to be a real vector and λ to be a real number. Here we follow the defnton due to Chang et al, where they gave the general defnton as above [2]. Defnton 2.1. The spectral radus of tensor A s defned as ρ(a) = max{ λ : λ s an egenvalue of A}. Defnton 2.2. (Reducblty, see Defnton 2.1 of [2]) A tensor C = (c 1 c m ) of order m dmenson n s called reducble, f there exsts a nonempty proper ndex subset I {1,...,n} such that c 1 m = 0, 1 I, 2,..., m I. If C s not reducble, then we call C rreducble. Chang et al generalzed the Perron-Frobenus Theorem from nonnegatve rreducble matrces to nonnegatve rreducble tensors [2]. The Perron-Frobenus Theorem for the tensor s related to measurng hgher order connectvty n lnked objects [10] and hypergraphs [13]. Yang and Yang gave further results for ths theorem [23]. Based on ther results, the Perron-Frobenus Theorem for nonnegatve rreducble tensors can be stated as follows: Theorem 2.3. If A s a nonnegatve rreducble tensor of order m dmenson n and ρ(a) s the spectral radus, then the followng hold: (1) ρ(a) > 0. (2) There s a postve egenvector x R++ n correspondng to ρ(a).

3 Further results for Perron-Frobenus Theorem for nonnegatve tensors II 3 (3) If λ s an egenvalue wth nonnegatve egenvector, then λ = ρ(a). Moreover, the nonnegatve egenvector s unque up to a multplcatve constant. (4) If λ s an egenvalue of A, then λ ρ(a). Next we ntroduce the nonnegatve weakly rreducble tensor defned by Fredland, Gaubert and Han [18]. Ths type of tensor s assocated wth the graph. Let A be an order m dmenson n nonnegatve tensor. The graph assocated to A, G(A), s the drected graph wth vertces 1,...,n and an edge from to j f and only f a 2 m > 0 for some l = j,l = 2,...,m. Defnton 2.4. ([18]) An order m dmenson n tensor A s called weakly rreducble f G(A) s strongly connected. We can gve an equvalent defnton of the weakly rreducble tensor from another pont of vew Defnton 2.5. An order m dmenson n tensor A s called weakly reducble, f there exsts a nonempty proper ndex subset I {1,...,n} such that a 1 m = 0, 1 I, j I, j = 2,...,m. If A s not weakly reducble, then we call A weakly rreducble. The Perron-Frobenus Theorem has been partly generalzed to the nonnegatve weakly rreducble tensors. Theorem 2.6. (Theorem 4.1 of [18]) Let A be an order m dmenson n tensor nonnegatve weakly rreducble tensor. Then there exsts a unque postve egenvector correspondng to the spectral radus. We gve an example to show that Theorem 2.3 (3) does not hold for nonnegatve weakly rreducble tensors Example Consder order 3 dmenson 2 weakly rreducble tensor A = (a jk ) where a 111 = a 121 = a 212 = 1 Its egenvalue problem s a jk = 0 elsewhere x 2 1 +x 1 x 2 = λx 2 1 x 1 x 2 = λx 2 2 It s not hard to see that λ = 1 s an egenvalue wth a nonnegatve egenvector (1,0). Usng the polynomal system solver NSolve avalable n Mathematca [20], we get that ρ(a) = , wth the unque postve egenvector ( , ). Ths shows that for the nonnegatve weakly rreducble tensor, an egenvalue wth a nonnegatve egenvector may not be the spectral radus.

4 4 Yunng Yang AND Qngzh Yang The followng result was proposed by Yang and Yang [23] Theorem 2.7. Let A and B be order m dmenson n tensors. If there s a dagonal nonsngular matrx D such that A = B D () D D, then they have the same egenvalues. Remark. For the product between tensor and matrx, one can see Defnton 2.1 of [7]. Here, C = A D () D D means where D s a dagonal matrx. c 1 2 m = a 1 m D () 1, 1 D 2, 2 D m, m, In the next secton, we wll ntroduce the stochastc tensor. Usng the stochastc tensor, we can generalze many conclusons from the rreducble tensor to the weakly rreducble tensor. 3. The stochastc tensor and ts applcatons. In ths secton, we ntroduce the stochastc tensor, whch s a generalzaton of the stochastc matrx. Frst we show some relatonshp between the stochastc tensor and the nonnegatve weakly rreducble tensor. Usng the relatonshp, we gve an alternatve proof of the Mnmax Theorem. We show that the Mnmax Theorem also holds for any nonnegatve tensor wth postve egenvectors. Next we generalze Lemma 3.1 [23] to the nonnegatve weakly rreducble tensor. Usng ths lemma, many conclusons proved n [23] can be generalzed to the nonnegatve weakly rreducble tensor. Defnton 3.1. A nonnegatve tensor A of order m dmenson n s called stochastc provded n a 2 m 1, = 1,...,n Obvously, when A s stochastc, 1 s the spectral radus of A and e s an egenvector correspondngto 1, where e s an all-ones vector; f further A s weakly rreducble, then e s the unque postve egenvector correspondng to 1. Theorem 3.2. Let A be an order m dmenson n nonnegatve weakly rreducble tensor. Then there exsts a dagonal matrx U wth postve man dagonal entres such that (3.1) ρ(a) B = A U (1 m) U U, where λ = ρ(a) and B s a stochastc weakly rreducble tensor. Furthermore, B s unque, and the dagonal entres of U are exactly the components of the unque postve egenvector correspondng to ρ(a). Proof. By assumpton and Theorem 2.6, we may let u be the unque postve egenvector correspondng to ρ(a),.e. Au = ρ(a)u [].

5 Further results for Perron-Frobenus Theorem for nonnegatve tensors II 5 Let U be the dagonal matrx such that ts dagonal entres are components of u,.e. U = u, = 1,...,n. Now let us check the tensor C = A U (1 m) U U. It s clear that for = 1,...,n n C 2 m = (Ce ) = (A U (1 m) U U e ) = (Au ) /u = ρ(a). Hence B := C/ρ(A) s the desred stochastc tensor. Note that snce the man dagonal entres of U are postve, the entres of B keep the postvty as A, whch shows the weakly rreducblty of B. Suppose B s another stochastc tensor such that λb s dagonally smlar to A va dagonal matrx U wth postve man dagonal entres, where λ s a real number. Then we can deduce that u := Ue R n s also a postve egenvector correspondng to some egenvalue of A,.e. t holds that Au = λu []. By Lemma 5.5 of [23], u must correspond to ρ(a). Snce the postve egenvector s unque, we have λ = ρ(a), u = u (up to a multplcatve constant), and hence B = B. The theorem above shows the exstence of a unque dagonally smlar stochastc tensor for a nonnegatve weakly rreducble tensor. Actually, for a nonnegatve tensor A, wthout the need of weakly rreducblty, f there exsts a postve egenvector u correspondng to ρ(a), then usng the same analyss as above, we can deduce that there also exsts a dagonal matrx U wth postve man dagonal entres such that (3.1) holds for A. However, snce the postve egenvector may not be unque for a nonnegatve tensor, the stochastc tensor may not be unque ether, nor rreducble. Next, we revew the Mnmax Theorem proposed by Chang et al [2]. In fact, ths theorem holds for nonnegatve tensors wth postve egenvectors correspondng to the spectral radus (Theorem 5.2 of [23]). Here we gve an alternatve proof of ths theorem by usng the stochastc tensor Theorem 3.3. Let A be an order m dmenson n nonnegatve tensor wth a postve egenvector correspondng to the spectral radus. Then mn max x R n 1 n ++ (Ax ) x = ρ(a) = max x R n \{0}mn x + 0 (Ax ) x. Proof. By assumpton, there exsts a stochastc tensor C such that B = ρ(a) C = A U () U 1 U 1,

6 6 Yunng Yang AND Qngzh Yang where U = dag(u 1,...,u n ) s a dagonal matrx wth postve dagonal entres. For any x R n + \{0}, wthout loss of generalty, suppose x 1 = max x 0{x }. We have ρ(b) = n B 12 m (Bx ) 1 x 1 mn x 0 (Bx ) x. By the arbtrarness of x we get ρ(b) max x R n \{0}mn x + 0 (Bx ) x. Smlarly, for any x R n ++, suppose x 2 = mn n =1{x }. Then ρ(b) = n B 22 m (Bx ) 2 x 2 (Bx ) max 1 n x and so ρ(b) mn max x R n 1 n ++ (Bx ) x. On the other sde, let x = e, the all-ones vector. We have ρ(b) = max (Be ) 1 mn max x R n 1 n ++ (Bx ) x and ρ(b) = mn (Be ) 1 max x R n \{0}mn x + 0 (Bx ) x. Gettng these nequaltes together, t leads to mn max x R n 1 n ++ (Bx ) x = ρ(b) = max x R n \{0}mn x + 0 (Bx ) x. Denote y = (x 1 /u 1,...,x n /u n ) T. Then we have mn max y R n 1 n ++ (Ay ) y = ρ(a) = max y R n \{0}mn y + 0 (Ay ) y. To generalze conclusons from the nonnegatve rreducble tensor to the nonnegatve weakly rreducble tensor, we frst gve a lemma Lemma 3.4. Let B be a stochastc weakly rreducble tensor. Suppose that there s x R n \{0} such that Bx 1 x []. Then t must hold that x = e (up to a multplcatve constant) and Be = 1 e.

7 Further results for Perron-Frobenus Theorem for nonnegatve tensors II 7 Proof. Suppose δ = max 1 n {x } > 0 and let I = { x = δ, = 1,...,n}. Denote N = {1,...,n}. If I = N, then the concluson holds. Otherwse let J = N \I. By assumpton, t holds that 1 (Bx ) x for x 0. By the weakly rreducblty of B, there must exst at least an entry a 2 m > 0 where I and some j J where j = 2,...,m. Snce x j < δ, we have 1 (Bx ) δ a 2 m + a 2 m δ m 2 x j δ < a 2 m = 1 whch deduces a contradcton. Thus I = N, whch mples x = e (up to a multplcatve constant), as desred. Usng ths lemma, we have Lemma 3.5. Let A be a nonnegatve weakly rreducble tensor. Suppose that there s y R n \{0} such that Then t must hold that Ay ρ(a) y []. Ay = ρ(a) y [], and y > 0,.e. y s the unque postve egenvector correspondng to ρ(a). Proof. By assumpton, there exsts a stochastc weakly rreducble tensor B, such that A = ρ(a) B U () U 1 U 1, where U s the dagonal matrx such that ts dagonal entres are components of u where u s the unque postve egenvector correspondng to ρ(a). By assumpton, we have whch s equvalent to (ρ(a) B U () U 1 U 1 )y ρ(a)y [] B(U 1 y) 1 (U 1 y) []. By Lemma 3.4, t holds that U 1 y = e, whch mples y = u, whch s the unque postve egenvector correspondng to ρ(a), thus Ay = ρ(a)y []. Ths completes the proof. Ths lemma generalze Lemma 3.1 of [23] from nonnegatve rreducble tensors to nonnegatve weakly rreducble tensors. Note that n [23], many conclusons can be deduced usng Lemma 3.1. We lst them here, wth the condton of weakly rreducblty Theorem 3.6. Let A,B be order m dmenson n tensors satsfyng B A, A s weakly rreducble. Let β be an egenvalue of B. Then

8 8 Yunng Yang AND Qngzh Yang (1) β ρ(a); (2) f β = ρ(a)e ϕ, then there exsts a dagonal matrx D wth modular-1 dagonal entres such that A = e ϕ B D () D D. Theorem 3.7. Let A be an order m dmenson n nonnegatve weakly rreducble tensor; suppose (λ,y) s an egen-par of A wth modulus of λ equal to ρ(a),.e. λ = ρ(a). Then y s the unque postve egenvector correspondng to ρ(a). Corollary 3.8. Let A be an order m dmenson n nonnegatve weakly rreducble tensor; suppose y s an egenvector correspondng to ρ(a). Then y contans no zero elements and y s the unque egenvector correspondng to ρ(a). Theorem 3.9. Let A 0 be an order m dmenson n weakly rreducble tensor. If A has k egenvalues wth modulus ρ(a) and they are not equal wth each other, then these egenvalues are ρ(a)e 2πj k, j = 0,...,k 1,.e. they are equally dstrbuted on the spectral crcle. Theorem Let A 0 be an order m dmenson n weakly rreducble tensor. Let λ 0 = ρ(a)e ϕ be an egenvalue of A. Then there exsts a dagonal matrx D wth unt dagonal entres such that (3.2) A = e ϕ A D () D D. Theorem Let A be an order m dmenson n nonnegatve weakly rreducble tensor. Denote σ( 1 2 m ) the set of all the permutatons of 1, 2,..., m. If there s a mult-ndex ( 1, 2,..., m) {1,...,n} such that a σ( 1 2 m ) > 0, then the number of the egenvalues on the spectral crcle s not larger than m. Furthermore, ths number must be a factor of m. Corollary The concluson of Theorem 3.11 holds for nonnegatve weakly rreducble supersymmetrc tensors. Theorem Let A be an order m dmenson n nonnegatve weakly rreducble tensor. Suppose that there are k dfferent egenvalues on the spectral crcle. Then any egenvalue of A rotatng the angle of 2π k s stll an egenvalue of A, but t can not rotate an angle smaller than 2π k. Moreover, suppose λ s an egenvalue of A wth modulus smaller than ρ(a). Then the number of egenvalues wth modulus λ s l k, where l 1 s a postve nteger. Note that all these conclusons can be proved by combnng Lemma 3.5 and the analyss n our prevous work [23, 24]. Next, we gve some new results usng Theorem 3.9 and Let σ(a) be the set of the egenvalues dstrbuted on the spectral crcle and let k be the number of these egenvalues. We have proved that for a postve tensor, the spectral radus s the unque egenvalue on the spectral crcle [23],.e. k = 1, whle the prmtve tensor

9 Further results for Perron-Frobenus Theorem for nonnegatve tensors II 9 s shown to have the same property by Pearson [5] and Chang et al [3], where the prmtve tensor s defned as Defnton (see Defnton 2.2 of [6]) For any vector x R+ n, we defne (x [ 1 ] ) = x 1. Let A and B be two m-order n dmensonal nonnegatve tensors. Let ω := (Ax ) [ 1 ] R+. n We defne the composte of the tensors for x R + to be the functon (not necessarly a tensor) (B A)x = Bω. Defnton (see Defnton 2.3 of [6]) A nonnegatve m-order n dmensonal tensor A s prmtve f there exsts a postve nteger h so that (A A A)x = A h x R++ n for any nonzero x R+. n Furthermore, we call the least value of such h the prmtve degree. The prmtve tensor s a generalzaton of the prmtve matrx. In matrx theory, a nonnegatve rreducble matrx A s prmtve f and only f the spectral radus s the unque egenvalue on the spectral crcle, or, equvalently, there s a postve nteger h, such that A h > 0. A nonnegatverreducble matrx s ether prmtve or mprmtve. However, In hgher order case, the prmtvty of a tensor s only a suffcent condton for the unqueness of the spectral radus on the spectral crcle. To see ths, we frst study nonnegatve weakly rreducble tensors wth postve trace, where the trace of a tensor s the sum of ts dagonal entres, and s denoted by tr( ). It s known that a matrx wth postve trace s a specal case of the prmtve matrx. But through an example below, we wll show that t s not always true for hgher order tensors. To begn wth, let D(T ) = {A : A s a nonnegatve weakly rreducble tensor and tr(a) > 0}. We have the followng concluson Theorem Let A D(T ). Then the spectral radus of A s the unque egenvalue on the spectral crcle. Proof. By Theorem 3.10, we get a = e ϕ a, = 1,...,n. By the condton that there s at least a a > 0, we have ϕ = 2kπ, k = 0,1,..., whch shows that the spectral radus s the unque egenvalue dstrbuted on the spectral crcle..e. Example Consder the order 3 dmenson 2 tensor A = (a jk ) gven n Secton 2, a 111 = a 121 = a 212 = 1 and a jk = 0 elsewhere. Clearly, A s weakly rreducble wth postve trace. Usng NSolve n Mathematca, we fnd that the spectral radus ρ(a) = , whch s the unque egenvalue on the spectral crcle, wth a unque postve egenvector ( , ) In [3], the authors proved that the spectral radus of a prmtve tensor s the unque egenvalue on the spectral crcle, and they gave an example to show that the converse s not true for hgher order tensors (Example 4.6 of [3]). Actually, the tensor they presented there s weakly reducble wth postve trace, whch s our case. Ths shows that the prmtve tensor s only a suffcent condton for the unqueness of the

10 10 Yunng Yang AND Qngzh Yang spectral radus on the spectral crcle. Theorem The prmtvty s a suffcent but NOT a necessary condton for the unqueness of the spectral radus on the spectral crcle of a nonnegatve rreducble tensor. REFERENCES [1] A. Mutapcc, K. Koh, S. Km and S. Boyd, GGPLAB verson 1.00: a Matlab toolbox for geometrc programmng, boyd/ggplab/ggplab.pdf, (2006). [2] K.-C. Chang, K. Pearson and T. Zhang, Perron Frobenus Theorem for nonnegatve tensors, Comm. Math. Sc. 6 (2008), [3] K.-C. Chang, K. Pearson and T. Zhang, Prmtvty, the convergence of the NQZ method, and the largest egenvalue for nonnegatve tensors, Pekng Unversty, Bejng, Chna, preprnt, (2010). [4] K.-C. Chang, L. Q and G. Zhou, Sngular values of a real rectangular tensor, J. Math. Anal. Appl. 370 (2010), [5] K. Pearson, Essentally postve tensors, Int. J. Algebra, 4 (2010), [6] K. Pearson, Prmtve tensors and convergence of an teratve process for the egenvalues of a prmtve tensor, arxv: v1, (2010). [7] L.De Lathauwer, B. D.Moor and J. Vandewalle, On the best rank-1 and rank-(r 1,R 2,...,R N ) approxmaton of hger-order tensors, SIAM J. Matrx Anal. Appl. 21 (2000), [8] L. Q, Egenvalues of a real supersymmetrc tensor, J. Symb. Comput. 40 (2005), [9] L. Q, W. Sun and Y. Wang, Numercal multlnear algebra and ts applcatons, Front. Math. Chna 2 (2007), [10] L.-H. Lm Multlnear pagerank: measurng hgher order connectvty n lnked objects, The nternet: Today and Tomorrow, (2005). [11] L.-H. Lm, Sngular values and egenvalues of tensors: a varatonal approach, Proceedngs of the IEEE Internatonal Workshop on Computatonal Advances n Mult-Sensor Addaptve Processng, 1 (2005), [12] M. Ng, L. Q and G. Zhou, Fndng the largest egenvalue of a non-negatve tensor SIAM J. Matrx Anal. Appl. 31 (2009), [13] P. Drneas and L.-H. Lm, A multlnear spectral theory of hypergraphs and expander hypergraphs, (2005). [14] Q. N, L. Q and F. Wang, An egenvalue method for the postve defnteness dentfcaton problem, IEEE Transactons on Automatc Control, 53 (2008), [15] R. Varga, Matrx Iteratve Analyss, Sprnger Verlag, (2000). [16] S. Boyd and L. Vandenberghe, Convex optmzaton. Cambrdge Unversty Press, Cambrdge (2004). [17] S. Boyd, S. Km, L. Vandenberghe and A. Hassb, A tutoral on geometrc programmng, Optm Eng. 8 (2007), [18] S. Fredland, S. Gaubert and L. Han, Perron-Frobenus theorem for nonnegatve multlnear forms and extensons, (2010), [19] S. Gaubert and J. Gunawardena, The Perron-Frobenus Theorem for homogeneous, monotone functons, Trans. Amer. Math. Soce, 356 (2004), [20] Wolfram Research, Inc., Mathematca, Verson 7.0, (2008). [21] Y. Lu, G. Zhou and N. F. Ibrahm, An always convergent algorthm for the largest egenvalue of an rreducble nonnegatve tensor, J. Compute. Appl. Math., 235 (2010), [22] Y. Nesterov and A. Nemrovsk, Interor-Pont Polynomal Methods n Convex Programmng, Studes n Appled Mathematcs, SIAM, Phladelpha, (1994). [23] Y. Yang and Q. Yang, Further results for Perron-Frobenus Theorem for nonnegatve tensors, SIAM. J. Matrx Anal. Appl. 31 (2010), [24] Y. Yang and Q. Yang, Further results for Perron-Frobenus Theorem for nonnegatve tensors II, SIAM. J. Matrx Anal. Appl. preprnt, 2011.