arxiv: v3 [math.na] 11 Apr 2013

Size: px
Start display at page:

Download "arxiv: v3 [math.na] 11 Apr 2013"

Transcription

1 Accurate egenvalue decomposton of arrowhead matrces and applcatons arxv: v3 [math.na] 11 Apr 2013 N. Jakovčevć Stor a,1,, I. Slapnčar a,1, J. Barlow b,2 a Faculty of Electrcal Engneerng, Mechancal Engneerng and Naval Archtecture, Unversty of Splt, Rudjera Boškovća 32, Splt, Croata b Department of Computer Scence and Engneerng, The Pennsylvana State Unversty, Unversty Park, PA , USA Abstract We present a new algorthm for solvng an egenvalue problem for a real symmetrc arrowhead matrx. The algorthm computes all egenvalues and all components of the correspondng egenvectors wth hgh relatve accuracy n O(n 2 ) operatons. The algorthm s based on a shft-and-nvert approach. Double precson s eventually needed to compute only one element of the nverse of the shfted matrx. Each egenvalue and the correspondng egenvector can be computed separately, whch makes the algorthm adaptable for parallel computng. Our results extend to Hermtan arrowhead matrces, real symmetrc dagonal-plus-rank-one matrces and sngular value decomposton of real trangular arrowhead matrces. Keywords: egenvalue decomposton, arrowhead matrx, hgh relatve accuracy, sngular value decomposton 2000 MSC: 65F15 1. Introducton and Prelmnares In ths paper we consder egenvalue problem for a real symmetrc matrx A whch s zero except for ts man dagonal and one row and column. Snce egenvalues are nvarant under smlarty transformatons, we can symmetrcally permute the rows and the columns of the gven matrx. Therefore, we assume wthout loss of generalty that the matrx A s a n n real symmetrc arrowhead matrx of the form Correspondng author Emal addresses: nevena@fesb.hr (N. Jakovčevć Stor), van.slapncar@fesb.hr (I. Slapnčar), barlow@cse.psu.edu (J. Barlow) 1 The research of Ivan Slapnčar and Nevena Jakovčevć Stor was supported by the Mnstry of Scence, Educaton and Sports of the Republc of Croata under grant The research of Jesse L. Barlow was supported by the Natonal Scence Foundaton under grant CCF Preprnt submtted to Elsever Aprl 12, 2013

2 where s dagonal matrx of order n 1, [ D z A = z T α D = dag(d 1,d 2,...,d n 1 ) ], (1) z = [ ζ 1 ζ 2 ζ n 1 ] T (2) s a vector and α s a scalar. Such matrces arse n the descrpton of radatonless transtons n solated molecules [3], oscllators vbratonally coupled wth a Ferm lqud [8], quantum optcs [15] (see also Example 4). Such matrces also arse n solvng symmetrc real trdagonal egenvalue problems wth the dvde-and-conquer method [11]. In ths paper we present an algorthm whch computes all egenvalues and all components of the correspondng egenvectors wth hgh relatve accuracy n O(n 2 ) operatons. Wthout loss of generalty we may assume that A s rreducble, that s, ζ 0, for all and d d j, for all j,,j = 1,...,n 1. If A has a zero n the last column, say ζ = 0, then the dagonal element d s an egenvalue whose correspondng egenvector s the -th unt vector, and we can reduce the sze of the problem by deletng the -th row and column of the matrx, eventually obtanng a matrx for whch all elements ζ j are nonzero. If d = d j, then d s egenvalue of matrx A (ths follows from the nterlacng property (7)), and we can reduce the sze of the problem by annhlatng ζ j wth a Gvens rotaton n the (,j)-plane and proceedng as n the prevous case. Further, by symmetrc row and column pvotng, we can order elements of D such that d 1 > d 2 > > d n 1. (3) Hence, we wll consder only ordered and rreducble arrowhead matrces. Wthout loss of generalty we can also assume that ζ > 0 for all, whch can be attaned by pre-and post-multplcatonofthe matrxawth D = dag(sgn(ζ ))). Let A = VΛV T (4) be the egenvalue decomposton of A. Here Λ = dag(λ 1,λ 2,...,λ n ) s a dagonal matrx whose dagonal elements are the egenvalues of A, and V = [ v 1 v n ] 2

3 s an orthonormal matrx whose columns are the correspondng egenvectors. The egenvalues of A are the zeros of the Pck functon (see [4, 16]) n 1 ζ 2 f(λ) = α λ d λ = α λ zt (D λi) 1 z, (5) =1 and the correspondng egenvectors are gven by v = x [ (D λ I) 1 z, x = x 2 1 ], = 1,...,n. (6) Dagonal elements of the matrx D, d, are called poles of the functon f. Notce that (3) and the Cauchy nterlacng theorem [10, Theorem 8.1.7] appled to matrces D and A mply the nterlacng property λ 1 > d 1 > λ 2 > d 2 > > d n 2 > λ n 1 > d n 1 > λ n. (7) Snce A s symmetrc, ts egenvalues may be computed by nvokng any of a number of standard programs (LAPACK [1]). However, these programs usually begn wth an ntal reducton of the matrx to trdagonal form [17], or as proposed n [16], wth an alternatve whch takes advantage of the structure of A by fndng the zeros of the Pck functon gven n (5), for the egenvalues of A. Ths results n an algorthm whch requres only O(n 2 ) computatons and O(n) storage. Although the dea s conceptually smple and n fact has been used to solve other egenvalue problems of specal structure [2, 5, 6, 7], the computaton s not always stable [11]. Namely, f the computed egenvalues λ are not accurate enough, then the computed egenvectors v may not be suffcently orthogonal (see Example 3). The exstng algorthms for arrowhead matrces [11, 16] obtan orthogonal egenvectors wth the followng procedure: - compute the egenvalues λ of A by solvng (5); - construct a new matrx [ D z à = z T α ] by solvngnverseproblem wth the prescrbedegenvalues λ, and dagonal matrx D, that s, compute new z and α as ) ) ζ = ( d λ ) ( λj d n 1 ( λj d n )( λ1 d (d j 1 d ) (d j d ), - compute egenvectors of à by (6). j=2 α = λ n 1 ) n + ( λj d j. j=1 j=+1 3

4 Snce the formulas for ζ nvolve only multplcatons, dvson and subtractons of exact quanttes, each ζ s computed wth relatve error of O(ε M ), where ε M denotes the machne precson. 3 Therefore, à = A + δa, where δa 2 = O(ǫ M ). Here 2 denotes the spectral matrx norm. We conclude that the computed egenvalues λ satsfy standard perturbaton bounds lke those from [10, Corollary 8.1.6]. Further, snce λ are the egenvalues of the matrx à computed to hgher relatve accuracy, the egenvectors computed by (6) are orthogonal to machne precson. For detals see [11, 16]. Our algorthm uses a dfferent approach. Accuracy of the egenvectors and ther orthogonalty follows from hgh relatve accuracy of the computed egenvalues and there s no need for follow-up orthogonalzaton. The algorthm s based on shft-and-nvert technque. Bascally, the egenvalue λ s computed as the largest or the smallest egenvalue of the nverse of the matrx shfted to the pole d whch s nearest to λ, that s, λ = 1 ν +d, (8) where ν s ether smallest or largest egenvalue of the matrx A 1 (A d I) 1. Inverses of arrowhead matrces are structured n the followng manner (here stands for non-zero element): the nverse of an arrowhead matrx wth zero on the shaft s a permuted arrowhead matrx wth zero on the shaft, 0 1 =, 0 and the nverse of the full arrowhead matrx s a dagonal-plus-rank-one(dpr1) matrx, 1 = ±uut. 0 3 The machne precson ε M s defned as a smallest postve number such that n the floatng-pont arthmetc 1 + ε M 1. In Matlab or FORTRAN REAL(8) arthmetc ε M = , thus the floatng-pont numbers have approxmately 16 sgnfcant decmal dgts. The term double of the workng precson means that the computatons are performed wth numbers havng approxmately 32 sgnfcant decmal dgts, or wth the machne precson equal to ε 2 M. 4

5 Our algorthm s completely parallel, snce the computaton of one egenvalue and ts egenvector s completely ndependent of the computaton of other egenvalues and egenvectors. In Secton 2 we descrbe the basc dea of our algorthm named aheg (ArrowHead EIGenvalues). In Secton 3 we dscuss the accuracy of the algorthm. In Secton 4 we present the complete algorthm whch uses double of the workng precson, f necessary. In Secton 5 we llustrate algorthm wth few examples and n Secton 6 we apply our results to egenvalue decomposton of Hermtan arrowhead matrx, sngular value decomposton of real trangular arrowhead matrx and egenvalue decomposton of real symmetrc dagonal-plus-rank-one matrx. The proofs are gven n Appendx A. 2. Basc shft-and-nvert algorthm Let λ be an egenvalue of A, let v be ts egenvector, and let x be the unnormalzed verson of v from (6). Let d be the pole whch s closest to λ. Clearly, from (7) t follows that ether λ = λ or λ = λ +1. Let A be the shfted matrx where A = A d I = D z ζ 0 0 D 2 z 2 z1 T ζ z2 T a D 1 = dag(d 1 d,...,d 1 d ), D 2 = dag(d +1 d,...,d n 1 d ), z 1 = [ ζ 1 ζ 2 ζ 1 ] T, z 2 = [ ζ +1 ζ +2 ζ n 1 ] T, a = α d. Notce that D 1 (D 2 ) s postve (negatve) defnte. Obvously, f λ s an egenvalue of A, then A 1 = µ = λ d, (9) s an egenvalue of A, and vce versa, and they both have the same egenvector. The nverse of A s D1 1 w w1 T b w2 T 1/ζ 0 w 2 D /ζ 0 0, (10) 5

6 where where Notce that w 1 = D1 1 z 1 1, ζ w 2 = D2 1 z 1 2, ζ b = 1 ( a+z T ζ 2 1 D1 1 z 1 +z2 T D2 1 z 2). (11) b = f (d )/ζ 2 f (d ) = α d z T ( D d I ) 1 z where D s the dagonal matrx D wthout d and z s z wthout ζ. The egenvector x from (6) s gven by (D 1 µi) 1 z 1 x 1 x =. = ζ µ x n (D 2 µi) 1 z 2. (12) 1 If λ s an egenvalue of A whch s closest to the pole d, then µ s the egenvalue of matrx A whch s closest to zero and ν = 1 µ = ± A 1 2. In ths case, f all entres of A 1 are computed wth hgh relatve accuracy, then, accordng to standard perturbaton theory, ν s computed to hgh relatve accuracy (by any reasonable algorthm). In Secton 3 we show that all entres of A 1 are ndeed computed to hgh relatve accuracy, except possbly b (see (11)). If b s not computed to hgh relatve accuracy and t nfluences A 1 2, t s suffcent to compute t n double of the workng precson (see Secton 4). Further, f µ s not the egenvalue of A whch s closest to zero, then ν < A 1 2, and the quantty A 1 K ν = 2 (13) ν tells us how far s ν from the absolutely largest egenvalue of A 1. If K ν 1, then the standard perturbaton theory does not guarantee that the egenvalue µ wll be computed wth hgh relatve accuracy. Remedes of ths stuaton are descrbed n Remark 3. Wth ths approach the componentwse hgh relatve accuracy of the egenvectors computed by (12) follows from hgh relatve accuracy of the computed egenvalues (see Theorem 3). Componentwse hgh relatve accuracy of the computed egenvectors mples, n turn, ther orthogonalty. 6

7 The descrbed procedure s mplemented n algorthm aheg basc (Algorthm 1). The computaton of the nverse of the shfted matrx, A 1, accordng to formulas (10) and (11), s mplemented n Algorthm 2. Algorthm 3 computes the largest or the smallest zero of the Pck functon (5) by bsecton. Gven egenvalue λ, Algorthm 4 computes the correspondng egenvector by (6) or (12), respectvely. 3. Accuracy of the algorthm We now consder numercal propertes of Algorthms 1, 2, 3, and 4. We assume tha standard model of floatng pont arthmetc where subtracton s preformed wth guard dgt, such that [9, 18, 10, 19] fl(a b) = (a b)(1+ε ), ε ε M, {+,,,/}, where ε M s machne precson. In the statements of the theorems and ther proofs we shall use the standard frst order approxmatons, that s, we neglect the terms of order O(ε 2 M ) or hgher. Moreover, we assume that nether overflow or underflow occurs durng the computaton. We shall use the followng notaton: Here Matrx Exact egenvalue Computed egenvalue A λ λ A µ Ã = fl(a ) µ µ = fl( µ) A 1 ν (A 1 ) = fl(a 1 ) ν ν = fl( ν) Ã = fl(a ) = D 1 (I +E 1 ) 0 0 z ζ 0 0 D 2 (I +E 2 ) z 2 z T 1 ζ z T 2 a(1+ε a ), (14) where E 1 and E 2 are dagonal matrces whose elements are bounded by ε M n absolute values and ε a ε M. Further we defne the quanttes κ λ, κ µ and κ b as follows: λ = fl(λ) = λ(1+κ λ ε M ), (15) µ = fl(µ) = µ(1+κ µ ε M ), (16) b = fl(b) = b(1+κb ε M ). (17) We also defne the quantty K b = a + z T 1 D1 1 z 1 + z T 2 D 1 a+z T 1 D1 1 z 1 +z2 TD 1 2 z 2 2 z 2. (18) 7

8 Algorthm 1 [λ,v] = aheg basc(d,z,α,k) % Computes the k-th egenpar of an rreducble arrowhead matrx % A = [dag(d) z;z α] n = max(sze(d))+1 % Determne the shft σ, the shft ndex, and whether λ s on the left % or the rght sde of the nearest pole. % Exteror egenvalues (k = 1 or k = n): f k == 1 σ = d 1 = 1 sde = R elsef k == n σ = d n 1 = n 1 sde = L else % Interor egenvalues (k {2,...,n 1}): Dtemp = D d k atemp = α d k mddle = Dtemp k 1 /2 Fmddle = atemp mddle (z 2./(Dtemp mddle)) f Fmddle < 0 σ = d k = k sde = R else σ = d k 1 = k 1 sde = L end end % Compute the nverse of the shfted matrx, A 1 [nvd 1,nvD 2,w 1,w 2,w ζ,b] = nva(d,z,α,) % Compute the leftmost or the rghtmost egenvalue of A 1 ν = bsect([nvd 1 ;0;nvD 2 ],[w 1 ;w ζ ;w 2 ],b,sde) % Compute the correspondng egenvector µ = 1/ν v = vect(d σ,z,µ) % Shft the egenvalue back λ = µ+σ 8

9 Algorthm 2 [nvd 1,nvD 2,w 1,w 2,w ζ,b] = nva(d,z,α,) % Computes the nverse of an arrowhead matrx A = [dag(d d ) z;z α d ] % accordng to (10) and (11). n = max(sze(d))+1 D = D d a = α d w 1 = z 1: 1./D 1: 1 /z w 2 = z +1:n 1./D +1:n 1 /z w ζ = 1/z nvd 1 = 1./D 1: 1 nvd 2 = 1./D +1:n 1 b = ( a+sum(z 1: 1.^2./D 1: 1 )+sum(z +1:n 1.^2./D +1:n 1 ))/z ^2 Algorthm 3 λ = bsect(d,z,α,sde) % Computes the leftmost (for sde= L ) or the rghtmost (for sde= R ) egenvalue % of an arrowhead matrx A = [dag(d) z; z α] by bsecton. n = max(sze(d))+1 % Determne the startng nterval for bsecton, [lef t, rght] f sde == L left = mn{d z,α z 1 } rght = mnd else rght = max{d+ z,α+ z 1 } left = maxd end % Bsecton mddle = (left+rght)/2 whle (rght left)/abs(mddle)> 2 eps Fmddle = α mddle sum(z.^2./ (D mddle)) f Fmddle > 0 left = mddle else rght = mddle end mddle = (left+rght)/2 end % Egenvalue λ = rght 9

10 Algorthm 4 v = vect(d,z,λ) % Computes the egenvector of an arrowhead matrx A = [dag(d) z;z α] % whch corresponds to the egenvalue λ by usng (6). v = [z./(d λ); 1] v = v/ v Connecton between accuracy of λ and µ Let λ = µ+d be an egenvalue of the matrx A, where µ s the correspondng egenvalue of the shfted matrx A = A d from whch λ s computed. Let λ = fl( µ+d ) be the computed egenvalue. Theorem 1 gves us dependency of accuracy of λ n (15) upon accuracy of µ n (16). Theorem 1. For λ and λ from (15) and µ and µ from (16) we have κ λ d + µ λ ( κ µ +1). (19) Proofs of ths theorem and subsequent theorems are gven n Appendx A. From Theorem 1 we see that the accuracy of λ depends on κ µ and the sze of the quotent d + µ. (20) λ Theorem 2 analyzes the quotent (20) wth respect to the poston of λ and sgns of µ and the neghborng poles. Theorem 2. Let the assumptons of Theorem 1 hold. () If (see Fgure 1 ()) then sgn(d ) = sgn(µ), d + µ λ = 1. () If λ s between two poles of the same sgn and sgn(d ) sgn(µ) (see Fgure 1 ()), then d + µ 3. λ Theorem 2 does not cover the followng cases: 10

11 µ {}}{ µ {}}{ d +1 () λ d 0 d λ () d 1 0 Fgure 1: Typcal stuatons from Theorem 2 (a) If d 1 < 0, then µ > 0. If, further, d 1 µ, then λ 1 s near zero, and ( d 1 + µ )/ λ 1 1 (see Fgure 2 (a)). 4 (b) If d n > 0, then µ < 0. If, further, d n µ, then λ n s near zero, and agan ( d n + µ )/ λ n 1. 5 (c) Ifλsbetweentwopolesofthedfferentsgnsandsgn(d ) sgn(µ), then ether d +1 < 0 < d and µ < 0, or d < 0 < d 1 and µ > 0. In both cases, f, addtonally, d µ, then λ s near zero, and ( d + µ )/ λ 1 (see Fgure 2 (c)). µ {}}{ µ {}}{ d 1 λ 1 (a) 0 d +1 0 (c) λ d Fgure 2: Typcal stuatons for specal cases Snce only one of these three cases can occur, Theorems 1 and 2 mply that for all egenvalues λ σ(a), but eventually one, t holds d + µ λ 3. If one of the above cases does occur, remedes are gven n the followng remark. Remark 1. If one of the cases (a), (b) or (c) occurs, then λ s an egenvalue of A nearest to zero, and we can accurately compute t from the nverse of A. Notce that the nverse s of an unreduced arrowhead matrx wth non-zero shaft 4 In ths case λ 1 s computed as a dfference of two close quanttes and cancellaton can occur. 5 In ths case λ n s computed as a dfference of two close quanttes and cancellaton can occur. 11

12 s a dagonal-plus-rank-one (DPR1) matrx of the form [ ] D A 1 1 = +ρuu 0 T, where u = [ z T D 1 1 ] T 1, ρ = a z T D 1 z. Egenvalues of A 1 are zeros of (see [2, 14]) ϕ(λ) = 1+ρ n j=1 u 2 j d j λ. Snce the absolutely largest egenvalue of A 1 s computed accurately accordng to standard perturbaton theory, and 1/ λ = A 1 2, λ s also computed wth hgh relatve accuracy. In computng matrx A 1, eventually ρ needs to be computed n hgher precson. For more detals see Remark 3. If the denomnator n ρ s computed as zero, the matrx A s numercally sngular and we can set λ = 0. Notce that all components of the the correspondng egenvector are stll computed accurately. Remark 2. Notce that Algorthm 1 (and, consequently, Algorthm 5 below) can be easly modfed to return both quanttes, d and µ such that λ = d +µ. If none of the remedes from Remark 1 were needed, these two quanttes gve addtonal nformaton about λ(that s, they gve a more accurate representaton of λ). An example s gven n Example 2. We stll need to bound the quantty κ µ from (19). Ths quantty essentally depends on the accuracy of fl(b). The bound for κ µ s gven n Theorem Accuracy of the egenvectors Snce the egenvector s computed by (12), ts accuracy depends on the accuracy of µ as descrbed by the followng theorem: Theorem 3. Let (16) hold and let x 1 (D 1 (I +E 1 ) µi) 1 z 1. x =. = fl( ζ µ (D 2 (I +E 2 ) µi) 1 z 2 ) (21) x n 1 be the computed un-normalzed egenvector correspondng to µ and λ. Then x j = x j ( 1+εxj ), εxj 3( κµ +3)ε M, j = 1,...,n. In other words, f κ µ s small, then all components of the egenvector are computed to hgh relatve accuracy. Snce the accuracy of λ and x depends on the accuracy of µ (on the sze of κ µ ) n the next three subsectons tells we dscuss the accuracy of µ. Snce µ s computed as an nverse of the egenvalue of the matrx fl(a 1 ), we frst dscuss the accuracy of that matrx. 12

13 3.3. Accuracy of the matrx A 1 We have the followng theorem: Theorem 4. For the computed elements of the matrx A 1 from (10) and (11) for all (j,k) (,) we have ( A 1 )jk = fl( A 1 )jk = ( A 1 ) For the computed element b ( A 1 where K b s defned by (18). ) jk (1+ε jk), ε jk 3ε M. from (17) we have κ b (n+3)k b, The above theorem states that all elements of the matrx A 1 are computed wth hgh relatve accuracy except possbly b. Therefore, we have to montor whether b s computed accurately, and, f not, t needs to be computed n double of the workng precson (see Secton 4 for detals) Accuracy of bsecton Let λ max be the absolutely largest egenvalue of a symmetrc arrowhead matrx A, an let λ max be the egenvalue computed by bsecton as mplemented n Algorthm 3. The error bound from [16, Secton 3.1] mmedately mples that λmax λ max = κ bs ε M, κ bs 1.06n ( n+1 ). (22) λ max Notce that the smlar error bound holds for all egenvalues whch are of the same order of magntude as λ max Accuracy of exteror egenvalues of A 1 The desred nteror egenvalue and, n some cases, also absolutely smaller exteror egenvalue λ of A s n Algorthm 1 computed by (8), where ν s one of the exteror egenvalues of the matrx A 1. The followng theorem covers the case when ν s the absolutely largest egenvalue of A 1 2, and gves two dfferent bounds. Theorem 5. Let A 1 be defned by (10) and let ν be ts egenvalue such that ν = A 1 2. (23) Let ν be the exact egenvalue of the computed matrx Then (A 1 ) ( ) = fl A 1. Let ν = ν(1+κ ν ε M ). (24) { κ ν mn (n+3) nk b,3 n+(n+3) ( 1+ 2 n 1 ζ where K b s defned by (18). k=1 k ζ k )}, (25) 13

14 3.6. Fnal error bounds All prevous error bounds are summarzed as follows. Theorem 6. Let λ be the computed egenvalue of an unreduced arrowhead matrx A, let µ be computed egenvalue of the matrx à from (9), and let ν be the correspondng computed egenvalue of the matrx (A ) 1 from (10). If µ s the egenvalue of A closest to zero (or, equvalently, f (23) holds), then the error n the computed egenvalue λ s gven by (15) wth κ λ 3( κ ν +κ bs )+4, (26) and the error n the computed un-normalzed egenvector x s gven by Theorem 3 wth κ µ κ ν +κ bs +1, (27) where κ ν s bounded by (25) and κ bs s defned by (22). Snce we are essentally usng the shft-and-nvert technque, we can guarantee hgh relatve accuracy of the computed egenvalue and hgh componentwse relatve accuracy of the computed egenvector f ν s such that ν = O( A 1 2 ) and t s computed accurately. Ths s certanly fulflled f the followng condtons are met: C1. The quantty K ν from (13) s moderate, and C2. () ether the quantty K b from (18) s small, or () the quantty 1 n 1 ζ ζ k from (25) s of order O(n). k=1 k The condton C1 mples that ν wll be computed accurately accordng to the standard perturbaton theory. The condtons C2 () or C2 () mply that κ ν from (25) s small, whch, together wth C1, mples that ν s computed accurately. If the condton C1 does not hold, that s, f K ν 1, remedes are gven n Remark 2 below. If nether of the condtons C2 () and C2 () holds, the remedystocomputebn doubleoftheworkngprecsonasdescrbednsecton 4. Remark 3. We have two possbltes: (a) we can compute λ by shftng to another neghborng pole provded that K ν s n ths case small (shftng to the pole d 1 nstead of d n Fgure 3 (a)), (b) f shftng to another neghborng pole s not possble (K ν 1, see Fgure 3 (b)), we can nvert A σi, where shft σ s chosen near λ, and σ / {λ,d,d 1 }. Ths results n a DPR1 matrx [ ] (D σi) (A σi) 1 1 = +ρuu 0 T, 14

15 where u = [ z T (D σi) 1 1 ] T, ρ = 1 a z T (D σi) 1 z. Egenvalues of ths matrx are zeros of ϕ(λ) = 1+ρ n j=1 u 2 j (d j σ) λ, and the absolutely largest egenvalue s computed accurately. Eventually, ρ needs to be computed n hgher precson. 6 d d 1 d d 1 λ +1 λ(λ ) λ 1 λ +1 λ(λ ) λ 1 (a) (b) Fgure 3: Typcal stuatons from Remark 3 4. Fnal algorthm If nether of the condtons C2 () and C2 () hold, n order to guarantee that λ wll be computed wth hgh relatve accuracy, the element b from the matrx A 1 needs to be computed n hgher precson. The followng theorem mples that f 1 K b O(1/ε M ), t s suffcent to evaluate (11) n double of the workng precson. 7 8 Theorem 7. If a > 0 n (11), set and f a < 0 n (11) set P = a+z T 1 D 1 1 z 1, Q = z T 2 D 1 2 z 2, P = z T 1 D 1 1 z 1, Q = a z T 2 D 1 2 z 2. 6 Determnng whether ρ needs to be computed n hgher precson s done smlarly as determnng whether element b of A 1 needs to be computed n hgher precson, whch s descrbed n Secton 4. Further, Theorem 7 mples that t suffces to compute ρ n double of the workng precson. 7 If K b O(1/ε M ), that s, f K b = 1/ε E for some ε E < ε M, then, n vew of Theorem 7, b needs to be computed wth extended precson ε E. 8 Usage of hgher precson n conjuncton wth the egenvalue computaton for DPR1 matrces s analyzed n [2], but there the hgher precson computaton s potentally needed n the teratve part. Ths s less convenent than our approach where the hgher precson computaton s used only to compute one element. 15

16 Notce that n both cases P,Q 0 and b = (P Q)/ζ 2. Let P = fl(p) and Q = fl(q) be evaluated n standard precson, ε M. Assume that P Q and K b O(1/ε M ). If P, Q and b are all evaluated n double of the workng precson, ε 2 M, then (17) holds wth κ b O(n). We summarze the above results n one, complete algorthm, aheg. The algorthm frst checks the components of the vector z. If they are of the same order of magntude, the egenpar (λ,v) s computed by Algorthm 1. If that s not the case, the quantty K b s computed, and f K b 1, the egenpar (λ,v) s computed by Algorthm 1 but wth evaluaton of b n double of the workng precson. At the end, the quantty K ν s computed, and f K ν 1, one of the remedes from Remark 3 s appled. Algorthm 5 [λ,v] = aheg(d,z,α,k) % Computes the k-th egenpar of an ordered rreducble arrowhead matrx % A = [dag(d) z;z α] compute the shft ( as n the frst part of Algorthm 1 n 1 ) f the quantty j=1 j ζ j / ζ from (25) s of O(n) % standard precson s enough [λ,v] = aheg basc(d,z,α,k) else compute the quantty K b from (18) f K b 1 % double precson s necessary [λ,v] = aheg basc(d,z,α,k) wth evaluaton of b n double precson else % standard precson s enough [λ,v] = aheg basc(d,z,α,k) end end compute the quantty K ν from (13) f K ν 1 apply one of the remedes from Remark 3 end 4.1. On mplementng double precson Implementaton of the double of the workng precson depends upon whether the nput s consdered to be bnary or decmal. Double standard precson n Matlab, whch assumes that nput s bnary, s obtaned by usng a combnaton of commands vpa, dgts and double [13], where 16

17 - dgts(d) specfes the number of sgnfcant decmal dgts d used to do varable precson arthmetc vpa, - vpa(x) uses varable-precson arthmetc to compute x to d decmal dgts of accuracy, - double(x) converts x to standard precson. The assgnment a1=vpa(a,32) pads the bnary representaton of a wth zeros, whch means that the decmal nterpretaton of the varable a1 may have non-zero entres after 16-th sgnfcant decmal dgt. The same effect s obtaned n Intel FORTRAN compler fort [12] by the followng program segment real(8) a real(16) a1... a1=a However, the user can assume that the true nput s gven as a decmal number, whch s, for example, assumed by extended precson computaton n Mathematca [20]. In ths case, the optons n Matlab are to ether use symbolc computaton, or to cast the nput to a strng, and then convert t to extended precson: a1=vpa(num2str(a,16),32) In ths case, the the decmal nterpretaton of the varable a1 has all zero entres after 16-th sgnfcant decmal dgt, but the bnary representaton of the varable a s, n general, padded wth non-zero entres. The same effect s obtaned n fort wrtng to and readng from a strng varable as n the followng program segment: real(8) a real(16) a1 character(25) strng... wrte(strng,*) a read(strng,*) a1 If the nput conssts of numbers for whch decmal and bnary representaton are equal (for example, ntegers, as n Example 3 below), then the two above approaches gve the same results. 5. Numercal Examples We llustrate out algorthm wth four numercally demandng examples. Examples 1 and 2 llustrate Algorthm 1, Example 3 llustrates the use of double precson arthmetc, and Example 4 llustrates an applcaton of hgher dmenson. 17

18 Example 1. Inths exampleboth quanttesk ν from(13) andk b from(18) are for all egenvalues approxmately equal to 1, so we guarantee that all egenvalues and all components of ther correspondng egenvectors are computed wth hgh relatve accuracy by Algorthm 5 (aheg) usng only standard machne precson. Let A = The egenvalues computed by Matlab [13] routne eg, Algorthm 5 and Mathematca [20] wth 100 dgts precson, are, respectvely: λ (eg) λ (aheg) λ (Math) Weseethateventhetnestegenvaluesλ 3 andλ 4, computedbyalgorthm5,are exact to the machne precson, whch s not true for the egenvalues computed by eg. Because of the accuracy of the computed egenvalues, the egenvectors computed by Algorthm 5 are componentwse accurate up to machne precson, and therefore, orthogonal up to machne precson. For example: v (eg) 4 v (aheg) 4 v (Math) Example 2. In ths example, despte very close dagonal elements, we agan guarantee that all egenvalues and all components of ther correspondng egenvectors are computed wth hgh relatve accuracy, wthout deflaton. Let A = 1+4ε M ε M ε M ε M where ε M = = For ths matrx the quanttes K ν and K b are agan of order one for all egenvalues, so Algorthm 5 uses only standard. 18

19 workng precson. The egenvalues computed by Matlab and Algorthm 5 are: λ (eg) λ (aheg) ε M 1+4ε M 1+4ε M 1+3ε M 1+3ε M 1+2ε M The egenvalues computed by Mathematca wth 100 dgts precson, properly rounded to 32 decmal dgts are 9 : λ (Math) The egenvalues computed by Matlab are accurate accordng to standard perturbaton theory, but they do not satsfy the nterlacng property. Furthermore, the Matlab s egenvectors correspondng to λ 2, λ 3 and λ 4 only span an accurate egenspace, and are not ndvdually accurate. On the other hand, the egenvalues computed by Algorthm 5 are exact (they concde wth the egenvalues computed by Mathematca properly rounded to 16 decmal dgts). Notce that despte of very close egenvalues, Algorthm 5 works wthout deflaton. Due to the accuracy of the computed egenvalues, the egenvectors computed by Algorthm 5 are componentwse accurate up to the machne precson, and are therefore orthogonal. If, as suggested n Remark 2, the algorthms are modfed to return d and µ (both n standard precson), then for the egenvalues λ 2, λ 3 and λ 4 the correspondng pars (d,µ) gve representatons of those egenvalues to 32 decmal dgts. That s, exact values d + µ properly rounded to 32 decmal dgts are equal to the correspondng egenvalues computed by Mathematca as dsplayed above. Example 3. In ths example we can guarantee all egenvalues and egenvectors, componentwse wll be computed wth hgh relatve accuracy only f we use double of the workng precson when computng b from (11) n matrces 9 Snce, as descrbed n Secton 4.1, Mathematca uses decmal representaton of the nput, n order to obtan accurate egenvectors we need to defne ε M n Mathematca wth the output of Matlab s command vpa(eps), ε M =

20 A 1 2,A 1 3,A 1 4 and A5 1. Let A = The quanttes K ν and K b are: 10 K ν K b It s clear, from the condton numbers, that the element b n each of the matrces A 1 2,A 1 3,A 1 4 and A 1 5 needs to be computed n double of the workng precson. For example, A 2 = A d 2 I = The element b = [ A2 1 ] computed by Algorthm 2 gves b = , 22 Matlab s routne nv yelds b = , whle computng b n double of the workng precson gves the correct value b = Egenvalues computed by Algorthm 1 (aheg basc, usng only standard workng precson), Algorthm 5 (aheg, usng double of the workng precson to compute respectve b s) and Mathematca wth 100 dgts precson, respectvely, are: λ aheg basc λ aheg λ Math The egenvectors computed by Algorthm 5 are componentwse accurate to machne precson and therefore orthogonal. 10 Algorthm 5 does not compute K ν and K b for the frst egenvalue, snce t s an absolutely largest one. 20

21 Example 4. Ths example comes from the research related to decay of excted states of quantum dots n n real photon crystals [15]. In ths case - α s quantum dot transton frequency, - d s a frequency of the -th optcal mode, and - ζ s an nteracton constant of the quantum dot wth the -th optcal mode. The sze of the matrx s changeable but, n realstc cases, t s between 10 3 and We ran a test example for n = 2501 where, typcally, d [ , ], ζ [ , ], α = For ths matrx the condton number K ν 1 for all egenvalues and the components of the vector z do not dffer by much n sze, thus the condtons C1 and C2 () from Secton 3 are fulflled. Therefore, all egenvalues and all components of all egenvectors are computed wth hgh relatve accuracy by Algorthm 5 usng only standard workng precson. On the other hand about half of the egenvalues computed by the Matlab routne eg do not satsfy the nterlacng property. 6. Applcatons In ths secton we extend our results to egenvalue decompostons of Hermtan arrowhead matrces, sngular value decompostons of real trangular arrowhead matrces and egenvalue decompostons of real symmetrc dagonalplus-rank-one matrces Hermtan arrowhead matrces Let where C = [ D z z α ], D = dag(d 1,d 2,...,d n 1 ), s a real dagonal matrx of order n 1, z = [ ζ 1 ζ 2 ζ n 1 ], s a complex valued vector and α s a real scalar. Here z denotes the conjugate transpose of z. As n Secton 1, we assume that C s rreducble. The egenvalue decomposton of C s gven by C = UΛU 21

22 where Λ = dag(λ 1,...,λ n ) R n n s a dagonal matrx of egenvalues, and U = [ ] u 1 u 2 u n s an untary matrx of the correspondng egenvectors. To apply Algorthm 5 to Hermtan arrowhead matrx we frst transform C to real symmetrc arrowhead matrx A by dagonal untary smlarty: [ ] A = Φ D z CΦ = z T, (28) α where ( ) ζ1 Φ = dag ζ 1, ζ 2 ζ 2,..., ζ n 1 ζ n 1,1 We now compute the k-th egenpar (λ,v) of A by Algorthm 5, and set u = Φv. Snce we guarantee hgh relatve accuracy of the egenvalue decomposton of A computed by Algorthm 5, we also guarantee hgh relatve accuracy of the egenvalue decomposton of C. Notce that, f double precson s needed to compute b n Algorthm 5, the modules ζ n (28) need to be computed n double of the workng precson, as well. Remark 4. Smlarly, for rreducble non-symmetrc arrowhead matrx [ ] D z G = z T, α where sgn( ζ ) = sgn( ζ ), = 1,...,n 1, we defne the dagonal matrx Ψ = dag sgn( ζ 1 ) ζ1 ζ 1,...,sgn( ζ n 1 ) ζn 1,1. ζ n 1 The matrx [ ] A = Ψ 1 D z GΨ = z T, α where ζ = ζ 1 ζ s an rreducble symmetrc arrowhead matrx. Wenowcomputethek-thegenpar(λ,v)ofAbyAlgorthm5. Theegenpar of G s then (λ,ψv). set u = Φv. Snce we guarantee hgh relatve accuracy of the egenvalue decomposton of A, we also guarantee hgh relatve accuracy of the egenvalue decomposton of G. Notce that, f double precson s needed to compute b n Algorthm 5, the elements ζ need to be computed n double of the workng precson, as well Sngular value decomposton of a trangular arrowhead matrx Let B = [ D z 0 α ], 22

23 be an rreducble upper trangular arrowhead matrx, that s, d d j for j and ζ 0 for all. The matrx [ ] A = B T D 2 Dz B = z T D α+z T, z s an rreducble symmetrc arrowhead matrx. When applyng Algorthm 5 to the matrx A, we must ensure that all components of A 1 n (10) are computed to hgh relatve accuracy. Ths s obvously true for elements of the vectors w and w 2. Dagonal elements, except b, are computed wth hgh relatve accuracy as dfferences of squares of orgnal quanttes, [A 1 1 ] jj = (d j d )(d j +d ), j. The element b = [A 1 ] from (11) s computed as 11 b = 1 α z T d 2 z +d + d 2 j ζ2 j. ζ2 (d j d )(d j +d ) j Ifdoubleprecsons needednalgorthm5, allentresofaneedtobe computed n double precson. Let B = UΣV T be the sngular value decomposton of B, where Σ = dag(σ 1,...,σ n ) are the sngular values, the columns of V are the correspondng rght sngular vectors and the columns of U are the correspondng left sngular vectors. We frst compute the k-th egenpar (λ,v) of A by Algorthm 5. Then σ = λ s the correspondng sngular value of B and v s the correspondng rght sngular vector. The value σ and all components of v are computed to almost full accuracy. From the relaton U T B = ΣV T for the k-th row we have whch mples [ u T 1:n 1 u n ] [ D z 0 α ] = σ [ ] v1:n 1 T v n, u 1:n 1 = σv 1:n 1 D 1. From the relaton BV = UΣ for the k-th column we have [ ][ ] [ ] D z v1:n 1 u1:n 1 = σ, 0 α v n u n whch mples u n = αv n σ. Components of u are computed by multplcaton and dvson of quanttes whch are accurate to almost full machne precson, so the are accurate to almost full machne precson, as well. 11 In vew of Theorem 7, f double precson computaton s necessary, the postve and negatve parts of ths formula should be computed separately, and then added. 23

24 6.3. Dagonal-plus-rank-one matrces Let where M = D+uu T, D = dag(d 1,...,d n ), d 1 > d 2 > > d n, u = [ u 1 u n ] T, u 0, = 1,...,n, be a n n rreducble ordered real symmetrc dagonal-plus-rank-one (DPR1) matrx. Let Then where D = dag(d 1,...,d n 1 ), = ( D d n ) 1/2, ū = [ ] T u 1 u n 1, [ ] un L = 1 0 ū T 1. 1 [ ] D z A = L 1 ML = z T, α z = ū, α = d n +u T u, s an rreducble real symmetrc arrowhead matrx. When applyng Algorthm 5 to the matrx A, we must ensure that all components of A 1 n (10) are computed to hgh relatve accuracy. Ths s obvously true for elements of the vectors w and w 2. Dagonal elements, except b, are computed wth hgh relatve accuracy as dfferences of orgnal quanttes, and the element b = [A 1 ] from (11) s computed as b = 1 d n u T u+d +. ζ d j d j Ifdoubleprecsons needednalgorthm5, allentresofaneedtobe computed n double precson. Let M = QΛQ T and A = VΛV T be the egenvalue decompostons of M and A, respectvely. Snce M s by assumpton rreducble, ts egenvalues satsfy nterlacng property λ 1 > d 1 > λ 2 > d 2 > > λ n > d n. (29) We frst compute the k-th egenpar (λ,v) of A by Algorthm 5. The value λ and all components of v are computed to almost full accuracy. The relaton V T AV = V T L 1 MLV = Λ mples that the columns of the matrx X = LV ζ j 24

25 are the unnormalzed egenvectors of the matrx M. Further, snce, by (29), all egenvalues are smple, we conclude that X = QΣ, where Σ = dag(σ 1,...,σ n ) s a postve defnte matrx. Notce that QΣV T = L s, n fact, sngular value decomposton of L. Equatng k-th columns of the equaton X = LV gves [ [ ][ ] x un x = = Lv = 1 0 v xn] ū T 1, 1 v n where x and v are parttoned accordng to L. Ths mmedately mples that x = u n 1 v. Notce that, snce all components of v are computed to almost full, accuracy, the same holds for the components of x, and t remans to compute x n accurately. Let [ ] q q = q n be the k-th column of Q and let σ = Σ kk. Equatng k-th rows of the equaton gves for the n-th element Thus, X 1 = Σ 1 Q T = V T L 1 1 q n σ = x 1 n σ 2 = v n. x n = σ 2 v n and, nordertocomputex n, tsnecessarytocomputeσ 2. FromX = UΣ = LV t follows that V T L T LV = Σ 2, or, equvalently, LV = L T VΣ 2. Equatng k-th columns of ths equaton gves 1 vu [ n = v 1 ] + 1 ūv n σ 2. u n Ths gves n 1 equatons for σ 2, and we can choose the numercally most accurate one. Therefore, x n wll be computed to almost full machne precson, as are the entres of x, and t remans to normalze x and obtan q = x/σ. Remark 5. Notce that DPR1 matrces of the form D uu T cannot be reduced to symmetrc arrowhead matrx by the procedure descrbed n ths secton. By usng deas from ths paper, t s possble to derve hghly accurate algorthm for DPR1 matrces wthout pror transformaton to arrowhead form. Ths algorthm, whch s a topc of our forthcomng paper, covers more general DPR1 matrces of the form D+ρuu T, ρ R. 25

26 Appendx A. Proofs Proof of Theorem 1. Let µ and λ be defned by (14). Then By smplfyng the equalty and usng λ = µ+d, we have Takng absolute value gves Proof of Theorem 2. or λ fl(d + µ) = (d + µ)(1+ε 1 ). (d +µ(1+κ µ ε M ))(1+ε 1 ) = λ(1+κ λ ε M ) d ε 1 +µ(κ µ ε M +ε 1 ) = λκ λ ε M. κ λ d + µ λ ( κ µ +1). () The assumpton sgn(d ) = sgn(µ) mmedately mples d + µ λ () The assumptons mply that ether = d +µ d +µ = 1. 0 < d +1 < λ < d, µ < 0, d < λ < d 1 < 0, µ > 0. In the frst case λ s closest to the pole d and d + µ λ d d d d +d d 1 2 d d d +1 3d d = 3. d d 1 2 d d d +1 Here we used the nequaltes µ 1 2 d d +1 and λ 1 2 d +d +1 for the frst nequalty, d d +1 > 0 and d +d +1 > 0 for the second nequalty and d +1 > 0 for the fourth nequalty, respectvely. The proof for the second case s analogous. 26

27 Proof of Theorem 3. Let x and x be defned by (12) and(21), respectvely. The theorem obvously holds for x n = x n = 1. For x we have ( x = fl ζ ) ζ = µ µ(1+κ µ ε M ) (1+ε 1) = x (1+ε x ). By usng (16) and (21), the frst order approxmaton gves For j / {,n}, by solvng the equalty x j = ε x ( κ µ +1)ε M. ζ j ((d j d )(1+ε 1 ) µ(1+κ µ ε M ))(1+ε 2 ) (1+ε 3) = ζ j d j λ (1+ε x) for ε x, usng (16) and λ = µ+d, and gnorng hgher order terms, we have Therefore, then If ε x = (d j d )(ε 1 +ε 2 +ε 3 ) µ(κ µ ε M +ε 2 +ε 3 ). d j λ ε x d j d + µ d j λ ( κ µ +3)ε M. To complete the proof we need to analyze two cases. If d j d + µ d j λ sgn(d j d ) = sgnµ, = d j d µ d j λ sgn(d j d ) = sgnµ, = d j λ d j λ = 1. then, snce d s pole closest to λ, we have µ 0.5 d j d and d j d + µ d j λ d 3 j d + µ d j d µ 2 d j d 1 2 d j d = 3. Fnally, the theorem follows by nsertng ths nto (A.1). (A.1) Proof of Theorem 4. For the non-zero computed elements of the matrx A 1 from (10) and (11), except the element b = [A 1 ], we have: fl( [ A 1 ]jj ) = 1 (d j d )(1+ε 1 ) (1+ε 2), j / {,n}, fl( [ A 1 ]j ) = fl([ A 1 ]j ) = ζ j (d j d )(1+ε 3 )ζ (1+ε 4 ) (1+ε 5), j / {,n}, fl([a 1 ] n ) = fl([a 1 ] n ) = 1 ζ (1+ε 6 ), 27

28 where ε k ε M for all ndces k. The frst statement ofthe theorem nowfollows by usng standard frst order approxmatons. Smlar analyss of the formula (11) yelds where δb 1 ζ 2 fl([a 1 ] ) = b = b+δb, ( a + z T 1 D 1 1 z 1 + z T 2 D 1 2 z 2 Ths, n turn, mples (17) wth κ b δb 1 b ε M = (n+3) a + z1 TD 1 1 z 1 + z2 T D 1 a+z T 1 D1 1 z 1 +z2 TD 1 where K b s defned by (18). Proof of Theorem 5. Let Therefore, whch, together wth (24), mples ( ) A 1 = A 1 +δa 1. ν ν = δa 1 2, ) (n+3)ε M. 2 z 2 2 z 2 = (n+3)k b, (A.2) νκ ν ε M δa 1 2. (A.3) Theorem 4 mples that δa 1 2 (n+3) A 1 2 K b ε M. Snce A 1 2 n A 1 2 and ν = A 1 2, from (A.3) we have κ ν (n+3) nk b, (A.4) whch proves the frst part of the bound (25). For the second part of the proof, notce that Theorem 4 also mples δa A 2 ε M + δb, (A.5) where A s equal to the matrx A 1 wthout b (that s, wth A = 0). By boundng (A.3) wth (A.5) and (A.2), and dvdng the resultng nequalty by νε m, we have κ ν 3 ( 1 a + z T n+(n+3) 1 D 1 ν 1 z 1 ζ 2 + z T 2 D 1 2 z 2 ). (A.6) 28

29 Snce a ζ 2 = 1 ζ 2 a+z1 T D1 1 z 1 +z2 T D2 1 z 2 z1 T D1 1 z 1 z2 T D2 1 z 2 b + 1 ζ 2 ( z1 T D1 1 z 1 + z2 T D2 1 z 2 ), from (A.6) t follows κ ν 3 ( b n+(n+3) ν + 2 z1 TD 1 ν 1 z 1 + z2 TD 1 ζ 2 2 z 2 Snce b ν and A 1 2 = ν = max A 1 x x 2 =1 2 A 1 e 2 k 1 = (d k d ) 2 + ζk 2 ζ 2(d k d ) 2 ζ k ζ d k d, by smply dvdng each term ζ 2 k ζ 2 d k d n (A.7) wth the correspondng quotent we obtan ζ k ζ d k d, ) ). (A.7) κ ν 3 n+(n+3) (1+ 2ζ n 1 ) ζ k. (A.8) k=1 k The bound (25) now follows from (A.4) and (A.8). Proof of Theorem 6. We frst prove the bound (27). Snce ν = fl( ν) s computed by bsecton, from (22) we have ν = ν(1+κ bs ε M ). Ths and (24) mply ν = ν(1+κ ν ε M )(1+κ bs ε M ). Snce µ = fl(1/ ν), the bound (27) follows by gnorng hgher order terms. The bound (26) now follows by nsertng (27) nto Theorems 1 and 2. 29

30 Proof of Theorem 7. Let the assumptons ofthe theorem hold. Let b be computed n double of the workng precson, ε 2 M, and then stored n the standard precson. The standard floatng-pont error analyss wth neglectng hgher order terms gves P ( ( ) 1+κ P εm) 2 Q 1+κQ ε 2 M ( ζ 2 1+κ1 ε 2 P Q M) = ζ 2 (1+κ b ε M ) b(1+κ b ε M ), where κ P, κ Q (n + 1) and κ 1 3. Solvng the above equalty for κ b, neglectng hgher order terms, and takng absolute values gves κ b P + Q P Q (n+4)ε M K b (n+4)ε M. Snce, by assumpton, K b O(1/ε M ), ths mples as desred. κ b O(n), References [1] E. Anderson et al., LAPACK Users Gude, SIAM 3rd ed., Phladelpha, (1999). [2] J. L. Barlow, Error analyss of update methods for the symmetrc egenvalue problem, SIAM J. Matrx Anal. Appl., 14 (1993) [3] M. Bxon and J. Jortner, Intramolecular radatonless transtons, J. Chem. Physcs, 48 (1968) [4] C. F. Borges, W. B. Gragg, A parallel Dvde - and - Conquer Method for the Generalzed Real Symmetrc Defnte Trdagonal Egenproblem, n Numercal Lnear Algebra and Scentfc Computng, L. Rechel, A. Ruttan and R. S. Varga, eds., de Gruyter, Berln (1993) [5] J. R. Bunch and C. P. Nelsen, Rank-one modfcaton of the symmetrc egenproblem, Numer. Math., 31 (1978) [6] J. J. M. Cuppen, A dvde and conquer method for the symmetrc trdagonal egenproblem, Numer. Math., 36 (1981) [7] J. Dongarra and D. Sorensen, A fully parallel algorthm for the symmetrc egenvalue problem, SIAM J. Sc. Statst. Comput., 8 (1987) [8] J. W. Gadzuk, Localzed vbratonal modes n Ferm lquds, general Theory, Phys. Rev. B, 24 (1981)

31 [9] D. Goldberg, What Every Computer Scentst Should Know About Floatng-Pont Arthmetc, ACM Computng Surveys, 23:1 (1991) [10] G. H. Golub and C. F. Van Loan, Matrx Computatons, The John Hopkns Unversty Press, Baltmore, 3rd ed. (1996). [11] M. Gu and S. C. Esenstat, A dvde-and-conquer algorthm for the symmetrc trdagonal egenproblem, SIAM J. Matrx Anal. Appl., 16 (1995) [12] Intel Fortran Compler, [13] MATLAB. The MathWorks, Inc., Natck, Massachusetts, USA, [14] A. Melman, Numercal soluton of a secular equaton, Numer. Math., 69 (1995) [15] D. Moglevtsev, A. Maloshtan, S. Kln, L. E. Olvera and S. B. Cavalcant, Spontaneous emsson and qubt transfer n spn-1/2 chans, J. Phys. B: At. Mol. Opt. Phys., (2010). [16] D. P. O Leary and G.W. Stewart, Computng the egenvalues and egenvectors of symmetrc arrowhead matrces, J. Comput. Phys. 90, 2 (1990) [17] S. Olvera, A new parallel chasng algorthm for transformng arrowhead matrces to trdagonal form, Math. Comp., 221 (1998) [18] B. N. Parlett, The Symmetrc Egenvalue Problem, Prentce-Hall, Englewood Clffs, (1980). [19] J. H. Wlknson, The Algebrac Egenvalue Problem, Clarendon Press, Oxford, (1965). [20] Wolfram Mathematca, Documentaton Center, 31

Accurate eigenvalue decomposition of arrowhead matrices and applications

Accurate eigenvalue decomposition of arrowhead matrices and applications Accurate egenvalue decomposton of arrowhead matrces and applcatons N. Jakovčevć Stor a,1,, I. Slapnčar a,1, J. Barlow b,2 a Faculty of Electrcal Engneerng, Mechancal Engneerng and Naval Archtecture, Unversty

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

ρ some λ THE INVERSE POWER METHOD (or INVERSE ITERATION) , for , or (more usually) to

ρ some λ THE INVERSE POWER METHOD (or INVERSE ITERATION) , for , or (more usually) to THE INVERSE POWER METHOD (or INVERSE ITERATION) -- applcaton of the Power method to A some fxed constant ρ (whch s called a shft), x λ ρ If the egenpars of A are { ( λ, x ) } ( ), or (more usually) to,

More information

= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system.

= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system. Chapter Matlab Exercses Chapter Matlab Exercses. Consder the lnear system of Example n Secton.. x x x y z y y z (a) Use the MATLAB command rref to solve the system. (b) Let A be the coeffcent matrx and

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016 U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and

More information

MEM 255 Introduction to Control Systems Review: Basics of Linear Algebra

MEM 255 Introduction to Control Systems Review: Basics of Linear Algebra MEM 255 Introducton to Control Systems Revew: Bascs of Lnear Algebra Harry G. Kwatny Department of Mechancal Engneerng & Mechancs Drexel Unversty Outlne Vectors Matrces MATLAB Advanced Topcs Vectors A

More information

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2 Salmon: Lectures on partal dfferental equatons 5. Classfcaton of second-order equatons There are general methods for classfyng hgher-order partal dfferental equatons. One s very general (applyng even to

More information

BOUNDEDNESS OF THE RIESZ TRANSFORM WITH MATRIX A 2 WEIGHTS

BOUNDEDNESS OF THE RIESZ TRANSFORM WITH MATRIX A 2 WEIGHTS BOUNDEDNESS OF THE IESZ TANSFOM WITH MATIX A WEIGHTS Introducton Let L = L ( n, be the functon space wth norm (ˆ f L = f(x C dx d < For a d d matrx valued functon W : wth W (x postve sem-defnte for all

More information

Inexact Newton Methods for Inverse Eigenvalue Problems

Inexact Newton Methods for Inverse Eigenvalue Problems Inexact Newton Methods for Inverse Egenvalue Problems Zheng-jan Ba Abstract In ths paper, we survey some of the latest development n usng nexact Newton-lke methods for solvng nverse egenvalue problems.

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

Formulas for the Determinant

Formulas for the Determinant page 224 224 CHAPTER 3 Determnants e t te t e 2t 38 A = e t 2te t e 2t e t te t 2e 2t 39 If 123 A = 345, 456 compute the matrx product A adj(a) What can you conclude about det(a)? For Problems 40 43, use

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

P A = (P P + P )A = P (I P T (P P ))A = P (A P T (P P )A) Hence if we let E = P T (P P A), We have that

P A = (P P + P )A = P (I P T (P P ))A = P (A P T (P P )A) Hence if we let E = P T (P P A), We have that Backward Error Analyss for House holder Reectors We want to show that multplcaton by householder reectors s backward stable. In partcular we wsh to show fl(p A) = P (A) = P (A + E where P = I 2vv T s the

More information

The lower and upper bounds on Perron root of nonnegative irreducible matrices

The lower and upper bounds on Perron root of nonnegative irreducible matrices Journal of Computatonal Appled Mathematcs 217 (2008) 259 267 wwwelsevercom/locate/cam The lower upper bounds on Perron root of nonnegatve rreducble matrces Guang-Xn Huang a,, Feng Yn b,keguo a a College

More information

763622S ADVANCED QUANTUM MECHANICS Solution Set 1 Spring c n a n. c n 2 = 1.

763622S ADVANCED QUANTUM MECHANICS Solution Set 1 Spring c n a n. c n 2 = 1. 7636S ADVANCED QUANTUM MECHANICS Soluton Set 1 Sprng 013 1 Warm-up Show that the egenvalues of a Hermtan operator  are real and that the egenkets correspondng to dfferent egenvalues are orthogonal (b)

More information

Perron Vectors of an Irreducible Nonnegative Interval Matrix

Perron Vectors of an Irreducible Nonnegative Interval Matrix Perron Vectors of an Irreducble Nonnegatve Interval Matrx Jr Rohn August 4 2005 Abstract As s well known an rreducble nonnegatve matrx possesses a unquely determned Perron vector. As the man result of

More information

LECTURE 9 CANONICAL CORRELATION ANALYSIS

LECTURE 9 CANONICAL CORRELATION ANALYSIS LECURE 9 CANONICAL CORRELAION ANALYSIS Introducton he concept of canoncal correlaton arses when we want to quantfy the assocatons between two sets of varables. For example, suppose that the frst set of

More information

Time-Varying Systems and Computations Lecture 6

Time-Varying Systems and Computations Lecture 6 Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

CSCE 790S Background Results

CSCE 790S Background Results CSCE 790S Background Results Stephen A. Fenner September 8, 011 Abstract These results are background to the course CSCE 790S/CSCE 790B, Quantum Computaton and Informaton (Sprng 007 and Fall 011). Each

More information

Norms, Condition Numbers, Eigenvalues and Eigenvectors

Norms, Condition Numbers, Eigenvalues and Eigenvectors Norms, Condton Numbers, Egenvalues and Egenvectors 1 Norms A norm s a measure of the sze of a matrx or a vector For vectors the common norms are: N a 2 = ( x 2 1/2 the Eucldean Norm (1a b 1 = =1 N x (1b

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Developing an Improved Shift-and-Invert Arnoldi Method

Developing an Improved Shift-and-Invert Arnoldi Method Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 93-9466 Vol. 5, Issue (June 00) pp. 67-80 (Prevously, Vol. 5, No. ) Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) Developng an

More information

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k) ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of

More information

On a Parallel Implementation of the One-Sided Block Jacobi SVD Algorithm

On a Parallel Implementation of the One-Sided Block Jacobi SVD Algorithm Jacob SVD Gabrel Okša formulaton One-Sded Block-Jacob Algorthm Acceleratng Parallelzaton Conclusons On a Parallel Implementaton of the One-Sded Block Jacob SVD Algorthm Gabrel Okša 1, Martn Bečka, 1 Marán

More information

One-sided finite-difference approximations suitable for use with Richardson extrapolation

One-sided finite-difference approximations suitable for use with Richardson extrapolation Journal of Computatonal Physcs 219 (2006) 13 20 Short note One-sded fnte-dfference approxmatons sutable for use wth Rchardson extrapolaton Kumar Rahul, S.N. Bhattacharyya * Department of Mechancal Engneerng,

More information

SL n (F ) Equals its Own Derived Group

SL n (F ) Equals its Own Derived Group Internatonal Journal of Algebra, Vol. 2, 2008, no. 12, 585-594 SL n (F ) Equals ts Own Derved Group Jorge Macel BMCC-The Cty Unversty of New York, CUNY 199 Chambers street, New York, NY 10007, USA macel@cms.nyu.edu

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Section 8.3 Polar Form of Complex Numbers

Section 8.3 Polar Form of Complex Numbers 80 Chapter 8 Secton 8 Polar Form of Complex Numbers From prevous classes, you may have encountered magnary numbers the square roots of negatve numbers and, more generally, complex numbers whch are the

More information

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41,

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41, The greatest common dvsor of two ntegers a and b (not both zero) s the largest nteger whch s a common factor of both a and b. We denote ths number by gcd(a, b), or smply (a, b) when there s no confuson

More information

Randić Energy and Randić Estrada Index of a Graph

Randić Energy and Randić Estrada Index of a Graph EUROPEAN JOURNAL OF PURE AND APPLIED MATHEMATICS Vol. 5, No., 202, 88-96 ISSN 307-5543 www.ejpam.com SPECIAL ISSUE FOR THE INTERNATIONAL CONFERENCE ON APPLIED ANALYSIS AND ALGEBRA 29 JUNE -02JULY 20, ISTANBUL

More information

Representation theory and quantum mechanics tutorial Representation theory and quantum conservation laws

Representation theory and quantum mechanics tutorial Representation theory and quantum conservation laws Representaton theory and quantum mechancs tutoral Representaton theory and quantum conservaton laws Justn Campbell August 1, 2017 1 Generaltes on representaton theory 1.1 Let G GL m (R) be a real algebrac

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

Workshop: Approximating energies and wave functions Quantum aspects of physical chemistry

Workshop: Approximating energies and wave functions Quantum aspects of physical chemistry Workshop: Approxmatng energes and wave functons Quantum aspects of physcal chemstry http://quantum.bu.edu/pltl/6/6.pdf Last updated Thursday, November 7, 25 7:9:5-5: Copyrght 25 Dan Dll (dan@bu.edu) Department

More information

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16 STAT 39: MATHEMATICAL COMPUTATIONS I FALL 218 LECTURE 16 1 why teratve methods f we have a lnear system Ax = b where A s very, very large but s ether sparse or structured (eg, banded, Toepltz, banded plus

More information

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011 Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected

More information

Numerical Properties of the LLL Algorithm

Numerical Properties of the LLL Algorithm Numercal Propertes of the LLL Algorthm Frankln T. Luk a and Sanzheng Qao b a Department of Mathematcs, Hong Kong Baptst Unversty, Kowloon Tong, Hong Kong b Dept. of Computng and Software, McMaster Unv.,

More information

7. Products and matrix elements

7. Products and matrix elements 7. Products and matrx elements 1 7. Products and matrx elements Based on the propertes of group representatons, a number of useful results can be derved. Consder a vector space V wth an nner product ψ

More information

Bézier curves. Michael S. Floater. September 10, These notes provide an introduction to Bézier curves. i=0

Bézier curves. Michael S. Floater. September 10, These notes provide an introduction to Bézier curves. i=0 Bézer curves Mchael S. Floater September 1, 215 These notes provde an ntroducton to Bézer curves. 1 Bernsten polynomals Recall that a real polynomal of a real varable x R, wth degree n, s a functon of

More information

Lecture 4: Constant Time SVD Approximation

Lecture 4: Constant Time SVD Approximation Spectral Algorthms and Representatons eb. 17, Mar. 3 and 8, 005 Lecture 4: Constant Tme SVD Approxmaton Lecturer: Santosh Vempala Scrbe: Jangzhuo Chen Ths topc conssts of three lectures 0/17, 03/03, 03/08),

More information

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 493 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces you have studed thus far n the text are real vector spaces because the scalars

More information

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b Int J Contemp Math Scences, Vol 3, 28, no 17, 819-827 A New Refnement of Jacob Method for Soluton of Lnear System Equatons AX=b F Naem Dafchah Department of Mathematcs, Faculty of Scences Unversty of Gulan,

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

The exponential map of GL(N)

The exponential map of GL(N) The exponental map of GLN arxv:hep-th/9604049v 9 Apr 996 Alexander Laufer Department of physcs Unversty of Konstanz P.O. 5560 M 678 78434 KONSTANZ Aprl 9, 996 Abstract A fnte expanson of the exponental

More information

Quantum Mechanics I - Session 4

Quantum Mechanics I - Session 4 Quantum Mechancs I - Sesson 4 Aprl 3, 05 Contents Operators Change of Bass 4 3 Egenvectors and Egenvalues 5 3. Denton....................................... 5 3. Rotaton n D....................................

More information

5 The Rational Canonical Form

5 The Rational Canonical Form 5 The Ratonal Canoncal Form Here p s a monc rreducble factor of the mnmum polynomal m T and s not necessarly of degree one Let F p denote the feld constructed earler n the course, consstng of all matrces

More information

Linear Algebra and its Applications

Linear Algebra and its Applications Lnear Algebra and ts Applcatons 4 (00) 5 56 Contents lsts avalable at ScenceDrect Lnear Algebra and ts Applcatons journal homepage: wwwelsevercom/locate/laa Notes on Hlbert and Cauchy matrces Mroslav Fedler

More information

On Finite Rank Perturbation of Diagonalizable Operators

On Finite Rank Perturbation of Diagonalizable Operators Functonal Analyss, Approxmaton and Computaton 6 (1) (2014), 49 53 Publshed by Faculty of Scences and Mathematcs, Unversty of Nš, Serba Avalable at: http://wwwpmfnacrs/faac On Fnte Rank Perturbaton of Dagonalzable

More information

Lecture 3. Ax x i a i. i i

Lecture 3. Ax x i a i. i i 18.409 The Behavor of Algorthms n Practce 2/14/2 Lecturer: Dan Spelman Lecture 3 Scrbe: Arvnd Sankar 1 Largest sngular value In order to bound the condton number, we need an upper bound on the largest

More information

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 13

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 13 CME 30: NUMERICAL LINEAR ALGEBRA FALL 005/06 LECTURE 13 GENE H GOLUB 1 Iteratve Methods Very large problems (naturally sparse, from applcatons): teratve methods Structured matrces (even sometmes dense,

More information

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens THE CHINESE REMAINDER THEOREM KEITH CONRAD We should thank the Chnese for ther wonderful remander theorem. Glenn Stevens 1. Introducton The Chnese remander theorem says we can unquely solve any par of

More information

Math 217 Fall 2013 Homework 2 Solutions

Math 217 Fall 2013 Homework 2 Solutions Math 17 Fall 013 Homework Solutons Due Thursday Sept. 6, 013 5pm Ths homework conssts of 6 problems of 5 ponts each. The total s 30. You need to fully justfy your answer prove that your functon ndeed has

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Foundations of Arithmetic

Foundations of Arithmetic Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an

More information

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 ) Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

1 GSW Iterative Techniques for y = Ax

1 GSW Iterative Techniques for y = Ax 1 for y = A I m gong to cheat here. here are a lot of teratve technques that can be used to solve the general case of a set of smultaneous equatons (wrtten n the matr form as y = A), but ths chapter sn

More information

Prof. Dr. I. Nasser Phys 630, T Aug-15 One_dimensional_Ising_Model

Prof. Dr. I. Nasser Phys 630, T Aug-15 One_dimensional_Ising_Model EXACT OE-DIMESIOAL ISIG MODEL The one-dmensonal Isng model conssts of a chan of spns, each spn nteractng only wth ts two nearest neghbors. The smple Isng problem n one dmenson can be solved drectly n several

More information

C/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1

C/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1 C/CS/Phy9 Problem Set 3 Solutons Out: Oct, 8 Suppose you have two qubts n some arbtrary entangled state ψ You apply the teleportaton protocol to each of the qubts separately What s the resultng state obtaned

More information

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS) Some Comments on Acceleratng Convergence of Iteratve Sequences Usng Drect Inverson of the Iteratve Subspace (DIIS) C. Davd Sherrll School of Chemstry and Bochemstry Georga Insttute of Technology May 1998

More information

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem. prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove

More information

NOTES ON SIMPLIFICATION OF MATRICES

NOTES ON SIMPLIFICATION OF MATRICES NOTES ON SIMPLIFICATION OF MATRICES JONATHAN LUK These notes dscuss how to smplfy an (n n) matrx In partcular, we expand on some of the materal from the textbook (wth some repetton) Part of the exposton

More information

PARTICIPATION FACTOR IN MODAL ANALYSIS OF POWER SYSTEMS STABILITY

PARTICIPATION FACTOR IN MODAL ANALYSIS OF POWER SYSTEMS STABILITY POZNAN UNIVE RSITY OF TE CHNOLOGY ACADE MIC JOURNALS No 86 Electrcal Engneerng 6 Volodymyr KONOVAL* Roman PRYTULA** PARTICIPATION FACTOR IN MODAL ANALYSIS OF POWER SYSTEMS STABILITY Ths paper provdes a

More information

2.5 Iterative Improvement of a Solution to Linear Equations

2.5 Iterative Improvement of a Solution to Linear Equations 2.5 Iteratve Improvement of a Soluton to Lnear Equatons 47 Dahlqust, G., and Bjorck, A. 1974, Numercal Methods (Englewood Clffs, NJ: Prentce-Hall), Example 5.4.3, p. 166. Ralston, A., and Rabnowtz, P.

More information

form, and they present results of tests comparng the new algorthms wth other methods. Recently, Olschowka & Neumaer [7] ntroduced another dea for choo

form, and they present results of tests comparng the new algorthms wth other methods. Recently, Olschowka & Neumaer [7] ntroduced another dea for choo Scalng and structural condton numbers Arnold Neumaer Insttut fur Mathematk, Unverstat Wen Strudlhofgasse 4, A-1090 Wen, Austra emal: neum@cma.unve.ac.at revsed, August 1996 Abstract. We ntroduce structural

More information

1 Matrix representations of canonical matrices

1 Matrix representations of canonical matrices 1 Matrx representatons of canoncal matrces 2-d rotaton around the orgn: ( ) cos θ sn θ R 0 = sn θ cos θ 3-d rotaton around the x-axs: R x = 1 0 0 0 cos θ sn θ 0 sn θ cos θ 3-d rotaton around the y-axs:

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

332600_08_1.qxp 4/17/08 11:29 AM Page 481

332600_08_1.qxp 4/17/08 11:29 AM Page 481 336_8_.qxp 4/7/8 :9 AM Page 48 8 Complex Vector Spaces 8. Complex Numbers 8. Conjugates and Dvson of Complex Numbers 8.3 Polar Form and DeMovre s Theorem 8.4 Complex Vector Spaces and Inner Products 8.5

More information

2 More examples with details

2 More examples with details Physcs 129b Lecture 3 Caltech, 01/15/19 2 More examples wth detals 2.3 The permutaton group n = 4 S 4 contans 4! = 24 elements. One s the dentty e. Sx of them are exchange of two objects (, j) ( to j and

More information

THE SUMMATION NOTATION Ʃ

THE SUMMATION NOTATION Ʃ Sngle Subscrpt otaton THE SUMMATIO OTATIO Ʃ Most of the calculatons we perform n statstcs are repettve operatons on lsts of numbers. For example, we compute the sum of a set of numbers, or the sum of the

More information

ECEN 5005 Crystals, Nanocrystals and Device Applications Class 19 Group Theory For Crystals

ECEN 5005 Crystals, Nanocrystals and Device Applications Class 19 Group Theory For Crystals ECEN 5005 Crystals, Nanocrystals and Devce Applcatons Class 9 Group Theory For Crystals Dee Dagram Radatve Transton Probablty Wgner-Ecart Theorem Selecton Rule Dee Dagram Expermentally determned energy

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information

On the Interval Zoro Symmetric Single-step Procedure for Simultaneous Finding of Polynomial Zeros

On the Interval Zoro Symmetric Single-step Procedure for Simultaneous Finding of Polynomial Zeros Appled Mathematcal Scences, Vol. 5, 2011, no. 75, 3693-3706 On the Interval Zoro Symmetrc Sngle-step Procedure for Smultaneous Fndng of Polynomal Zeros S. F. M. Rusl, M. Mons, M. A. Hassan and W. J. Leong

More information

Integrals and Invariants of Euler-Lagrange Equations

Integrals and Invariants of Euler-Lagrange Equations Lecture 16 Integrals and Invarants of Euler-Lagrange Equatons ME 256 at the Indan Insttute of Scence, Bengaluru Varatonal Methods and Structural Optmzaton G. K. Ananthasuresh Professor, Mechancal Engneerng,

More information

Chat eld, C. and A.J.Collins, Introduction to multivariate analysis. Chapman & Hall, 1980

Chat eld, C. and A.J.Collins, Introduction to multivariate analysis. Chapman & Hall, 1980 MT07: Multvarate Statstcal Methods Mke Tso: emal mke.tso@manchester.ac.uk Webpage for notes: http://www.maths.manchester.ac.uk/~mkt/new_teachng.htm. Introducton to multvarate data. Books Chat eld, C. and

More information

A Local Variational Problem of Second Order for a Class of Optimal Control Problems with Nonsmooth Objective Function

A Local Variational Problem of Second Order for a Class of Optimal Control Problems with Nonsmooth Objective Function A Local Varatonal Problem of Second Order for a Class of Optmal Control Problems wth Nonsmooth Objectve Functon Alexander P. Afanasev Insttute for Informaton Transmsson Problems, Russan Academy of Scences,

More information

arxiv: v2 [math.na] 21 Sep 2015

arxiv: v2 [math.na] 21 Sep 2015 Forward stable eigenvalue decomposition of rank-one modifications of diagonal matrices arxiv:1405.7537v2 [math.na] 21 Sep 2015 N. Jakovčević Stor a,1,, I. Slapničar a,1, J. L. Barlow b,2 a Faculty of Electrical

More information

Appendix for Causal Interaction in Factorial Experiments: Application to Conjoint Analysis

Appendix for Causal Interaction in Factorial Experiments: Application to Conjoint Analysis A Appendx for Causal Interacton n Factoral Experments: Applcaton to Conjont Analyss Mathematcal Appendx: Proofs of Theorems A. Lemmas Below, we descrbe all the lemmas, whch are used to prove the man theorems

More information

A combinatorial problem associated with nonograms

A combinatorial problem associated with nonograms A combnatoral problem assocated wth nonograms Jessca Benton Ron Snow Nolan Wallach March 21, 2005 1 Introducton. Ths work was motvated by a queston posed by the second named author to the frst named author

More information

10-801: Advanced Optimization and Randomized Methods Lecture 2: Convex functions (Jan 15, 2014)

10-801: Advanced Optimization and Randomized Methods Lecture 2: Convex functions (Jan 15, 2014) 0-80: Advanced Optmzaton and Randomzed Methods Lecture : Convex functons (Jan 5, 04) Lecturer: Suvrt Sra Addr: Carnege Mellon Unversty, Sprng 04 Scrbes: Avnava Dubey, Ahmed Hefny Dsclamer: These notes

More information

arxiv: v1 [math.co] 12 Sep 2014

arxiv: v1 [math.co] 12 Sep 2014 arxv:1409.3707v1 [math.co] 12 Sep 2014 On the bnomal sums of Horadam sequence Nazmye Ylmaz and Necat Taskara Department of Mathematcs, Scence Faculty, Selcuk Unversty, 42075, Campus, Konya, Turkey March

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

On the correction of the h-index for career length

On the correction of the h-index for career length 1 On the correcton of the h-ndex for career length by L. Egghe Unverstet Hasselt (UHasselt), Campus Depenbeek, Agoralaan, B-3590 Depenbeek, Belgum 1 and Unverstet Antwerpen (UA), IBW, Stadscampus, Venusstraat

More information

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity Week3, Chapter 4 Moton n Two Dmensons Lecture Quz A partcle confned to moton along the x axs moves wth constant acceleraton from x =.0 m to x = 8.0 m durng a 1-s tme nterval. The velocty of the partcle

More information

MATH Sensitivity of Eigenvalue Problems

MATH Sensitivity of Eigenvalue Problems MATH 537- Senstvty of Egenvalue Problems Prelmnares Let A be an n n matrx, and let λ be an egenvalue of A, correspondngly there are vectors x and y such that Ax = λx and y H A = λy H Then x s called A

More information

An efficient algorithm for multivariate Maclaurin Newton transformation

An efficient algorithm for multivariate Maclaurin Newton transformation Annales UMCS Informatca AI VIII, 2 2008) 5 14 DOI: 10.2478/v10065-008-0020-6 An effcent algorthm for multvarate Maclaurn Newton transformaton Joanna Kapusta Insttute of Mathematcs and Computer Scence,

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Advanced Quantum Mechanics

Advanced Quantum Mechanics Advanced Quantum Mechancs Rajdeep Sensarma! sensarma@theory.tfr.res.n ecture #9 QM of Relatvstc Partcles Recap of ast Class Scalar Felds and orentz nvarant actons Complex Scalar Feld and Charge conjugaton

More information

A new construction of 3-separable matrices via an improved decoding of Macula s construction

A new construction of 3-separable matrices via an improved decoding of Macula s construction Dscrete Optmzaton 5 008 700 704 Contents lsts avalable at ScenceDrect Dscrete Optmzaton journal homepage: wwwelsevercom/locate/dsopt A new constructon of 3-separable matrces va an mproved decodng of Macula

More information

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng

More information