Computation of Kronecker-like forms of periodic matrix pairs

Size: px
Start display at page:

Download "Computation of Kronecker-like forms of periodic matrix pairs"

Transcription

1 Symp. on Mathematical Theory of Networs and Systems, Leuven, Belgium, July 5-9, 2004 Computation of Kronecer-lie forms of periodic matrix pairs A. Varga German Aerospace Center DLR - berpfaffenhofen Institute of Robotics and Mechatronics D Wessling, Germany. Andras.Varga@dlr.de Abstract We propose a computationally efficient and numerically reliable algorithm to compute Kronecerlie forms of periodic matrix pairs. The eigenvalues and Kronecer indices are defined via the Kronecer structure of an associated lifted matrix pencil. The proposed reduction method relies on structure preserving manipulations of this pencil to extract successively lower complexity subpencils which contains the finite and infinite eigenvalues as well as the left and right Kronecer structures. The new algorithm uses exclusively orthogonal transformations and for the overall reduction the bacward numerical stability can be proved. 1 Introduction The invariants of a matrix pencil A ze under strict equivalence transformation are contained in the Kronecer canonical form (KCF) of this pencil 3. Specifically, it is possible to find two invertible matrices Q and Z such that Q(A ze)z = diag {J f zi, I zj, L ɛ1,..., L ɛs, L T η 1,..., L T η t } (1) where J f and J are in Jordan form with J nilpotent, and L is the bidiagonal matrix pencil of dimension ( + 1): z 1 z 1 L = z 1 The matrices J f and J describes the finite and infinite eigenvalues, respectively, while the index sets {ɛ i, i = 1,..., s} and {η j, j = 1,..., t} are the right and left minimal indices of A ze, respectively. 1

2 To compute these structural invariants, generally there is no need to compute the KCF, (this would involve using possibly ill-conditioned transformations), but it is possible to determine, using exclusively orthogonal transformations, so-called Kronecer-lie forms (KLFs) which contain a part or the complete information on the structural invariants. For example, using two orthogonal transformation matrices Q and Z, we can determine using the method of 10 the KLF Q(A ze)z = B r A r ze r A ze A f ze f A l ze l C l where: (1) the pair (A r ze r, B r ) is controllable with E r invertible; (2) the pair (C l, A l ze l ) is observable with E l invertible; (3) A ze, with A invertible and E nilpotent, contains the infinite eigenvalues; and (4) A f ze f, with E f invertible, contains the finite eigenvalues. Since the subpencils A B r A r ze r and l ze l are obtained in special staircase forms, the left and right Kronecer C l indices can be easily deduced from the dimensions of the full-row ran and full-column ran diagonal blocs of these subpencils, respectively. The subpencil A ze is also in a special staircase form and the dimensions of the diagonal blocs of E determines the multiplicity of infinite eigenvalues. Similar algorithms to compute KLFs have been proposed in 8, 1, 2, 6. These algorithms mainly differ by their computational complexities (i.e., (n 3 ) or (n 4 ), where n represents the maximal dimension of A and E), the shape of the resulting submatrices, and the employed ran determination strategies. Let S R µ ν and T R µ ν +1 be periodic matrices with period N 1. The index can be freely associated with a time instant and thus the matrices S and T can also be interpreted as periodically time-varying matrices. Note that the dimensions of these matrices are time-varying as well. The time related interpretation is especially relevant in connection with linear periodic discrete-time systems where many structural analysis problems can be formulated in terms of periodic matrix pairs 16. In this paper we extend the structural invariant concepts for linear pencils to study analogous structural invariants of a periodic matrix pair (S, T ) under periodic similarity transformations. Two N- periodic pairs (S, T ) and ( S, T ) are equivalent if there exist invertible N-periodic matrices Q and Z such that S = Q S Z, T = Q T Z +1 (2) The transformation (2) is called a periodic similarity transformation. We propose an algorithm to determine orthogonal periodic transformation matrices Q and Z such that B r A r E r A Q S Z = A f A l, Q E T Z +1 = E f E l (3) C l 2

3 where: (a) E r is invertible and the periodic pair ( (E r ) 1 A r, (Er ) 1 B r ) is completely reachable; (b) E l is invertible and the periodic pair ( C l, (El ) 1 A l ) is completely observable; (c) A is invertible and the product (A ) 1 E... (A +N 1 ) 1 E+N 1 is nilpotent; and (d) E f is non-singular. In (3), Q S Z and Q T Z +1 have the same row partition which however generally depends on. For a fixed column partitioning of Q S Z, the corresponding column partitioning of Q T Z +1 is uniquely determined by the conditions (a)-(d) above. As we will show in the next section, the periodic pair (A, E ) specifies the structure at infinity of an associated lifted pencil, while the pair (Af, Ef ) specifies its finite structure. Similarly, the periodic triples (A r, Er, Br ) and (Al, El, Cl ) specify the right and left Kronecer structure of this pencil, respectively. Notation. For an N-periodic matrix X i R m n we use alternatively the script notation X := diag (X, X +1,..., X +N 1 ), which associates the bloc-diagonal matrix X to the cyclic matrix sequence X i, i =,..., + N 1 starting at time moment. To simplify the notation for the case = 1, we drop the usage of index used for the matrices and dimensions. For an N-periodic matrix pair (A, E ) with A R n +1 n and E R n +1 n +1 invertible, we denote the n j n i generalized transition matrix Φ A,E (j, i) := Ej 1 1 A j 1Ej 2 1 A j 2 Ei 1 A i, where Φ A,E (i, i) := I ni. 2 Basic definitions and results Consider the lifted pencil at time associated with the periodic pair (S, T ) S T S +1 T +1 P (z) = S +N 2 T +N 2 zt +N 1 S +N 1 (4) This pencil represents a generalization to rectangular pairs with time-varying dimensions of the lifted pencil introduced in 4 to study periodic systems with constant state dimensions. The same lifting has been used in 16, 11 to define and compute the zeros of periodic descriptor systems using algorithms which exploits and respectively, preserve the special cyclic structure of the pencil P (z). The following definitions generalize corresponding notions for standard linear pencils. Definition 1 The finite eigenvalues at time moment of the N-periodic pair (S, T ) are the finite eigenvalues of the pencil P (z) in (4). 3

4 From the above definition it follows that the finite eigenvalues of the periodic pair (S, T ) are those values of z (counting multiplicities) where the ran of the lifted pencil P (z) drops below its normal ran. This definition generalizes the definition of characteristic multipliers of a single periodic matrix S R ν +1 ν (defined as the eigenvalues of the product S +N 1 S +1 S ). These are precisely the finite eigenvalues of the periodic pair (S, I ν+1 ). Definition 2 The infinite eigenvalues at time moment of the N-periodic pair (S, T ) are the infinite eigenvalues of the pencil P (z) in (4) excepting N 1 i=1 ran T +i 1 simple infinite eigenvalues. The infinite eigenvalues of P (z) include N 1 i=1 ran T +i 1 simple eigenvalues at of the pencil P (z) which originate from the lifting. These should not play any role when counting the true infinite eigenvalues, and therefore must be discarded from the total count. Since the multiplicities of infinite zeros of a pencil are by definition in excess one with respect to the multiplicities of infinite eigenvalues, we have the following simpler definition of zeros. Definition 3 The zeros (finite and infinite) at time moment of the N-periodic pair (S, T ) are the zeros of the pencil P (z) in (4). Definition 4 The left/right minimal indices at time moment of the N-periodic pair (S, T ) are the left/right minimal indices of the pencil P (z) in (4). Definition 5 The N-periodic pair (S, T ) is called regular if it has no left or right Kronecer indices. Using transformations as in (2) to reduce the periodic pair (S, T ) to the form (3) is equivalent to compute P (z) = Q P (z)z, where P (z) has the same cyclic structure as P (z). By using appropriate permutation matrices Π 1 and Π 2 we can reorder the blocs of P (z) such that Π 1 P (z)π 2 = P r(z) P (z) P f (z) P l(z) (5) with each nonzero bloc having the same cyclic structure as P (z). For example, the diagonal blocs have the form S x T x S+1 x T+1 x P x (z) = S+N 2 x T+N 2 x zt+n 1 x S+N 1 x 4

5 where the upper index x stays for r,, f, or l. For = 1,..., N, the submatrices of the diagonal subpencils of (5) have the structures S r := B r A r, T r := E r S := A, T := E S f := A f, T f := E f A S l l := E, T l l := C l The main issue when relating the eigenvalues and minimal indices of the reduced pair ( S, T ) in (3) to the structures of submatrices in (4) is to discard the simple infinite eigenvalues of the pencil P (z) which are introduced via the lifting. Provided the submatrices of reduced pair ( S, T ) in (3) satisfy the properties (a), (b), (c), (d), then we can easily prove the following results: Proposition 1 The finite eigenvalues at time moment of the N-periodic pair (S, T ) are the eigenvalues of the generalized monodromy matrix Φ A f,ef ( + N, ). Proposition 2 The infinite eigenvalues at time moment of the N-periodic pair (S, T ) are the generalized eigenvalues of P (z), excepting N 1 i=1 ran E +i 1 simple infinite eigenvalues. Proposition 3 The right minimal indices at time moment of the N-periodic pair (S, T ) are given by the right minimal indices of P r (z). Proposition 4 The left minimal indices at time moment of the N-periodic pair (S, T ) are given by the left minimal indices of P l (z). In what follows, we propose a computational approach which ensures by construction the properties (a), (b), (c), (d) of the submatrices of the reduced pair ( S, T ) in (3). We also show how the proposed algorithm allows to determine directly from the structures of the reduced matrices the left and right Kronecer minimal indices. 3 Computational approach In this section we propose a computational approach to determine the KLF (3) of a given periodic pair (S, T ). To simplify notation we describe only the computation for = 1, but the same algorithm is evidently applicable for arbitrary after a suitable permutation of the order of matrices. The proposed algorithm has several main steps, which we discuss in the subsequent subsections. 5

6 3.1 Computation of compressed form In the first step we reduce the problem to an equivalent one, but with a special structure of matrices. Let Q (1) and Z (1) be orthogonal periodic matrices such that S (1) := Q (1) S Z (1) B A = D C, T (1) := Q (1) T Z (1) +1 = E where, for = 1,..., N: E R n +1 n +1 is invertible, A R n +1 n, B R n +1 m, C R p n, D R p m, with m := ν n and p := µ n +1. The compression of each T to a non-singular E can be done by computing a full orthogonal decomposition Q (1) T V +1 = diag (E, ) using either the singular-value decomposition (SVD) or a ran-revealing QR-decomposition followed by an RQ-decomposition. Finally, the form in (6) is obtained by applying column permutations with an appropriate permutation matrix Π. For both ran determination techniques, we can freely assume that each resulting E is upper triangular. Define Z (1) = V Π. The pencil P (z) and the transformed pencil P (1) (z) = Q (1) P (z)z (1) corresponding to the reduced periodic pair (S (1), T (1) ) have the same Kronecer-canonical form, thus this pair has the same eigenvalues, as well as left and right minimal indices. Interestingly, the compressed pair, specified by the quintuple (E, A, B, C, D), defines a periodic descriptor system E x( + 1) = A x() + B u() (7) y() = C x() + D u() (6) where the input vector u(), state vector x() and output vector y() have in general time-varying dimensions. The system matrices E, A, B, C, and D have time-varying dimensions as well and E is invertible. Note that the original periodic pair (S, T ) frequently arises in an already compressed form when analyzing periodic systems properties Basic reduction The goal of this reduction step is to separate the right-infinite (r ) and finite-left (fl) structures of the compressed pencil P (1) (z). In this step we compute orthogonal periodic matrices Q (2) and Z (2) such that S (2) := Q (2) S(1) Z(2) = A r A fl, T (2) := Q (2) T (1) Z(2) E r +1 = where, for = 1,..., N, A r R mr nr is in a staircase form with full row ran matrices on its main diagonal, E r R mr nr +1 has the part formed from the trailing non-zero columns of fullcolumn ran, and A fl Rmfl nfl, and E fl Rmfl nfl +1 is upper trapezoidal and full column ran. For this separation, we can freely apply the Algorithm PS-REDUCE proposed in 11 to the compressed pair and accumulate the performed orthogonal transformation. This algorithm can be seen as an E fl (8) 6

7 extension of the standard pencil reduction technique of 5 to compute the finite eigenvalues of a compressed periodic pair. However, to achieve more symmetry in the structure at infinity, we propose an extension of the basic algorithm of 1 along the lines of improvements suggested in 6. The following basic reduction algorithm will be used repeatedly to identify and separate different structures of a compressed periodic pair: Algorithm BASIC REDUCTIN. For = 1,..., N: set m r step i = 0, n r = 0; set Q (2) = I µ, Z (2) = I ν. 1. For each = 1,..., K, compute (e.g., by performing the QR-decomposition with column pivoting on D ) an orthogonal matrix W and a permutation matrix Π such that B,1 B,2 A D,1 D,2 C,1 B A := diag (I n+1, W ) diag (Π D C C, I n ),,2 where D,1 R τ (i) (i) τ is invertible and upper-triangular. B,1 2. For each = 1,..., N, compress the rows of with orthogonal X such that B,11 B,12 A,1 B,22 A,2 D,1 := X B,1 B,2 A D,1 D,2 C,1, E,1 E,2 := X E with B,11 R τ (i) upper-triangular. (i) τ full row ran and upper-triangular and E,2 R n +1 n +1 invertible and 3. For = 1,..., N, determine orthogonal U to compress the rows of B,22 to a full row ran matrix B,22 such that U B,22 =, where B,22 R ρ(i) +1 (m τ (i) ) is of full row ran, and compute orthogonal V +1 such that U E,2 V +1 is upper triangular. 4. For = 1,..., N, form the transformation matrices ( ) ( Q = diag I (i) τ, U, I p τ (i) diag X, I p τ (i) Z = diag (Π, I n ) diag (I m, V ) and transform the submatrices and partition them as: τ (i) B,11 B,12 A,11 A,12 ρ (i) +1 B,22 A,21 A,22 n +1 ρ (i) +1 A,31 A,32 p τ (i) C,21 C,22 τ (i) m τ (i) ρ (i) n ρ (i) 7 ) diag ( I n+1, W ), := Q B A D C Z,

8 τ (i) ρ (i) +1 n +1 ρ (i) +1 p τ (i) E,11 E,12 E,21 E,22 E,32 τ (i) +1 m +1 τ (i) +1 ρ (i) +1 n +1 ρ (i) +1 := Q E Z +1, where: B,11 is invertible and upper triangular, B,22 is of full row ran, and E,21 and E,32 are invertible and upper triangular. 4. For = 1,..., N, update A := A,32, E := E,32, B := A,31, C := C,22, D := C,21. ( 5. For = 1,..., N, Q (2) := diag I m r, Q ) ( Q (2), Z(2) := Z (2) diag I n r, Z ). 6. For = 1,..., N, update m r := m r m := ρ (i), p := p τ (i). 7. If m = 0 for = 1,..., K, then go to exit 8. i := i + 1 go to step i; + ρ (i) +1 + τ (i), nr := n r + m, n := n ρ (i), exit Compute S (2) := Q (2) S(1) Z(2), T (2) := Q (2) T (1) Z(2) +1 and partition them according to (8). The computation stops when all B and D have null columns. The resulting periodic pair (A fl, Efl ) has the following form A fl = A, E fl C = E, (9) where A R (ν +1 n r +1 ) (ν n r and C R plf (ν n r ), where p lf ), E R (ν +1 n r +1 ) (ν +1 n r +1 ) is invertible and upper triangular, = (µ m r ) (ν +1 n r +1 ). Since the associated lifted pencil ) can have only has full column ran for almost all values of z (finite and infinite), the pair (A fl finite eigenvalues and/or left Kronecer structure. The compression at Step 2 can be done by performing a QR-decomposition of, Efl B,1 D,1 which exploits the upper triangular shape of D,1. This can be achieved by employing sequences of Givens transformations to zero successively elements under the diagonal of B,1. By starting from below (i.e., zeroing first the diagonal element of D,1 ) the upper triangular structure of E,2 is automatically achieved. For details see 6. The compression at Step 3 of B,22 to a full row ran matrix can be done simultaneously with maintaining E,2 upper triangular. This compression technique represents the main computational step in determining the periodic controllability staircase form of periodic descriptor systems (see 13 for more details). 8

9 T (2) At the end of Algorithm BASIC REDUCTIN we obtain globally the reduced matrices S (2) and in the form (8), where the periodic pair (A r, Er ) is in the following staircase form A r = A r ;1,1 A r ;1,2 A r ;1,l 1 A r ;2,2 A r ;2,l A r ;l 1,l 1 A r ;1,l A r ;2,l. A r ;l 1,l A r ;l,l E;1,2 r E;1,l 1 r E;1,l r E;2,l 1 r E;2,l r E r = E;l 1,l r where l is the number of steps performed by the algorithm, A r ;i,i R(ρ(i) +1 (i) +τ ) ρ(i 1) (10) (11) is of full row ran and E r +1 ) ρ(i) +1 is of full column ran. Since by construction the associated lifted pencil P r (z) has full row ran for all finite values of z, the pair (A r, Er ) has only infinite and/or right Kronecer structures. Furthermore, we have the following relations among the dimensions of the bloc ρ (i 1) +i 1 ρ(i) +i + τ (i) +i 1, i = 1,..., l ;i,i+1 R(ρ(i) +τ (i) 3.3 Separation of finite and left structures Let X be an m n matrix. Define the pertranspose of X as X P = J n X T J m, where J j is the j j permutation matrix J j = A possible approach to separate the finite and left structures of the periodic pair (A fl the Algorithm BASIC REDUCTIN to the dual pair (Ârf ) defined as, Êrf, Efl ) is to apply  rf = (Afl N +1 )P, = 1,..., N, Ê rf = (Efl N )P, = 1,..., N 1, Ẽ rf N = (Efl N )P Note that the dual pair (Ârf empty matrices., Êrf ) is already in a particular compressed form as in (6), with D and C 9

10 We perform the Algorithm BASIC REDUCTIN to the dual pair to obtain Q and Ẑ such that Br Q Â rf Ẑ = Â r, Q Ê rf Âf Ẑ+1 = Êr Êf where Êr and Êf are invertible and upper-triangular, and the matrices B r Âr and Êr are in staircase forms similar to (10) and (11), respectively. This separation is equivalent to the recently proposed algorithm to compute the periodic Kalman reachability decomposition of a periodic descriptor system of the form (7) with invertible E 13. By defining ( ) ( Q (3) := diag, ẐP N +1, Z (3) := diag, Q ) P N +1 I m r we obtain the matrices of the reduced pair (S (3), T (3) ) := (Q(3) A r S (3) := A f A l, T (3) := C l I n r S(3) Z(3), Q(3) T (2) Z(3) +1 E r E f E l ) in the form (12) where the pair (A f, Ef ) has only finite eigenvalues and the periodic pair ((El ) 1 A l, Cl ) is observable. Note that the above approach also ensures that both E f and El are upper triangular. Assume that the full row ran diagonal blocs of B r Âr (i) are ( ρ(i) +1 + τ ) ρ(i 1) matrices for i = 1,..., l l with τ (i) = 0, where ρ (0) = p lf is the row dimension of C in (9). The following result, which we give without proof, relates the bloc sizes of the computed staircase forms B l Âl to the left minimal Kronecer indices of P (z). Proposition 5 The index sets { ρ (i) }, i = 1,..., ll completely determines the left minimal Kronecer indices as follows: there are η (i) 1 η (i+1) 1 Kronecer blocs L T i 1, for i = 1, 2,..., where min{(i+1)n,l l } η (i) = ρ (j) j=in Separation of right and infinite structures A possible computational approach for this separation is to compress first the pair (A r A r B A = D C := U A r, E Er =, Er ) as := U E r (13) 10

11 by using appropriate orthogonal matrices U. These matrices can be determined from the QR-decomposition of the trailing non-zero columns of E r in (11). By exploiting the full column ran and the staircase structures of these matrices, this computation can be done efficiently. Then, we form the dual pair (à l ) defined as à l, Ẽ l = (A r N +1) P, = 1,..., N, Ẽ l = (E r N ) P, = 1,..., N 1, ẼN l = (Er N ) P and apply the Algorithm BASIC REDUCTIN to the dual compressed form to obtain the orthogonal transformation matrices Q and Z such that à Q à l Ẽ Z = à l, Q Ẽ l Z +1 = Ẽ l Cl where  and Êl are invertible and upper-triangular, and the matrices  and Ê are in staircase forms similar to (10) and (11), respectively. By defining Q (4) := diag ( ) ZP N +1 U, I µ m r,, Z (4) := diag ( ) QP N +1, I ν n r, we obtain the matrices of the reduced pair (S (4), T (4) ) := (Q(4) S(3) Z(4), Q(4) T (3) Z(4) +1 ) in the form (3), where the pair (A, E ) has only infinite eigenvalues and the periodic pair ( (E r) 1 A r, (Er ) 1 B) r is completely reachable. Note that the above approach also ensures that E r and A are upper triangular. To obtain B r, Ar in a staircase form lie (10), the Algorithm BASIC REDUCTIN must be applied once again to the particular compressed pair ( B r, Ar,, Er. We postulate the existence of a more efficient procedure without computational overheads (e.g., pertransposing) to determine directly the orthogonal matrices U and V which reduce the pair (A r, Er ) to the separated form U A r B V r = A r A, U E r E r V +1 = E where the matrices of both pairs ( B r, Ar,, Er and (A, E ) are in staircase forms. As basis for such a procedure could serve the Algorithms and in 1, suitably extended to exploit the fine structure of matrices A r and E r in (10) and (11), respectively. Assume that the full row ran diagonal blocs of B r Ar are (ρ(i) +1 + τ (i) ) ρ(i 1) matrices for i = 1,..., l with τ (i) = 0, where ρ (0) is the column dimension of B r. The following result, which we give without proof, relates the bloc sizes of the computed staircase forms B r Ar to the right minimal Kronecer indices of P (z). 11

12 Proposition 6 The index sets {ρ (i) }, i = 1,..., l completely determines the right minimal Kronecer indices as follows: there are ɛ (i) 1 ɛ(i+1) 1 Kronecer blocs L i 1, for i = 1, 2,..., where ɛ (i) min{(i+1)n,l} = j=in+1 A similar result relating the multiplicity of infinite eigenvalues to the bloc sizes is still open. 4 Numerical Aspects For the reduction of the periodic pair (S, T ) to the periodic KLF (3) we employed exclusively orthogonal transformations of the form (2), which can be applied as sequences of Householder and Givens transformations underlying the computation of several QR-decompositions, with or without column pivoting. Thus it possible to prove that the computed matrices in the KLF (3) are exact for slightly perturbed initial matrices S, T, which satisfy X X ε X X, ρ (j) X = S, T where, in each case, ε X is a modest multiple of the relative machine precision ε M. It follows that the proposed algorithm is bacward stable. Regarding the computational complexity of the proposed algorithm, we note that all reductions are performed N times on low order matrices, thus the overall computational complexity is proportional with N. To estimate the worst-case computational complexity in terms of problem dimensions, we assume constant dimensions µ and ν for S and T, and constant ran n of T. The computation of the compressed form (6) can be performed by using either SVD-based or ran-revealing QRdecomposition based reductions. This requires (N n(n + p)(n + m)) floating point operations (flops), where p = µ n and m = ν n. The ey computation in the proposed approach is the Algorithm BASIC REDUCTIN. The compressions of D, = 1,..., N at Step 1 can be done by computing successively N ran-revealing QR-decompositions of p m matrices and applying the transformation to n m sub-blocs. This reduction step, performed more than once for decreasing values of p, m and n, has a worst-case computational complexity of (N(n + m)pm). The compression at Step 2 and the application of transformations to the rest of matrices has a worst-case computational complexity of (N(n + p)(n + m)p). The compression performed at Step 3 and the application of transformations is the only critical computation of the proposed approach. Note that by just computing V +1 such that U E,2 V +1 is upper triangular is an operation of complexity (n 3 ). This would mae the overall worst-case complexity to maintain E,2 upper triangular for = 1,..., N to become (Nn 4 ). To avoid this, we can perform the compression of B,22 with U and restoring the upper-triangular form of U E,2 simultaneously, by employing Givens rotations. The reduction technique is entirely similar to that independently developed in 1 and 9. Using this approach, this computation has per iteration step a complexity at most (Nηn 2 ), where η is small compared to n. Thus, the overall complexity of the compression-restoring algorithm is (Nn 3 ). Summing up, the Algorithm BASIC REDUCTIN has a worst-case complexity which can be bounded by (N(p + n)(m + n)n). 12

13 5 CNCLUSIN We developed a numerically bacward stable algorithm to reduce periodic matrix pairs to Kronecerlie forms. The proposed algorithm allows to determine directly from the structures of the reduced matrices the main Kronecer invariants of the associated lifted pencil. The new algorithm wors in the most general setting of periodic matrix pairs with time-varying dimensions. Two ey features of this algorithm are: 1) a satisfactory worst-case computational complexity, which is linear in the period N and cubic in the maximum dimension of the blocs; and 2) bacward numerical stability achieved by employing exclusively reductions based on orthogonal transformations. According to the requirements we formulated in 15, this is a satisfactory algorithm, well-suited for robust software implementations. The proposed algorithm has many useful potential applications in the area of analysis and design of multirate and periodic systems. Some examples where the periodic KLF can play a ey role are: computation of system zeros and Kronecer structure, computation of generalized periodic reachability/observability decompositions, finite-infinite additive decomposition, computation of generalized inverses of periodic systems 12, computation of left/right annihilators 14, solution of periodic model matching problems, design of fault detectors for periodic systems 14, etc. The proposed algorithm appears to be equivalent with a recently proposed algorithm to compute a regularizing decomposition for cycles of linear mappings 7, Theorem 6.1. When applied to the following quiver representation of the periodic pair (S, T ) S V 1 T 1 1 S W1 2 T V2 2 T N 1 W2... V N S N WN T N V1 where V and W are respectively, ν and µ dimensional vector spaces, the algorithm of 7 produces via appropriate basis changes, a decomposition of the underlying matrices as a direct sum of elementary canonical constituents. Although both algorithms can produce similar decompositions, establishing an exact equivalence between the structural information determined by the two algorithms is not straightforward. While the algorithm of 7 appears to be rather a conceptual procedure useful mainly for the classification theory of cycles of linear mappings, the algorithm proposed in this paper is a practical approach, directly implementable using existing linear algebra tools. Moreover, the structural information obtained with our approach has a strong system theory relevant interpretation, being useful in addressing several applications of periodic systems (see above), without the need to build the associated lifted representation. Acnowledgement The wor of the author has been performed in the framewor of the Swedish Strategic Research Foundation Grant Matrix Pencil Computations in Computer-Aided Control System Design: Theory, Algorithms and Software Tools. The author thans to the anonymous reviewer for his careful reading of the paper and for the hint to reference 7. 13

14 References 1 T. Beelen and P. Van Dooren. An improved algorithm for the computation of Kronecer s canonical form of a singular pencil. Lin. Alg. & Appl., 105:9 65, J. Demmel and B. Kågström. The generalized Schur decomposition of an arbitrary pencil A λb: robust software with error bounds and applications. Part I: Theory and algorithms. Part I: Software and applications. TMS, 19: , , F. R. Gantmacher. Theory of Matrices, volume 2. Chelsea, New Yor, M. Grasselli and S. Longhi. Finite zero structure of linear periodic discrete-time systems. Int. J. Systems Sci., 22: , P. Misra, P. Van Dooren, and A. Varga. Computation of structural invariants of generalized statespace systems. Automatica, 30: , C. ară and P. Van Dooren. An improved algorithm for the computation of structural invariants of a system pencil and related geometric aspects. Systems & Control Lett., 30:39 48, V. V. Sergeichu. Computation of canonical matrices for chains and cycles of linear mappings. Lin. Alg. & Appl., 376: , P. Van Dooren. The computation of Kronecer s canonical form of a singular pencil. Lin. Alg. & Appl., 27: , A. Varga. Computation of irreducible generalized state-space realizations. Kybernetia, 26:89 106, A. Varga. Computation of Kronecer-lie forms of a system pencil: Applications, algorithms and software. Proc. CACSD 96 Symposium, Dearborn, MI, pp , A. Varga. Strongly stable algorithm for computing periodic system zeros. Proc. of CDC 2003, Maui, Hawaii, A. Varga. Computation of generalized inverses of periodic systems. (submitted to CDC 2004). 13 A. Varga. Computation of Kalman decompositions of periodic systems. European Journal of Control, 10, 2004 (to appear). 14 A. Varga. Design of fault detection filters for periodic systems. (submitted to CDC 2004). 15 A. Varga and P. Van Dooren. Computational methods for periodic systems - an overview. Proc. of IFAC Worshop on Periodic Control Systems, Como, Italy, pp , A. Varga and P. Van Dooren. Computing the zeros of periodic descriptor systems. Systems & Control Lett., 50:371381,

arxiv: v1 [cs.sy] 29 Dec 2018

arxiv: v1 [cs.sy] 29 Dec 2018 ON CHECKING NULL RANK CONDITIONS OF RATIONAL MATRICES ANDREAS VARGA Abstract. In this paper we discuss possible numerical approaches to reliably check the rank condition rankg(λ) = 0 for a given rational

More information

Computing generalized inverse systems using matrix pencil methods

Computing generalized inverse systems using matrix pencil methods Computing generalized inverse systems using matrix pencil methods A. Varga German Aerospace Center DLR - Oberpfaffenhofen Institute of Robotics and Mechatronics D-82234 Wessling, Germany. Andras.Varga@dlr.de

More information

Key words. Polynomial matrices, Toeplitz matrices, numerical linear algebra, computer-aided control system design.

Key words. Polynomial matrices, Toeplitz matrices, numerical linear algebra, computer-aided control system design. BLOCK TOEPLITZ ALGORITHMS FOR POLYNOMIAL MATRIX NULL-SPACE COMPUTATION JUAN CARLOS ZÚÑIGA AND DIDIER HENRION Abstract In this paper we present new algorithms to compute the minimal basis of the nullspace

More information

Parallel Singular Value Decomposition. Jiaxing Tan

Parallel Singular Value Decomposition. Jiaxing Tan Parallel Singular Value Decomposition Jiaxing Tan Outline What is SVD? How to calculate SVD? How to parallelize SVD? Future Work What is SVD? Matrix Decomposition Eigen Decomposition A (non-zero) vector

More information

Descriptor system techniques in solving H 2 -optimal fault detection problems

Descriptor system techniques in solving H 2 -optimal fault detection problems Descriptor system techniques in solving H 2 -optimal fault detection problems Andras Varga German Aerospace Center (DLR) DAE 10 Workshop Banff, Canada, October 25-29, 2010 Outline approximate fault detection

More information

Solving projected generalized Lyapunov equations using SLICOT

Solving projected generalized Lyapunov equations using SLICOT Solving projected generalized Lyapunov equations using SLICOT Tatjana Styel Abstract We discuss the numerical solution of projected generalized Lyapunov equations. Such equations arise in many control

More information

Optimal Scaling of Companion Pencils for the QZ-Algorithm

Optimal Scaling of Companion Pencils for the QZ-Algorithm Optimal Scaling of Companion Pencils for the QZ-Algorithm D Lemonnier, P Van Dooren 1 Introduction Computing roots of a monic polynomial may be done by computing the eigenvalues of the corresponding companion

More information

THE STABLE EMBEDDING PROBLEM

THE STABLE EMBEDDING PROBLEM THE STABLE EMBEDDING PROBLEM R. Zavala Yoé C. Praagman H.L. Trentelman Department of Econometrics, University of Groningen, P.O. Box 800, 9700 AV Groningen, The Netherlands Research Institute for Mathematics

More information

Robust and Minimum Norm Pole Assignment with Periodic State Feedback

Robust and Minimum Norm Pole Assignment with Periodic State Feedback IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 45, NO 5, MAY 2000 1017 Robust and Minimum Norm Pole Assignment with Periodic State Feedback Andras Varga Abstract A computational approach is proposed to solve

More information

A Fast Implicit QR Eigenvalue Algorithm for Companion Matrices

A Fast Implicit QR Eigenvalue Algorithm for Companion Matrices A Fast Implicit QR Eigenvalue Algorithm for Companion Matrices D. A. Bini a,1 P. Boito a,1 Y. Eidelman b L. Gemignani a,1 I. Gohberg b a Dipartimento di Matematica, Università di Pisa, Largo Bruno Pontecorvo

More information

EIGENVALUE PROBLEMS. EIGENVALUE PROBLEMS p. 1/4

EIGENVALUE PROBLEMS. EIGENVALUE PROBLEMS p. 1/4 EIGENVALUE PROBLEMS EIGENVALUE PROBLEMS p. 1/4 EIGENVALUE PROBLEMS p. 2/4 Eigenvalues and eigenvectors Let A C n n. Suppose Ax = λx, x 0, then x is a (right) eigenvector of A, corresponding to the eigenvalue

More information

Preliminary/Qualifying Exam in Numerical Analysis (Math 502a) Spring 2012

Preliminary/Qualifying Exam in Numerical Analysis (Math 502a) Spring 2012 Instructions Preliminary/Qualifying Exam in Numerical Analysis (Math 502a) Spring 2012 The exam consists of four problems, each having multiple parts. You should attempt to solve all four problems. 1.

More information

A COMPUTATIONAL APPROACH FOR OPTIMAL PERIODIC OUTPUT FEEDBACK CONTROL

A COMPUTATIONAL APPROACH FOR OPTIMAL PERIODIC OUTPUT FEEDBACK CONTROL A COMPUTATIONAL APPROACH FOR OPTIMAL PERIODIC OUTPUT FEEDBACK CONTROL A Varga and S Pieters DLR - Oberpfaffenhofen German Aerospace Research Establishment Institute for Robotics and System Dynamics POB

More information

On the application of different numerical methods to obtain null-spaces of polynomial matrices. Part 1: block Toeplitz algorithms.

On the application of different numerical methods to obtain null-spaces of polynomial matrices. Part 1: block Toeplitz algorithms. On the application of different numerical methods to obtain null-spaces of polynomial matrices. Part 1: block Toeplitz algorithms. J.C. Zúñiga and D. Henrion Abstract Four different algorithms are designed

More information

Krylov Techniques for Model Reduction of Second-Order Systems

Krylov Techniques for Model Reduction of Second-Order Systems Krylov Techniques for Model Reduction of Second-Order Systems A Vandendorpe and P Van Dooren February 4, 2004 Abstract The purpose of this paper is to present a Krylov technique for model reduction of

More information

Computation of transfer function matrices of periodic systems

Computation of transfer function matrices of periodic systems INT J CONTROL,, VOL 6, NO 1, 11 1 Computation of transfer function matrices of periodic systems A VARGAy We present a numerical approach to evaluate the transfer function matrices of a periodic system

More information

Numerical Methods in Matrix Computations

Numerical Methods in Matrix Computations Ake Bjorck Numerical Methods in Matrix Computations Springer Contents 1 Direct Methods for Linear Systems 1 1.1 Elements of Matrix Theory 1 1.1.1 Matrix Algebra 2 1.1.2 Vector Spaces 6 1.1.3 Submatrices

More information

Solving large scale eigenvalue problems

Solving large scale eigenvalue problems arge scale eigenvalue problems, Lecture 4, March 14, 2018 1/41 Lecture 4, March 14, 2018: The QR algorithm http://people.inf.ethz.ch/arbenz/ewp/ Peter Arbenz Computer Science Department, ETH Zürich E-mail:

More information

CANONICAL LOSSLESS STATE-SPACE SYSTEMS: STAIRCASE FORMS AND THE SCHUR ALGORITHM

CANONICAL LOSSLESS STATE-SPACE SYSTEMS: STAIRCASE FORMS AND THE SCHUR ALGORITHM CANONICAL LOSSLESS STATE-SPACE SYSTEMS: STAIRCASE FORMS AND THE SCHUR ALGORITHM Ralf L.M. Peeters Bernard Hanzon Martine Olivi Dept. Mathematics, Universiteit Maastricht, P.O. Box 616, 6200 MD Maastricht,

More information

MATLAB TOOLS FOR SOLVING PERIODIC EIGENVALUE PROBLEMS 1

MATLAB TOOLS FOR SOLVING PERIODIC EIGENVALUE PROBLEMS 1 MATLAB TOOLS FOR SOLVING PERIODIC EIGENVALUE PROBLEMS 1 Robert Granat Bo Kågström Daniel Kressner,2 Department of Computing Science and HPC2N, Umeå University, SE-90187 Umeå, Sweden. {granat,bokg,kressner}@cs.umu.se

More information

Index. for generalized eigenvalue problem, butterfly form, 211

Index. for generalized eigenvalue problem, butterfly form, 211 Index ad hoc shifts, 165 aggressive early deflation, 205 207 algebraic multiplicity, 35 algebraic Riccati equation, 100 Arnoldi process, 372 block, 418 Hamiltonian skew symmetric, 420 implicitly restarted,

More information

A Backward Stable Hyperbolic QR Factorization Method for Solving Indefinite Least Squares Problem

A Backward Stable Hyperbolic QR Factorization Method for Solving Indefinite Least Squares Problem A Backward Stable Hyperbolic QR Factorization Method for Solving Indefinite Least Suares Problem Hongguo Xu Dedicated to Professor Erxiong Jiang on the occasion of his 7th birthday. Abstract We present

More information

Conceptual Questions for Review

Conceptual Questions for Review Conceptual Questions for Review Chapter 1 1.1 Which vectors are linear combinations of v = (3, 1) and w = (4, 3)? 1.2 Compare the dot product of v = (3, 1) and w = (4, 3) to the product of their lengths.

More information

ON THE QR ITERATIONS OF REAL MATRICES

ON THE QR ITERATIONS OF REAL MATRICES Unspecified Journal Volume, Number, Pages S????-????(XX- ON THE QR ITERATIONS OF REAL MATRICES HUAJUN HUANG AND TIN-YAU TAM Abstract. We answer a question of D. Serre on the QR iterations of a real matrix

More information

Review Questions REVIEW QUESTIONS 71

Review Questions REVIEW QUESTIONS 71 REVIEW QUESTIONS 71 MATLAB, is [42]. For a comprehensive treatment of error analysis and perturbation theory for linear systems and many other problems in linear algebra, see [126, 241]. An overview of

More information

Numerically Stable Cointegration Analysis

Numerically Stable Cointegration Analysis Numerically Stable Cointegration Analysis Jurgen A. Doornik Nuffield College, University of Oxford, Oxford OX1 1NF R.J. O Brien Department of Economics University of Southampton November 3, 2001 Abstract

More information

Practical Linear Algebra: A Geometry Toolbox

Practical Linear Algebra: A Geometry Toolbox Practical Linear Algebra: A Geometry Toolbox Third edition Chapter 12: Gauss for Linear Systems Gerald Farin & Dianne Hansford CRC Press, Taylor & Francis Group, An A K Peters Book www.farinhansford.com/books/pla

More information

Index. book 2009/5/27 page 121. (Page numbers set in bold type indicate the definition of an entry.)

Index. book 2009/5/27 page 121. (Page numbers set in bold type indicate the definition of an entry.) page 121 Index (Page numbers set in bold type indicate the definition of an entry.) A absolute error...26 componentwise...31 in subtraction...27 normwise...31 angle in least squares problem...98,99 approximation

More information

OPTIMAL SCALING FOR P -NORMS AND COMPONENTWISE DISTANCE TO SINGULARITY

OPTIMAL SCALING FOR P -NORMS AND COMPONENTWISE DISTANCE TO SINGULARITY published in IMA Journal of Numerical Analysis (IMAJNA), Vol. 23, 1-9, 23. OPTIMAL SCALING FOR P -NORMS AND COMPONENTWISE DISTANCE TO SINGULARITY SIEGFRIED M. RUMP Abstract. In this note we give lower

More information

On the computation of the Jordan canonical form of regular matrix polynomials

On the computation of the Jordan canonical form of regular matrix polynomials On the computation of the Jordan canonical form of regular matrix polynomials G Kalogeropoulos, P Psarrakos 2 and N Karcanias 3 Dedicated to Professor Peter Lancaster on the occasion of his 75th birthday

More information

Algorithm 853: an Efficient Algorithm for Solving Rank-Deficient Least Squares Problems

Algorithm 853: an Efficient Algorithm for Solving Rank-Deficient Least Squares Problems Algorithm 853: an Efficient Algorithm for Solving Rank-Deficient Least Squares Problems LESLIE FOSTER and RAJESH KOMMU San Jose State University Existing routines, such as xgelsy or xgelsd in LAPACK, for

More information

AMS526: Numerical Analysis I (Numerical Linear Algebra for Computational and Data Sciences)

AMS526: Numerical Analysis I (Numerical Linear Algebra for Computational and Data Sciences) AMS526: Numerical Analysis I (Numerical Linear Algebra for Computational and Data Sciences) Lecture 19: Computing the SVD; Sparse Linear Systems Xiangmin Jiao Stony Brook University Xiangmin Jiao Numerical

More information

Solving linear equations with Gaussian Elimination (I)

Solving linear equations with Gaussian Elimination (I) Term Projects Solving linear equations with Gaussian Elimination The QR Algorithm for Symmetric Eigenvalue Problem The QR Algorithm for The SVD Quasi-Newton Methods Solving linear equations with Gaussian

More information

Infinite elementary divisor structure-preserving transformations for polynomial matrices

Infinite elementary divisor structure-preserving transformations for polynomial matrices Infinite elementary divisor structure-preserving transformations for polynomial matrices N P Karampetakis and S Vologiannidis Aristotle University of Thessaloniki, Department of Mathematics, Thessaloniki

More information

Derivation of the Maximum a Posteriori Estimate for Discrete Time Descriptor Systems

Derivation of the Maximum a Posteriori Estimate for Discrete Time Descriptor Systems Derivation of the Maximum a Posteriori Estimate for Discrete Time Descriptor Systems Ali A Al-Matouq a a Department of Electrical Engineering and Computer Science, b Department of Applied arxiv:27336v5

More information

MULTISHIFT VARIANTS OF THE QZ ALGORITHM WITH AGGRESSIVE EARLY DEFLATION LAPACK WORKING NOTE 173

MULTISHIFT VARIANTS OF THE QZ ALGORITHM WITH AGGRESSIVE EARLY DEFLATION LAPACK WORKING NOTE 173 MULTISHIFT VARIANTS OF THE QZ ALGORITHM WITH AGGRESSIVE EARLY DEFLATION LAPACK WORKING NOTE 173 BO KÅGSTRÖM AND DANIEL KRESSNER Abstract. New variants of the QZ algorithm for solving the generalized eigenvalue

More information

Computation of a canonical form for linear differential-algebraic equations

Computation of a canonical form for linear differential-algebraic equations Computation of a canonical form for linear differential-algebraic equations Markus Gerdin Division of Automatic Control Department of Electrical Engineering Linköpings universitet, SE-581 83 Linköping,

More information

Matrix decompositions

Matrix decompositions Matrix decompositions Zdeněk Dvořák May 19, 2015 Lemma 1 (Schur decomposition). If A is a symmetric real matrix, then there exists an orthogonal matrix Q and a diagonal matrix D such that A = QDQ T. The

More information

Lecture 9: Numerical Linear Algebra Primer (February 11st)

Lecture 9: Numerical Linear Algebra Primer (February 11st) 10-725/36-725: Convex Optimization Spring 2015 Lecture 9: Numerical Linear Algebra Primer (February 11st) Lecturer: Ryan Tibshirani Scribes: Avinash Siravuru, Guofan Wu, Maosheng Liu Note: LaTeX template

More information

APPLIED NUMERICAL LINEAR ALGEBRA

APPLIED NUMERICAL LINEAR ALGEBRA APPLIED NUMERICAL LINEAR ALGEBRA James W. Demmel University of California Berkeley, California Society for Industrial and Applied Mathematics Philadelphia Contents Preface 1 Introduction 1 1.1 Basic Notation

More information

Numerical Methods I Non-Square and Sparse Linear Systems

Numerical Methods I Non-Square and Sparse Linear Systems Numerical Methods I Non-Square and Sparse Linear Systems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 MATH-GA 2011.003 / CSCI-GA 2945.003, Fall 2014 September 25th, 2014 A. Donev (Courant

More information

CANONICAL FORM. University of Minnesota University of Illinois. Computer Science Dept. Electrical Eng. Dept. Abstract

CANONICAL FORM. University of Minnesota University of Illinois. Computer Science Dept. Electrical Eng. Dept. Abstract PLAING ZEROES and the KRONEKER ANONIAL FORM D L oley P Van Dooren University of Minnesota University of Illinois omputer Science Dept Electrical Eng Dept Minneapolis, MN USA Urbana, IL 8 USA boleymailcsumnedu

More information

Orthonormal Transformations

Orthonormal Transformations Orthonormal Transformations Tom Lyche Centre of Mathematics for Applications, Department of Informatics, University of Oslo October 25, 2010 Applications of transformation Q : R m R m, with Q T Q = I 1.

More information

only nite eigenvalues. This is an extension of earlier results from [2]. Then we concentrate on the Riccati equation appearing in H 2 and linear quadr

only nite eigenvalues. This is an extension of earlier results from [2]. Then we concentrate on the Riccati equation appearing in H 2 and linear quadr The discrete algebraic Riccati equation and linear matrix inequality nton. Stoorvogel y Department of Mathematics and Computing Science Eindhoven Univ. of Technology P.O. ox 53, 56 M Eindhoven The Netherlands

More information

Math 102, Winter Final Exam Review. Chapter 1. Matrices and Gaussian Elimination

Math 102, Winter Final Exam Review. Chapter 1. Matrices and Gaussian Elimination Math 0, Winter 07 Final Exam Review Chapter. Matrices and Gaussian Elimination { x + x =,. Different forms of a system of linear equations. Example: The x + 4x = 4. [ ] [ ] [ ] vector form (or the column

More information

QR-decomposition. The QR-decomposition of an n k matrix A, k n, is an n n unitary matrix Q and an n k upper triangular matrix R for which A = QR

QR-decomposition. The QR-decomposition of an n k matrix A, k n, is an n n unitary matrix Q and an n k upper triangular matrix R for which A = QR QR-decomposition The QR-decomposition of an n k matrix A, k n, is an n n unitary matrix Q and an n k upper triangular matrix R for which In Matlab A = QR [Q,R]=qr(A); Note. The QR-decomposition is unique

More information

Interlacing Inequalities for Totally Nonnegative Matrices

Interlacing Inequalities for Totally Nonnegative Matrices Interlacing Inequalities for Totally Nonnegative Matrices Chi-Kwong Li and Roy Mathias October 26, 2004 Dedicated to Professor T. Ando on the occasion of his 70th birthday. Abstract Suppose λ 1 λ n 0 are

More information

AMS 209, Fall 2015 Final Project Type A Numerical Linear Algebra: Gaussian Elimination with Pivoting for Solving Linear Systems

AMS 209, Fall 2015 Final Project Type A Numerical Linear Algebra: Gaussian Elimination with Pivoting for Solving Linear Systems AMS 209, Fall 205 Final Project Type A Numerical Linear Algebra: Gaussian Elimination with Pivoting for Solving Linear Systems. Overview We are interested in solving a well-defined linear system given

More information

Linear Algebra: A Constructive Approach

Linear Algebra: A Constructive Approach Chapter 2 Linear Algebra: A Constructive Approach In Section 14 we sketched a geometric interpretation of the simplex method In this chapter, we describe the basis of an algebraic interpretation that allows

More information

Orthogonal Transformations

Orthogonal Transformations Orthogonal Transformations Tom Lyche University of Oslo Norway Orthogonal Transformations p. 1/3 Applications of Qx with Q T Q = I 1. solving least squares problems (today) 2. solving linear equations

More information

The Jordan Canonical Form

The Jordan Canonical Form The Jordan Canonical Form The Jordan canonical form describes the structure of an arbitrary linear transformation on a finite-dimensional vector space over an algebraically closed field. Here we develop

More information

8. Diagonalization.

8. Diagonalization. 8. Diagonalization 8.1. Matrix Representations of Linear Transformations Matrix of A Linear Operator with Respect to A Basis We know that every linear transformation T: R n R m has an associated standard

More information

Eigenvalue and Eigenvector Problems

Eigenvalue and Eigenvector Problems Eigenvalue and Eigenvector Problems An attempt to introduce eigenproblems Radu Trîmbiţaş Babeş-Bolyai University April 8, 2009 Radu Trîmbiţaş ( Babeş-Bolyai University) Eigenvalue and Eigenvector Problems

More information

This can be accomplished by left matrix multiplication as follows: I

This can be accomplished by left matrix multiplication as follows: I 1 Numerical Linear Algebra 11 The LU Factorization Recall from linear algebra that Gaussian elimination is a method for solving linear systems of the form Ax = b, where A R m n and bran(a) In this method

More information

A connection between number theory and linear algebra

A connection between number theory and linear algebra A connection between number theory and linear algebra Mark Steinberger Contents 1. Some basics 1 2. Rational canonical form 2 3. Prime factorization in F[x] 4 4. Units and order 5 5. Finite fields 7 6.

More information

LU Factorization. Marco Chiarandini. DM559 Linear and Integer Programming. Department of Mathematics & Computer Science University of Southern Denmark

LU Factorization. Marco Chiarandini. DM559 Linear and Integer Programming. Department of Mathematics & Computer Science University of Southern Denmark DM559 Linear and Integer Programming LU Factorization Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark [Based on slides by Lieven Vandenberghe, UCLA] Outline

More information

Tikhonov Regularization of Large Symmetric Problems

Tikhonov Regularization of Large Symmetric Problems NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS Numer. Linear Algebra Appl. 2000; 00:1 11 [Version: 2000/03/22 v1.0] Tihonov Regularization of Large Symmetric Problems D. Calvetti 1, L. Reichel 2 and A. Shuibi

More information

MS&E 318 (CME 338) Large-Scale Numerical Optimization

MS&E 318 (CME 338) Large-Scale Numerical Optimization Stanford University, Management Science & Engineering (and ICME MS&E 38 (CME 338 Large-Scale Numerical Optimization Course description Instructor: Michael Saunders Spring 28 Notes : Review The course teaches

More information

Chapter 2: Matrix Algebra

Chapter 2: Matrix Algebra Chapter 2: Matrix Algebra (Last Updated: October 12, 2016) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). Write A = 1. Matrix operations [a 1 a n. Then entry

More information

11.3 Eigenvalues and Eigenvectors of a Tridiagonal Matrix

11.3 Eigenvalues and Eigenvectors of a Tridiagonal Matrix 11.3 Eigenvalues and Eigenvectors of a ridiagonal Matrix Evaluation of the Characteristic Polynomial Once our original, real, symmetric matrix has been reduced to tridiagonal form, one possible way to

More information

Key words. Companion matrix, quasiseparable structure, QR iteration, eigenvalue computation,

Key words. Companion matrix, quasiseparable structure, QR iteration, eigenvalue computation, A FAST IMPLICIT QR EIGENVALUE ALGORITHM FOR COMPANION MATRICES D. A. BINI, P. BOITO, Y. EIDELMAN, L. GEMIGNANI, AND I. GOHBERG Abstract. An implicit version of the QR eigenvalue algorithm given in [D.

More information

LAPACK-Style Codes for Pivoted Cholesky and QR Updating. Hammarling, Sven and Higham, Nicholas J. and Lucas, Craig. MIMS EPrint: 2006.

LAPACK-Style Codes for Pivoted Cholesky and QR Updating. Hammarling, Sven and Higham, Nicholas J. and Lucas, Craig. MIMS EPrint: 2006. LAPACK-Style Codes for Pivoted Cholesky and QR Updating Hammarling, Sven and Higham, Nicholas J. and Lucas, Craig 2007 MIMS EPrint: 2006.385 Manchester Institute for Mathematical Sciences School of Mathematics

More information

(Linear equations) Applied Linear Algebra in Geoscience Using MATLAB

(Linear equations) Applied Linear Algebra in Geoscience Using MATLAB Applied Linear Algebra in Geoscience Using MATLAB (Linear equations) Contents Getting Started Creating Arrays Mathematical Operations with Arrays Using Script Files and Managing Data Two-Dimensional Plots

More information

Some Formulas for the Principal Matrix pth Root

Some Formulas for the Principal Matrix pth Root Int. J. Contemp. Math. Sciences Vol. 9 014 no. 3 141-15 HIKARI Ltd www.m-hiari.com http://dx.doi.org/10.1988/ijcms.014.4110 Some Formulas for the Principal Matrix pth Root R. Ben Taher Y. El Khatabi and

More information

Boolean Inner-Product Spaces and Boolean Matrices

Boolean Inner-Product Spaces and Boolean Matrices Boolean Inner-Product Spaces and Boolean Matrices Stan Gudder Department of Mathematics, University of Denver, Denver CO 80208 Frédéric Latrémolière Department of Mathematics, University of Denver, Denver

More information

Using semiseparable matrices to compute the SVD of a general matrix product/quotient

Using semiseparable matrices to compute the SVD of a general matrix product/quotient Using semiseparable matrices to compute the SVD of a general matrix product/quotient Marc Van Barel Yvette Vanberghen Paul Van Dooren Report TW 508, November 007 n Katholieke Universiteit Leuven Department

More information

Bare-bones outline of eigenvalue theory and the Jordan canonical form

Bare-bones outline of eigenvalue theory and the Jordan canonical form Bare-bones outline of eigenvalue theory and the Jordan canonical form April 3, 2007 N.B.: You should also consult the text/class notes for worked examples. Let F be a field, let V be a finite-dimensional

More information

A Framework for Structured Linearizations of Matrix Polynomials in Various Bases

A Framework for Structured Linearizations of Matrix Polynomials in Various Bases A Framework for Structured Linearizations of Matrix Polynomials in Various Bases Leonardo Robol Joint work with Raf Vandebril and Paul Van Dooren, KU Leuven and Université

More information

Algebra C Numerical Linear Algebra Sample Exam Problems

Algebra C Numerical Linear Algebra Sample Exam Problems Algebra C Numerical Linear Algebra Sample Exam Problems Notation. Denote by V a finite-dimensional Hilbert space with inner product (, ) and corresponding norm. The abbreviation SPD is used for symmetric

More information

Matrix Algorithms. Volume II: Eigensystems. G. W. Stewart H1HJ1L. University of Maryland College Park, Maryland

Matrix Algorithms. Volume II: Eigensystems. G. W. Stewart H1HJ1L. University of Maryland College Park, Maryland Matrix Algorithms Volume II: Eigensystems G. W. Stewart University of Maryland College Park, Maryland H1HJ1L Society for Industrial and Applied Mathematics Philadelphia CONTENTS Algorithms Preface xv xvii

More information

Direct Methods for Solving Linear Systems. Simon Fraser University Surrey Campus MACM 316 Spring 2005 Instructor: Ha Le

Direct Methods for Solving Linear Systems. Simon Fraser University Surrey Campus MACM 316 Spring 2005 Instructor: Ha Le Direct Methods for Solving Linear Systems Simon Fraser University Surrey Campus MACM 316 Spring 2005 Instructor: Ha Le 1 Overview General Linear Systems Gaussian Elimination Triangular Systems The LU Factorization

More information

Fast matrix algebra for dense matrices with rank-deficient off-diagonal blocks

Fast matrix algebra for dense matrices with rank-deficient off-diagonal blocks CHAPTER 2 Fast matrix algebra for dense matrices with rank-deficient off-diagonal blocks Chapter summary: The chapter describes techniques for rapidly performing algebraic operations on dense matrices

More information

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 13

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 13 STAT 309: MATHEMATICAL COMPUTATIONS I FALL 208 LECTURE 3 need for pivoting we saw that under proper circumstances, we can write A LU where 0 0 0 u u 2 u n l 2 0 0 0 u 22 u 2n L l 3 l 32, U 0 0 0 l n l

More information

Main matrix factorizations

Main matrix factorizations Main matrix factorizations A P L U P permutation matrix, L lower triangular, U upper triangular Key use: Solve square linear system Ax b. A Q R Q unitary, R upper triangular Key use: Solve square or overdetrmined

More information

LU Factorization. LU factorization is the most common way of solving linear systems! Ax = b LUx = b

LU Factorization. LU factorization is the most common way of solving linear systems! Ax = b LUx = b AM 205: lecture 7 Last time: LU factorization Today s lecture: Cholesky factorization, timing, QR factorization Reminder: assignment 1 due at 5 PM on Friday September 22 LU Factorization LU factorization

More information

LA BUDDE S METHOD FOR COMPUTING CHARACTERISTIC POLYNOMIALS

LA BUDDE S METHOD FOR COMPUTING CHARACTERISTIC POLYNOMIALS LA BUDDE S METHOD FOR COMPUTING CHARACTERISTIC POLYNOMIALS RIZWANA REHMAN AND ILSE C.F. IPSEN Abstract. La Budde s method computes the characteristic polynomial of a real matrix A in two stages: first

More information

Linear Systems of n equations for n unknowns

Linear Systems of n equations for n unknowns Linear Systems of n equations for n unknowns In many application problems we want to find n unknowns, and we have n linear equations Example: Find x,x,x such that the following three equations hold: x

More information

(VI.C) Rational Canonical Form

(VI.C) Rational Canonical Form (VI.C) Rational Canonical Form Let s agree to call a transformation T : F n F n semisimple if there is a basis B = { v,..., v n } such that T v = λ v, T v 2 = λ 2 v 2,..., T v n = λ n for some scalars

More information

Homework 2 Foundations of Computational Math 2 Spring 2019

Homework 2 Foundations of Computational Math 2 Spring 2019 Homework 2 Foundations of Computational Math 2 Spring 2019 Problem 2.1 (2.1.a) Suppose (v 1,λ 1 )and(v 2,λ 2 ) are eigenpairs for a matrix A C n n. Show that if λ 1 λ 2 then v 1 and v 2 are linearly independent.

More information

Introduction to Numerical Linear Algebra II

Introduction to Numerical Linear Algebra II Introduction to Numerical Linear Algebra II Petros Drineas These slides were prepared by Ilse Ipsen for the 2015 Gene Golub SIAM Summer School on RandNLA 1 / 49 Overview We will cover this material in

More information

Linear Algebra Done Wrong. Sergei Treil. Department of Mathematics, Brown University

Linear Algebra Done Wrong. Sergei Treil. Department of Mathematics, Brown University Linear Algebra Done Wrong Sergei Treil Department of Mathematics, Brown University Copyright c Sergei Treil, 2004, 2009 Preface The title of the book sounds a bit mysterious. Why should anyone read this

More information

A NOTE ON THE JORDAN CANONICAL FORM

A NOTE ON THE JORDAN CANONICAL FORM A NOTE ON THE JORDAN CANONICAL FORM H. Azad Department of Mathematics and Statistics King Fahd University of Petroleum & Minerals Dhahran, Saudi Arabia hassanaz@kfupm.edu.sa Abstract A proof of the Jordan

More information

Computing Science Group STABILITY OF THE MAHALANOBIS DISTANCE: A TECHNICAL NOTE. Andrew D. Ker CS-RR-10-20

Computing Science Group STABILITY OF THE MAHALANOBIS DISTANCE: A TECHNICAL NOTE. Andrew D. Ker CS-RR-10-20 Computing Science Group STABILITY OF THE MAHALANOBIS DISTANCE: A TECHNICAL NOTE Andrew D. Ker CS-RR-10-20 Oxford University Computing Laboratory Wolfson Building, Parks Road, Oxford OX1 3QD Abstract When

More information

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2 MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a

More information

Decomposition. bq (m n) R b (n n) r 11 r 1n

Decomposition. bq (m n) R b (n n) r 11 r 1n The QR Decomposition Lab Objective: The QR decomposition is a fundamentally important matrix factorization. It is straightforward to implement, is numerically stable, and provides the basis of several

More information

On doubly structured matrices and pencils that arise in linear response theory

On doubly structured matrices and pencils that arise in linear response theory On doubly structured matrices and pencils that arise in linear response theory Christian Mehl Volker Mehrmann Hongguo Xu Abstract We discuss matrix pencils with a double symmetry structure that arise in

More information

Sparsity-Preserving Difference of Positive Semidefinite Matrix Representation of Indefinite Matrices

Sparsity-Preserving Difference of Positive Semidefinite Matrix Representation of Indefinite Matrices Sparsity-Preserving Difference of Positive Semidefinite Matrix Representation of Indefinite Matrices Jaehyun Park June 1 2016 Abstract We consider the problem of writing an arbitrary symmetric matrix as

More information

Lecture 2: Numerical linear algebra

Lecture 2: Numerical linear algebra Lecture 2: Numerical linear algebra QR factorization Eigenvalue decomposition Singular value decomposition Conditioning of a problem Floating point arithmetic and stability of an algorithm Linear algebra

More information

Matrices and systems of linear equations

Matrices and systems of linear equations Matrices and systems of linear equations Samy Tindel Purdue University Differential equations and linear algebra - MA 262 Taken from Differential equations and linear algebra by Goode and Annin Samy T.

More information

Sparse BLAS-3 Reduction

Sparse BLAS-3 Reduction Sparse BLAS-3 Reduction to Banded Upper Triangular (Spar3Bnd) Gary Howell, HPC/OIT NC State University gary howell@ncsu.edu Sparse BLAS-3 Reduction p.1/27 Acknowledgements James Demmel, Gene Golub, Franc

More information

Derivation of the Kalman Filter

Derivation of the Kalman Filter Derivation of the Kalman Filter Kai Borre Danish GPS Center, Denmark Block Matrix Identities The key formulas give the inverse of a 2 by 2 block matrix, assuming T is invertible: T U 1 L M. (1) V W N P

More information

Numerical Methods. Elena loli Piccolomini. Civil Engeneering. piccolom. Metodi Numerici M p. 1/??

Numerical Methods. Elena loli Piccolomini. Civil Engeneering.  piccolom. Metodi Numerici M p. 1/?? Metodi Numerici M p. 1/?? Numerical Methods Elena loli Piccolomini Civil Engeneering http://www.dm.unibo.it/ piccolom elena.loli@unibo.it Metodi Numerici M p. 2/?? Least Squares Data Fitting Measurement

More information

Foundations of Matrix Analysis

Foundations of Matrix Analysis 1 Foundations of Matrix Analysis In this chapter we recall the basic elements of linear algebra which will be employed in the remainder of the text For most of the proofs as well as for the details, the

More information

Introduction to Mathematical Programming

Introduction to Mathematical Programming Introduction to Mathematical Programming Ming Zhong Lecture 6 September 12, 2018 Ming Zhong (JHU) AMS Fall 2018 1 / 20 Table of Contents 1 Ming Zhong (JHU) AMS Fall 2018 2 / 20 Solving Linear Systems A

More information

arxiv: v1 [math.na] 5 May 2011

arxiv: v1 [math.na] 5 May 2011 ITERATIVE METHODS FOR COMPUTING EIGENVALUES AND EIGENVECTORS MAYSUM PANJU arxiv:1105.1185v1 [math.na] 5 May 2011 Abstract. We examine some numerical iterative methods for computing the eigenvalues and

More information

GAUSSIAN ELIMINATION AND LU DECOMPOSITION (SUPPLEMENT FOR MA511)

GAUSSIAN ELIMINATION AND LU DECOMPOSITION (SUPPLEMENT FOR MA511) GAUSSIAN ELIMINATION AND LU DECOMPOSITION (SUPPLEMENT FOR MA511) D. ARAPURA Gaussian elimination is the go to method for all basic linear classes including this one. We go summarize the main ideas. 1.

More information

A Fault Detection Toolbox for MATLAB

A Fault Detection Toolbox for MATLAB A Fault Detection Toolbox for MATLAB A. Varga Abstract The recently developed FAULT DETECTION Toolbox for MATLAB is described. The new toolbox provides a comprehensive set of high level m-functions to

More information

L(C G (x) 0 ) c g (x). Proof. Recall C G (x) = {g G xgx 1 = g} and c g (x) = {X g Ad xx = X}. In general, it is obvious that

L(C G (x) 0 ) c g (x). Proof. Recall C G (x) = {g G xgx 1 = g} and c g (x) = {X g Ad xx = X}. In general, it is obvious that ALGEBRAIC GROUPS 61 5. Root systems and semisimple Lie algebras 5.1. Characteristic 0 theory. Assume in this subsection that chark = 0. Let me recall a couple of definitions made earlier: G is called reductive

More information

Incomplete Cholesky preconditioners that exploit the low-rank property

Incomplete Cholesky preconditioners that exploit the low-rank property anapov@ulb.ac.be ; http://homepages.ulb.ac.be/ anapov/ 1 / 35 Incomplete Cholesky preconditioners that exploit the low-rank property (theory and practice) Artem Napov Service de Métrologie Nucléaire, Université

More information

Numerical Linear Algebra Primer. Ryan Tibshirani Convex Optimization /36-725

Numerical Linear Algebra Primer. Ryan Tibshirani Convex Optimization /36-725 Numerical Linear Algebra Primer Ryan Tibshirani Convex Optimization 10-725/36-725 Last time: proximal gradient descent Consider the problem min g(x) + h(x) with g, h convex, g differentiable, and h simple

More information