Computations in Modules over Commutative Domains

Size: px
Start display at page:

Download "Computations in Modules over Commutative Domains"

Transcription

1 Computations in Modules over Commutative Domains 2007, September, 15

2 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method àñòü I System of Linear Equations

3 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method Let R be a commutative domain, F be the eld of fractions of R. A R n m, c R n, n m, A = (A, c) = (a ij ) and, Ax = c be a system of linear equations over R

4 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method x i = (δ n i,m+1 m j=n+1 x jδ n ij )(δn ) 1, i = 1... n, where x j, j = n + 1,..., m, are the free variables, and the determinant δ n 0.

5 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method We denote by δ k, k = 1,..., n the left upper corner minor of matrix A of order k, and by δ k ij the corner minor of matrix A where columns i and j have been interchanged. We assume that all corner minors δ k, k = 1,..., n are dierent from 0.

6 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method 1 Dodgson's Algorithm 2 Method of Forward and Backward Direction 3 The One-pass Method 4 The Recursive Method

7 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method The determinant identity a b c d e f g h k = a d d g b e e h b e e h c f f k e 1 or in the more general form where â k+1 ij = âi 1,j 1 k âi,j 1 k âi 1,j k âij k (âk 1 i 1,j 1 ) 1 â k+1 ij = A i k,...,i:(rows) j k,...,j:(columns)

8 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method 1 Dodgson's Algorithm 2 Method of Forward and Backward Direction 3 The One-pass Method 4 The Recursive Method

9 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method a k+1 ij = (a k kk ak ij a k ik ak kj )(ak 1 k 1,k 1 ) 1, k = 2,..., n 1, i = k + 1,..., n, j = k + 1,..., m, where a k+1 ij = A 1,...,k,i:(rows) 1,...,k,j:(columns)

10 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method a1,1 1 a1,2 1 a1,n 1 1 a1,n 1 a1,n 1 a1,m a2,2 2 a2,n 1 2 a2,n 2 a2,n+1 2 a2,m an 1,n 1 an 1,n an 1,n+1 an 1,m an,n n an,n+1 n an,m+1 n

11 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method ak,k k 0, k = 1,..., n 1 δij n. δk ij is the corner minor of order k of the matrix A after column i has been interchanged with column j. The determinant identity of the backward direction algorithm is: δij n = ( n anna n ij i aik i kj) δn (a i ii ) 1, i = n 1,... 1, j = n+1,..., m. k=i+1 an,n n δ1,n n δ1,m+1 n 0 an,n n 0 0 δ2,n+1 n δ2,m+1 n. 0 0 an,n n 0 δn 1,n+1 n δn 1,m+1 n an,n n δn,n+1 n δn,m+1 n

12 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method

13 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method The number of operations, necessary for the procedure of forward and backward direction, is N m = (9n 2 m 5n 3 3nm 3n 2 6m + 8n)/6, N d = (3n 2 m n 3 3nm 6n n 6)/6 N a = (6n 2 m 4n 3 6nm + 3n 2 + n)/6.

14 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method 1 Dodgson's Algorithm 2 Method of Forward and Backward Direction 3 The One-pass Method 4 The Recursive Method

15 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method k k+1,j = a k+1,k+1δkk k a k+1,p δpj, k j = k m, δ k+1 p=1 δ k+1 ij = (δ k+1 k+1,k+1 δk i,j δ k+1 k+1,j δk i,k+1 )/δk k,k, k = 1,..., n 1, i = 1,..., k, j = k + 2,..., m. ak,k k 0 0 δ1,k+1 k δ1,m+1 k 0 ak,k k 0 δ2,k+1 k δ2,m+1 k. 0 0 ak,k k δk,k+1 k δk,m+1 k a k+1,1 a k+1,2 a k+1,k a k+1,k+1 a k+1,m a n,1 a n,2 a n,k a n,k+1 a n,m+1

16 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method

17 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method N m = (9n 2 m 6n 3 3nm 6m + 6n)/6, N d = (3n 2 m 2n 3 3nm 6m + 2n + 12)/6 N a = (6n 2 m 4n 3 6nm + 3n 2 + n)/6. Number of Operations Method Multiplications Divisions Add./Substr. FB OP (4n 3 +3n 2 n 6) 6 (n 3 +2n 2 n 2) 2 (2n 3 6n 2 +10n 6) 6 (n 3 7n+6) 6 (2n 3 +3n 2 5n) 6 (2n 3 +3n 2 5n) 6

18 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method 1 Dodgson's Algorithm 2 Method of Forward and Backward Direction 3 The One-pass Method 4 The Recursive Method

19 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method a p r+1,k+1 a p r+1,k+2 a p r+1,c A r,l,(p) a p r+2,k+1 a p r+2,k+2 a p r+2,c k,c = a p l,k+1 a p l,k+2 a p l,c δ p r+1,k+1 δ p r+1,k+2 δ p r+1,c G r,l,(p) δ p r+2,k+1 δ p r+2,k+2 δ p r+2,c k,c = δ p l,k+1 δ p l,k+2 δ p l,c,,

20 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method G r,l,(p) k,c, A r,l,(p) k,c R (l r) (c k), 0 k < n, k < c n, 0 r < m, r < l m, 1 p n. We describe one recursive step reducing the matrix à = A k,l,(k+1) k,c to the diagonal form where à (δ l I l k, Ĝ) à = A k,l,(k+1) k,c, Ĝ = G k,l,(l) l,c 0 k < c m, k < l n, l < c. Note that if k = 0, l = n and c = m, then we obtain the solution of the original system.

21 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method Description of One Step of the Recursive Method ( A 1 Ã = A 2 ) 1 ( δ s I s k G 1 2 A 2 1 A 2 2 ) 2 ( δ s I s k G Â 2 2 ) 3 3 ( δ s I s k G 1 2 G δ l I l s Ĝ 2 2 ) 4 ( δ l I s k 0 Ĝ δ l I l s Ĝ 2 2 = ( δ l I l k Ĝ ) ) =

22 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method s: k < s < l Ã: ( A 1 à = A 2 ), where A 1 = A k,s,(k+1) k,c is the upper part of the matrix à consisting of s k rows and A 2 = A s,l,(k+1) k,c is the lower part of the matrix Ã. where A 1 R (s k) (c k), G 1 2 = G k,s,(s) s,c. A 1 (δ s I s k, G 1 2 ), (I )

23 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method Let A 2 = (A 2 1, A2 2 ) where A2 1 = As,l,(k+1) k,s and A 2 2 = As,l,(k+1) s,c consisting of s k and c s columns respectively, δ k 0. The matrix Â2 2 = As,l,(s+1) s,c identity is computed with the help of the matrix  2 2 = (δ s A 2 2 A 2 1 G 1 2 )(δ k ) 1. (II )  2 2 (δ l I l s, Ĝ 2 2 ), (III ) where  2 2 R(l s) (c s) and Ĝ 2 2 = G s,l,(l) l,c. Let G2 1 = (G 2 1, G 1 2 ), where the blocks G2 1 = G k,s,(s) s,l and G2 1 = G k,s,(s) l,c contain l s and c l columns respectively, and δ s 0.

24 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method The matrix Ĝ 2 1 = G k,s,(l) l,c is computed with the help of the matrix identity Ĝ2 1 = (δl G2 1 G 2 1 Ĝ 2 2 )(δs ) 1. (IV ) In the result we obtain δ l and ( Ĝ 1 Ĝ = 2 Ĝ 2 2 )

25 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method Example: x 1 x 2 x 3 x 4 = A1 = A 02(1) 05 (δ 2 I 2, G 02(2) 25 ) (I ) A 01(1) 05 (δ 1 I 1, G 01(1) 15 ) = (3; 1, 1, 1, 4) (i)

26 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method δ 0 A 12(2) 15 = δ 1 A 12(1) 15 A 12(1) 01 G 01(1) 15 = = 3(2, 0, 1, 4) (1)(1, 1, 1, 4) = (5, 1, 4, 8), δ 0 1. (ii) A 12(2) 15 (δ 2 I 1, G 12(2) 25 ) = (5; 1, 4, 8) (iii) δ 1 G 01(2) 25 = δ 2 G 01(1) 25 G 01(1) 12 G 12(2) 25 = = 5(1, 1, 4) (1)( 1, 4, 8) = (6, 9, 12) (iv)

27 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method G 01(2) 25 = (2, 3, 4) ( (δ 2 I 2, G 02(2) 5 0; ) = 0 5; Â 2 2 = A 24(3) 25 (II ) δ 0 A 24(3) 25 = δ 2 A 24(1) 25 A 24(1) 02 G 02(2) 25 = ( ) ( ) ( ) = 5 = ( ) = ( ) δ 0 1; A 24(3) = )

28 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method A 24(3) 25 (δ 4 I 2 G 24(4) 45 ) (III ) A 23(3) 25 (δ 3 I 1, G 23(3) 35 ) = (11; 4, 18) (i) δ 2 A 34(4) 35 = δ 3 A 34(4) 35 A 34(3) 23 G 23(3) 35 = = 11(13, 9) ( 2)( 4, 18) = (135, 135) A 34(4) 35 = (27, 27) (ii)

29 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method A 34(4) 35 (δ 4 I 1, G 34(4) 45 ) = (27, 27) (iii) δ 3 G 23(4) 45 = δ 4 G 23(3) 45 G 23(3) 34 G 34(4) 45 = = 27( 18) ( 4)( 27) = 594, G 23(4) 45 = ( 54) (iv) ( ) (δ 4 I 2, G 24(4) 27 0; = 0 27; 27 Ĝ2 1 02(4) = G45 (V )

30 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method ( 4 = 27 8 δ 2 G 02(4) 45 = δ 4 G 02(2) 45 G 02(2) 24 G 24(4) 45 = ) ( G 02(4) 45 = δ 4 = 27; G 04(4) 45 = ) ( ) 54 = 27 ( ) ( )

31 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method Example: Description of the First Step 3 A = A

32 Dodgson's Algorithm Method of Forward and Backward Direction The One-pass Method The Recursive Method Complexity of the Recursive Method is O(mn β 1 ). We can obtain an exact estimate. For n = 2 N, m = n + 1 and β = log 2 7 the number of multiplication operations is 7 15 nlog n 2 (log 2 n 2 3 ) + n(2 log 2 n ). For n = 2 N, β = 3 the number of multiplications and divisions is N m = (6n 2 m 4n 3 + (6nm 3n 2 ) log 2 n 6nm + 4n)/6, N d = ((6nm 3n 2 ) log 2 n 6nm n 2 + 6m + 3n 2)/6. The number of multiplication operations for m = n + 1 is (1/3)n 3 + O(n 2 ). The estimations for the previous two methods are, respectively, n 3 + O(n 2 ) and (2/3)n 3 + O(n 2 ).

33 Dichotomic process àñòü II Adjoint Matrix

34 Dichotomic process The best method for computing the matrix determinant and adjoint matrix in the arbitrary commutative ring was suggested in the papers by Kaltofen [9] and Kaltofen and Villard [10]. Its complexity is O(n β+1/3 ( log n log ) log n). A C Let A = be an invertible matrix and A an invertible B D block.

35 Dichotomic process Then A 1 = ( I A 1 C 0 I ) ( I 0 0 (D BA 1 C) 1 ) ( I 0 B I ) ( A I In case n = 2 p it will take 2 p 1 inversions of 2 2 blocks and 2 p k multiplications of 2 k 2 k blocks.

36 Dichotomic process n log7 n/2 O(n β ), O(n β ). Let R be a commutative ring, and let A = (a i,j ) be a square matrix of order n over the ring R. A (s) t = (a s i,j) i=s,...,t j=s,...,t and G (t) s = (δ t(i,j) ) i=s,...,t j=t+1,...,n

37 Dichotomic process Theorem Let A be a square block matrix of order n over the ring R; that is, ( ) A C A =, B D where A is a square block of order s, (1 < s < n), the determinant of which, δ s, is neither zero nor a zero divider in R. Then, the adjoint matrix A can be written as the product ( A δ 1 s δ = n I δs 1 FC 0 I where F = A, G = δ n+s+1 the identity s ) ( I 0 0 G ) ( I 0 B δ s I ) ( F 0 0 I ), ( ) A (s+1) n, I is the identity matrix and we have A (s+1) n = δ s D BFC.

38 Dichotomic process Theorem Let A (s+1) n be a square block matrix of order n s, (s > 0, n s > 2), over the ring R; that is, ( A (s+1) A C n = B D where A is a square block of order t s, (1 < s < t < n), and δ s and δ t are neither zero nor zero dividers in R. Then, the matrix δs n+s+1 A n (s+1) can be written as the product ( δ 1 t δ n I δt 1 ) ( FC I 0 0 I 0 δs 1 G where F = δs t+s+1 A (s+1) t and we have the identity A (t+1) n, G = δ n+t+1 t ), ) ( I 0 B δ t I = δs 1 (δ t D BFC). ) ( F 0 0 I ), ( ) A (t+1) n, I is the identity matrix

39 Dichotomic process Remark 1: If n = s + 2, then, A (s+1) n = ( an,n s+1 an 1,n s+1 an,n 1 s+1 an 1,n 1 s+1 And if n = s + 1, then A (s+1) n = 1. Remark 2: In the factorization ( ) δ n can be found from Sylvester's identity δ n = δ n+s+1 s ) deta (s+1) n. And if n = s + 2, then δ n = detg. In an analogous way we can nd δ t and δ n, in the factorization ( ) :.

40 Dichotomic process The dimensions of the upper left block A (of the initial square block matrix A) may be chosen arbitrarily. The case will be examined when the dimensions of block A are powers of two. Let n be the order of the matrix A, 2 h < n 2 h+1 and assume that all minors δ 2i, i = 1, 2,... are not zero or zero dividers of the ring R. According to Theorems 1 and 2 we are going to sequentially compute adjoint matrices for the upper left blocks of order 2, 4, 8, 16,... of matrix A.

41 Dichotomic process 1. For the block of order 2 we have: A 2 2,2 = (a i,j ) i,j=1,2, δ 2 = det A 1 2,2, ( A 2 a2,2 a 2,2 = 1,2 a 2,1 a 1,1 2. For the block of order 4 we have: ). ( A 4 δ 1 4,4 = 2 δ 4I δ2 1 FC 0 I ) ( I 0 0 G ) ( I 0 B δ 2 I ) ( F 0 0 I ), F = A 2 2,2, B = (a i,j) i=3,4 j=1,2, C = (a i,j ) i=1,2 j=3,3, D = (a i,j) i,j=3,4, A (3) 4 = δ 2 D BFC = (ai,j 3 ) i,j=3,4, G = δ2 1 A(3) 4, δ 4 = det G.

42 Dichotomic process 3. For the block of order 8 we have: ( A 8 δ 1 8,8 = 4 δ 8I δ4 1 FC 0 I ) ( I 0 0 G ) ( I 0 B δ 4 I ) ( F 0 0 I ), F = A 4 4,4, B = (a i,j) i=5,...,8 j=1,...,4, C = (a i,j ) i=1,...,4 j=5,...,8, D = (a i,j ) i,j=5,...,8,

43 Dichotomic process ( δ 1 G = 6 δ 8I δ6 1 FC 0 I ) ( I 0 0 δ 1 4 G ) ( I 0 B δ 6 I ) ( F 0 0 I ), A (5) 8 = δ 4 D BFC = (ai,j 5 ) i,j=5,...,8, F = δ4 3 A(5) 6, δ 6 = det F, B = (ai,j 5 )i=7,8 j=5,6, C = (ai,j 5 )i=5,6 j=7,8, D = (ai,j 5 ) i,j=7,8, A (7) 8 = δ4 1 (δ 6D BFC) = (ai,j 7 ) i,j=7,8, G = δ6 1 A(7) 8, δ 8 = det G.

44 Dichotomic process Example: A =

45 Dichotomic process 1. For the second order block we have: A 0,2 0,2 = ( ) (, α 2 = det A 0, ,2 = 2, A0,2 0,2 = 1 0 ).

46 Dichotomic process 2. For the fourth order block we have: F = A 0,2 0,2, B = ( ( A 3;2,4 2,4 = α D BFC = 0 2 ) ( 2 2, C = 1 2 ) ( 3 0, D = 1 1 ) (, G = (α 2 ) 1 A 3;2, ,4 = 0 3 α 4 = (α 2 ) 1 det A 3;2,4 2,4 = 6, ( A (α = 2 ) 1 α 4 I (α 2 ) 1 ) ( ) ( FC I 0 I 0 0 I 0 G B α 2 I ), ), ) ( F 0 0 I )

47 Dichotomic process = =

48 Dichotomic process Complexity Estimation Let γn β + o(n β ) be an asymptotic estimation of the number of operations for multiplying two matrices of order n. Then the complexity of computing the adjoint matrix of order n = 2 p is F (n) = 6γn β 1 (n/2)1 β 2 β 2 + o(n β )

49 Computation of similar p-trianular matrix àñòü III Characteristic polynomial

50 Computation of similar p-trianular matrix In the case of an arbitrary commutative ring, the best algorithms for computing the characteristic polynomial are Chistov's algorithm [6] and the improved Berkowitz algorithm [3]. The complexity of these methods is O(n β+1 log n). We present the best method to date for computations in commutative domains which has complexity O(n 3 ). Let A = (a ij ) be an n n matrix over the ring R. If all the diagonal minors δ k (k = 1,..., n 1) of matrix A are not zero, then the following identity holds A u = LA,

51 Computation of similar p-trianular matrix where A u is an upper triangular matrix and L is a lower triangular matrix with determinant dierent from zero, such that L = D 1 n 2 L n 1 D 1 1 L 2 L1 L k = diag(i k 1, L k ), D k = diag(i k, D k ), where I k is the identity matrix of order k, D k = δ k I n k, ( ) ( ) δk L k =, L k = v k δ k I n k v k I n k

52 Computation of similar p-trianular matrix v k = (ak+1,k k,..., ak n,k )T, A u = (a (n) i,j ) is an n n matrix, and a (n) i,j = ai,j i, for i j, a(n) i,j = 0, for i > j. The proof is based on Sylvester's identity a k 1 k 1,k 1 ak+1 i,j = a k k,k ak i,j a k i,k ak k,j. The factorization of matrix A into upper and lower triangular matrices is the result of the forward direction part of the forward and backward direction algorithm.

53 Computation of similar p-trianular matrix Let A (k) u = (a (k) i,j ) be an n n matrix, k = 1,..., n, with a (k) i,j = ai,j i = ai,j k, i k, j k, and the remaining elements for i j < k, a (k) i,j zero. Then A u = LA reduces to the identities A (2) u = L 1 A; A (k+1) u = D 1 k 1 L k A u (k), k = 2,..., n 1, which subsequently enable the computation of matrices A (k) u, k = 2, 3,..., n, such that all the elements of the matrices D k and L k are elements of the matrix A (k) u.

54 Computation of similar p-trianular matrix The requirement that the diagonal minors δ k (k = 1, 2,..., n 1) be dierent from zero may be weakened. If a diagonal minor δ k of order k is equal to zero, and in column v k there is a nonzero element ai,k k, then rows i and k must be interchanged; that is, multiply on the left the matrix of interchanges P k = P (i,k) = I n + E ik + E ki E kk E ii, where E ik denotes a matrix in which all elements are zero except element (i, k), which is equal to one.

55 Computation of similar p-trianular matrix And if δ k = 0 and v k = 0, then necessarily P k = L k = D k 1 = I n, D k = D k 1. The factorization formula remains as before, only now L k = diag(i k 1, L k )P k.

56 Computation of similar p-trianular matrix Note the following identities, which will be subsequently needed: where L k L k = D k, LL = T, L = L 1 L 2 L n 1, L k = P 1 k diag(i k 1, L k ), T is a diagonal matrix dened by, T = S 1 S 2, where S 1 = diag(1, S), and S 2 = diag(s, 1), with S = diag(δ 1, δ 2,..., δ n 1 ). To indicate the matrix A from which a given triangular or diagonal matrix was computed, we write L = L(A), T = T (A).

57 Computation of similar p-trianular matrix ( ) a b Let A = be a matrix over R with blocks a of order p p c d and d of order n n. We will call matrix A upper p-triangular, if the block (c, d) looks like an upper triangular matrix. We will denote with calligraphic letters block-diagonal matrices of order (n + p) (n + p) of the type diag(i p, G) = G, where G is a p p matrix.

58 Computation of similar p-trianular matrix Let G be some p p matrix and let L = L((c, d)g), and T = T (((c, d)g)). If we take now G = L, L = diag(i p, L), L = diag(i p, L), then the matrix A u = LAL will become an upper p-triangular matrix, and matrix T 1 A u will be similar to A. The cofactors L and L of the matrix can be computed sequentially. Since ((c, d)g) = (c, dl) and the rst p of the columns of the matrix (c, dl) constitute block c and are independent from L, then using them we can compute sequentially the rst p cofactors of the matrix L : L 1, D 1, L 2,..., D p 1, L p. From these we can write the rst p cofactors of matrix L, can compute p columns of the matrix dl and after that the following p cofactors of matrix L, etc. For p = 1 we obtain a quasi-triangular matrix, that is a matrix with zero elements under the second diagonal, which is obtained by the elements a 2,1, a 3,2,..., a n,n 1.

59 Computation of similar p-trianular matrix Let us denote by A k (1 k n) the corner minors of order k of the quasi-triangular matrix A = (a i,j ), a i,j = 0 for i 2, j i 1, and assume A 0 = 1. Then its determinant can be computed as shown n 1 det (A n ) = a nn det (A n 1 ) + a i,n det (A i 1 ) i=1 n 1 j=i+1 ( a j,j 1 ). The complexity of this method is 5 3 n3 + O(n 2 ) multiplicative operations.

60 Computation of similar p-trianular matrix Example. Let A = L 1 = , then we obtain:, L 1 = ,

61 Computation of similar p-trianular matrix L 2 = A (2) = L 1 AL 1 = , L 2 =, ,

62 Computation of similar p-trianular matrix A (3) = diag 1 (1, 1, 1, 2, 2) L 2 A (2) L 2 = L 3 = , L 3 = ,,

63 Computation of similar p-trianular matrix A (4) = diag 1 (1, 1, 1, 1, 12) L 2 A (2) L = The 1-triangular matrix A (4) is similar to diag(1, 2, 24, 864, 72)A. The characteristic polynomial of the matrix A and the matrix diag(1, 1 2, 1 24, 1 864, 1 72 )A(4) is equal to x 5 + x 4 + 3x 3 22x 2 + 6x + 12.

64 àñòü IV Conclusion

65 For computations over commutative domains we have the following results: The complexity of the O(n 3 ) methods (FB) and (OP) for solving systems of linear equations of size n m is M (FB) = (1/2)(4n 2 m 2n 3 2nm 3n 2 2m + 7n 2), M (OP) = (1/6)(12n 2 m 8n 3 6nm 9n 2 12m + 8n + 12). Suppose that the complexity of the given method for matrix multiplications is γn β + o(n β ), where γ and β are constants, and n is the order of the matrix. Then, the complexity of the recursive methods for solving systems of size n m is S(n, m) = γ nβ [ m (4 2 β n n2 β 1 n1 β ] 2) β + o(n β β m).

66 The complexity of the method for the computation of the determinant of a matrix of order n is S(n, n). The complexity of the method for the computation of the kernel of a linear operator is S(n, m). The complexity of the method for the computation and the factorization of the adjoint matrix is F (n) = 6γn β 1 (n/2)1 β 2 β 2 + o(n β ) Finally, the complexity of the best method we know today for the computation of the characteristic polynomial of a matrix of order n is 5 3 n3 + O(n 2 ).

67 àñòü V Bibliography

68 Akritas A.G. Elements of Computer Algebra with Applications. J. Wiley Interscience, New York, Akritas, A. G., Akritas, E. K., Malaschonok, G. I. Various proofs of Sylvester's (determinant) identity. Mathematics and Computations in Simulation 42 (1996) Abdeljaoued, J. Berkowitz Algorithm, Maple and computing the characteristic polynomial in an arbitrary commutative ring. Computer Algebra MapleTech 4, No. 3, Birkhauser Boston (1997) Abdeljaoued, J., Malaschonok, G. I. Ecient Algorithms for Computing the Characteristic Polynomial in a Domain. Journal of Pure and Applied Algebra (to appear) Bareiss, E. H. Sylvester's Identity and Multistep Integer-Preserving Gaussian Elimination. Math. Comp. 22 (103) (1968) Chistov, A. L. Fast parallel calculation of the rank of matrices over a eld of arbitrary characteristic. Proc. FCT'85, Springer Lecture Notes in Computer Science 199 (1985)

69 Kaltofen E., Villard G. On the complexity of computing determinants. Proc. Fifth Asian Symposium on Computer Mathematics, ASCM Extended abstract. P Malashonok, G. I. Solution of a system of linear equations in an integral domain. USSR Journal of computational Mathematics and Mathematical Physics 23, no.6, (1983) Malashonok, G. I. On the solution of a linear equation system over commutative rung. Math. Notes of the Acad. Sci. USSR 42, No. 4 (1987) Malashonok, G. I.: A new solution method for linear equation systems over commutative rung. International Algebraic Conference. Theses on the ring theory, algebras and modules. Novosibirsk, Aug , 1989, P.82. Malashonok, G. I. Algorithms for the solution of systems of linear equations in commutative rings. Eective methods in algebraic geometry (Castiglioncello, 1990), Progr. Math., 94, Birkhauser Boston, Boston, MA, 1991,

70 Malaschonok, G. I. Recursive Method for the Solution of Systems of Linear Equations. Computational Mathematics (Proc. of the 15th IMACS World Congress, Vol. I, Berlin, August 1997). Wissenschaft & Technik Verlag, Berlin (1997) Malaschonok G.I. A Computation of the Characteristic Polynomial of an Endomorphism of a Free Module, Zap. Nauchnyh Sem. S.-Peterburg. Otdel. Mat. Inst. Steklov. (POMI), V.258, 1999, Teor. Predst. Din. Sist. Komb. i Algoritm. Metody. 4,

71 Malaschonok G.I. Eective Matrix Methods in Commutative Domains. Formal Power Series and Algebraic Combinatorics. Springer, P Strassen, V. Gaussian Elimination is not optimal. Numerische Mathematik 13 (1969) Sasaki, T. & Murao, H. Ecient Gaussian elimination method for symbolic determinants and linear systems. A.C.M. Trans. Math. Software 8, No. 4 (1968) Waugh F.V., Dwyer P.S.. Compact computation of the inverse of a matrix. Annals of Mathemaical Statistic V. 16. P

1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i )

1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i ) Direct Methods for Linear Systems Chapter Direct Methods for Solving Linear Systems Per-Olof Persson persson@berkeleyedu Department of Mathematics University of California, Berkeley Math 18A Numerical

More information

Various Proofs of Sylvester s (Determinant) Identity

Various Proofs of Sylvester s (Determinant) Identity Various Proofs of Sylvester s Determinant Identity IMACS Symposium SC 1993 Alkiviadis G Akritas, Evgenia K Akritas, University of Kansas Department of Computer Science Lawrence, KS 66045-2192, USA Genadii

More information

Elementary maths for GMT

Elementary maths for GMT Elementary maths for GMT Linear Algebra Part 2: Matrices, Elimination and Determinant m n matrices The system of m linear equations in n variables x 1, x 2,, x n a 11 x 1 + a 12 x 2 + + a 1n x n = b 1

More information

Formula for the inverse matrix. Cramer s rule. Review: 3 3 determinants can be computed expanding by any row or column

Formula for the inverse matrix. Cramer s rule. Review: 3 3 determinants can be computed expanding by any row or column Math 20F Linear Algebra Lecture 18 1 Determinants, n n Review: The 3 3 case Slide 1 Determinants n n (Expansions by rows and columns Relation with Gauss elimination matrices: Properties) Formula for the

More information

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2 MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a

More information

Fundamentals of Engineering Analysis (650163)

Fundamentals of Engineering Analysis (650163) Philadelphia University Faculty of Engineering Communications and Electronics Engineering Fundamentals of Engineering Analysis (6563) Part Dr. Omar R Daoud Matrices: Introduction DEFINITION A matrix is

More information

Phys 201. Matrices and Determinants

Phys 201. Matrices and Determinants Phys 201 Matrices and Determinants 1 1.1 Matrices 1.2 Operations of matrices 1.3 Types of matrices 1.4 Properties of matrices 1.5 Determinants 1.6 Inverse of a 3 3 matrix 2 1.1 Matrices A 2 3 7 =! " 1

More information

Yet Another Proof of Sylvester s Identity

Yet Another Proof of Sylvester s Identity Yet Another Proof of Sylvester s Identity Paul Vrbik 1 1 University of Newcastle Australia Sylvester s Identity Let A be an n n matrix with entries a i,j for i, j [1, n] and denote by A i k the matrix

More information

A Review of Matrix Analysis

A Review of Matrix Analysis Matrix Notation Part Matrix Operations Matrices are simply rectangular arrays of quantities Each quantity in the array is called an element of the matrix and an element can be either a numerical value

More information

MATH 2050 Assignment 8 Fall [10] 1. Find the determinant by reducing to triangular form for the following matrices.

MATH 2050 Assignment 8 Fall [10] 1. Find the determinant by reducing to triangular form for the following matrices. MATH 2050 Assignment 8 Fall 2016 [10] 1. Find the determinant by reducing to triangular form for the following matrices. 0 1 2 (a) A = 2 1 4. ANS: We perform the Gaussian Elimination on A by the following

More information

Lemma 8: Suppose the N by N matrix A has the following block upper triangular form:

Lemma 8: Suppose the N by N matrix A has the following block upper triangular form: 17 4 Determinants and the Inverse of a Square Matrix In this section, we are going to use our knowledge of determinants and their properties to derive an explicit formula for the inverse of a square matrix

More information

2.1 Gaussian Elimination

2.1 Gaussian Elimination 2. Gaussian Elimination A common problem encountered in numerical models is the one in which there are n equations and n unknowns. The following is a description of the Gaussian elimination method for

More information

CS412: Lecture #17. Mridul Aanjaneya. March 19, 2015

CS412: Lecture #17. Mridul Aanjaneya. March 19, 2015 CS: Lecture #7 Mridul Aanjaneya March 9, 5 Solving linear systems of equations Consider a lower triangular matrix L: l l l L = l 3 l 3 l 33 l n l nn A procedure similar to that for upper triangular systems

More information

CHAPTER 6. Direct Methods for Solving Linear Systems

CHAPTER 6. Direct Methods for Solving Linear Systems CHAPTER 6 Direct Methods for Solving Linear Systems. Introduction A direct method for approximating the solution of a system of n linear equations in n unknowns is one that gives the exact solution to

More information

Matrices Gaussian elimination Determinants. Graphics 2009/2010, period 1. Lecture 4: matrices

Matrices Gaussian elimination Determinants. Graphics 2009/2010, period 1. Lecture 4: matrices Graphics 2009/2010, period 1 Lecture 4 Matrices m n matrices Matrices Definitions Diagonal, Identity, and zero matrices Addition Multiplication Transpose and inverse The system of m linear equations in

More information

Determinants Chapter 3 of Lay

Determinants Chapter 3 of Lay Determinants Chapter of Lay Dr. Doreen De Leon Math 152, Fall 201 1 Introduction to Determinants Section.1 of Lay Given a square matrix A = [a ij, the determinant of A is denoted by det A or a 11 a 1j

More information

Gaussian Elimination and Back Substitution

Gaussian Elimination and Back Substitution Jim Lambers MAT 610 Summer Session 2009-10 Lecture 4 Notes These notes correspond to Sections 31 and 32 in the text Gaussian Elimination and Back Substitution The basic idea behind methods for solving

More information

Math 240 Calculus III

Math 240 Calculus III The Calculus III Summer 2015, Session II Wednesday, July 8, 2015 Agenda 1. of the determinant 2. determinants 3. of determinants What is the determinant? Yesterday: Ax = b has a unique solution when A

More information

Lecture 12 (Tue, Mar 5) Gaussian elimination and LU factorization (II)

Lecture 12 (Tue, Mar 5) Gaussian elimination and LU factorization (II) Math 59 Lecture 2 (Tue Mar 5) Gaussian elimination and LU factorization (II) 2 Gaussian elimination - LU factorization For a general n n matrix A the Gaussian elimination produces an LU factorization if

More information

Undergraduate Mathematical Economics Lecture 1

Undergraduate Mathematical Economics Lecture 1 Undergraduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 15, 2014 Outline 1 Courses Description and Requirement 2 Course Outline ematical techniques used in economics courses

More information

Computational Linear Algebra

Computational Linear Algebra Computational Linear Algebra PD Dr. rer. nat. habil. Ralf Peter Mundani Computation in Engineering / BGU Scientific Computing in Computer Science / INF Winter Term 2017/18 Part 2: Direct Methods PD Dr.

More information

MATH2210 Notebook 2 Spring 2018

MATH2210 Notebook 2 Spring 2018 MATH2210 Notebook 2 Spring 2018 prepared by Professor Jenny Baglivo c Copyright 2009 2018 by Jenny A. Baglivo. All Rights Reserved. 2 MATH2210 Notebook 2 3 2.1 Matrices and Their Operations................................

More information

n n matrices The system of m linear equations in n variables x 1, x 2,..., x n can be written as a matrix equation by Ax = b, or in full

n n matrices The system of m linear equations in n variables x 1, x 2,..., x n can be written as a matrix equation by Ax = b, or in full n n matrices Matrices Definitions Diagonal, Identity, and zero matrices Addition Multiplication Transpose and inverse The system of m linear equations in n variables x 1, x 2,..., x n a 11 x 1 + a 12 x

More information

Lecture 2 INF-MAT : , LU, symmetric LU, Positve (semi)definite, Cholesky, Semi-Cholesky

Lecture 2 INF-MAT : , LU, symmetric LU, Positve (semi)definite, Cholesky, Semi-Cholesky Lecture 2 INF-MAT 4350 2009: 7.1-7.6, LU, symmetric LU, Positve (semi)definite, Cholesky, Semi-Cholesky Tom Lyche and Michael Floater Centre of Mathematics for Applications, Department of Informatics,

More information

Linear Algebraic Equations

Linear Algebraic Equations Linear Algebraic Equations 1 Fundamentals Consider the set of linear algebraic equations n a ij x i b i represented by Ax b j with [A b ] [A b] and (1a) r(a) rank of A (1b) Then Axb has a solution iff

More information

Chapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in

Chapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in Chapter 4 - MATRIX ALGEBRA 4.1. Matrix Operations A a 11 a 12... a 1j... a 1n a 21. a 22.... a 2j... a 2n. a i1 a i2... a ij... a in... a m1 a m2... a mj... a mn The entry in the ith row and the jth column

More information

Graduate Mathematical Economics Lecture 1

Graduate Mathematical Economics Lecture 1 Graduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 23, 2012 Outline 1 2 Course Outline ematical techniques used in graduate level economics courses Mathematics for Economists

More information

Numerical Methods I Solving Square Linear Systems: GEM and LU factorization

Numerical Methods I Solving Square Linear Systems: GEM and LU factorization Numerical Methods I Solving Square Linear Systems: GEM and LU factorization Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 MATH-GA 2011.003 / CSCI-GA 2945.003, Fall 2014 September 18th,

More information

Math Linear Algebra Final Exam Review Sheet

Math Linear Algebra Final Exam Review Sheet Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of

More information

SOLUTION OF GENERALIZED LINEAR VECTOR EQUATIONS IN IDEMPOTENT ALGEBRA

SOLUTION OF GENERALIZED LINEAR VECTOR EQUATIONS IN IDEMPOTENT ALGEBRA , pp. 23 36, 2006 Vestnik S.-Peterburgskogo Universiteta. Matematika UDC 519.63 SOLUTION OF GENERALIZED LINEAR VECTOR EQUATIONS IN IDEMPOTENT ALGEBRA N. K. Krivulin The problem on the solutions of homogeneous

More information

ANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3

ANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3 ANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3 ISSUED 24 FEBRUARY 2018 1 Gaussian elimination Let A be an (m n)-matrix Consider the following row operations on A (1) Swap the positions any

More information

ENGI 9420 Lecture Notes 2 - Matrix Algebra Page Matrix operations can render the solution of a linear system much more efficient.

ENGI 9420 Lecture Notes 2 - Matrix Algebra Page Matrix operations can render the solution of a linear system much more efficient. ENGI 940 Lecture Notes - Matrix Algebra Page.0. Matrix Algebra A linear system of m equations in n unknowns, a x + a x + + a x b (where the a ij and i n n a x + a x + + a x b n n a x + a x + + a x b m

More information

Foundations of Matrix Analysis

Foundations of Matrix Analysis 1 Foundations of Matrix Analysis In this chapter we recall the basic elements of linear algebra which will be employed in the remainder of the text For most of the proofs as well as for the details, the

More information

Determinants. Samy Tindel. Purdue University. Differential equations and linear algebra - MA 262

Determinants. Samy Tindel. Purdue University. Differential equations and linear algebra - MA 262 Determinants Samy Tindel Purdue University Differential equations and linear algebra - MA 262 Taken from Differential equations and linear algebra by Goode and Annin Samy T. Determinants Differential equations

More information

1 Determinants. 1.1 Determinant

1 Determinants. 1.1 Determinant 1 Determinants [SB], Chapter 9, p.188-196. [SB], Chapter 26, p.719-739. Bellow w ll study the central question: which additional conditions must satisfy a quadratic matrix A to be invertible, that is to

More information

Linear Systems and Matrices

Linear Systems and Matrices Department of Mathematics The Chinese University of Hong Kong 1 System of m linear equations in n unknowns (linear system) a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.......

More information

Linear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0.

Linear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0. Matrices Operations Linear Algebra Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0 The rectangular array 1 2 1 4 3 4 2 6 1 3 2 1 in which the

More information

Linear Algebra. James Je Heon Kim

Linear Algebra. James Je Heon Kim Linear lgebra James Je Heon Kim (jjk9columbia.edu) If you are unfamiliar with linear or matrix algebra, you will nd that it is very di erent from basic algebra or calculus. For the duration of this session,

More information

Chapter 7. Linear Algebra: Matrices, Vectors,

Chapter 7. Linear Algebra: Matrices, Vectors, Chapter 7. Linear Algebra: Matrices, Vectors, Determinants. Linear Systems Linear algebra includes the theory and application of linear systems of equations, linear transformations, and eigenvalue problems.

More information

SOLVING LINEAR SYSTEMS

SOLVING LINEAR SYSTEMS SOLVING LINEAR SYSTEMS We want to solve the linear system a, x + + a,n x n = b a n, x + + a n,n x n = b n This will be done by the method used in beginning algebra, by successively eliminating unknowns

More information

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 6

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 6 CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 6 GENE H GOLUB Issues with Floating-point Arithmetic We conclude our discussion of floating-point arithmetic by highlighting two issues that frequently

More information

Letting be a field, e.g., of the real numbers, the complex numbers, the rational numbers, the rational functions W(s) of a complex variable s, etc.

Letting be a field, e.g., of the real numbers, the complex numbers, the rational numbers, the rational functions W(s) of a complex variable s, etc. 1 Polynomial Matrices 1.1 Polynomials Letting be a field, e.g., of the real numbers, the complex numbers, the rational numbers, the rational functions W(s) of a complex variable s, etc., n ws ( ) as a

More information

Direct Methods for Solving Linear Systems. Matrix Factorization

Direct Methods for Solving Linear Systems. Matrix Factorization Direct Methods for Solving Linear Systems Matrix Factorization Numerical Analysis (9th Edition) R L Burden & J D Faires Beamer Presentation Slides prepared by John Carroll Dublin City University c 2011

More information

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 13

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 13 STAT 309: MATHEMATICAL COMPUTATIONS I FALL 208 LECTURE 3 need for pivoting we saw that under proper circumstances, we can write A LU where 0 0 0 u u 2 u n l 2 0 0 0 u 22 u 2n L l 3 l 32, U 0 0 0 l n l

More information

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing

More information

Determinants - Uniqueness and Properties

Determinants - Uniqueness and Properties Determinants - Uniqueness and Properties 2-2-2008 In order to show that there s only one determinant function on M(n, R), I m going to derive another formula for the determinant It involves permutations

More information

Introduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX

Introduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX Introduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX September 2007 MSc Sep Intro QT 1 Who are these course for? The September

More information

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2018 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing

More information

Lesson 3. Inverse of Matrices by Determinants and Gauss-Jordan Method

Lesson 3. Inverse of Matrices by Determinants and Gauss-Jordan Method Module 1: Matrices and Linear Algebra Lesson 3 Inverse of Matrices by Determinants and Gauss-Jordan Method 3.1 Introduction In lecture 1 we have seen addition and multiplication of matrices. Here we shall

More information

arxiv: v1 [cs.sc] 17 Apr 2013

arxiv: v1 [cs.sc] 17 Apr 2013 EFFICIENT CALCULATION OF DETERMINANTS OF SYMBOLIC MATRICES WITH MANY VARIABLES TANYA KHOVANOVA 1 AND ZIV SCULLY 2 arxiv:1304.4691v1 [cs.sc] 17 Apr 2013 Abstract. Efficient matrix determinant calculations

More information

Dense LU factorization and its error analysis

Dense LU factorization and its error analysis Dense LU factorization and its error analysis Laura Grigori INRIA and LJLL, UPMC February 2016 Plan Basis of floating point arithmetic and stability analysis Notation, results, proofs taken from [N.J.Higham,

More information

Equality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same.

Equality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same. Introduction Matrix Operations Matrix: An m n matrix A is an m-by-n array of scalars from a field (for example real numbers) of the form a a a n a a a n A a m a m a mn The order (or size) of A is m n (read

More information

Materials engineering Collage \\ Ceramic & construction materials department Numerical Analysis \\Third stage by \\ Dalya Hekmat

Materials engineering Collage \\ Ceramic & construction materials department Numerical Analysis \\Third stage by \\ Dalya Hekmat Materials engineering Collage \\ Ceramic & construction materials department Numerical Analysis \\Third stage by \\ Dalya Hekmat Linear Algebra Lecture 2 1.3.7 Matrix Matrix multiplication using Falk s

More information

Matrix Algebra Determinant, Inverse matrix. Matrices. A. Fabretti. Mathematics 2 A.Y. 2015/2016. A. Fabretti Matrices

Matrix Algebra Determinant, Inverse matrix. Matrices. A. Fabretti. Mathematics 2 A.Y. 2015/2016. A. Fabretti Matrices Matrices A. Fabretti Mathematics 2 A.Y. 2015/2016 Table of contents Matrix Algebra Determinant Inverse Matrix Introduction A matrix is a rectangular array of numbers. The size of a matrix is indicated

More information

THREE LECTURES ON QUASIDETERMINANTS

THREE LECTURES ON QUASIDETERMINANTS THREE LECTURES ON QUASIDETERMINANTS Robert Lee Wilson Department of Mathematics Rutgers University The determinant of a matrix with entries in a commutative ring is a main organizing tool in commutative

More information

MATRICES. a m,1 a m,n A =

MATRICES. a m,1 a m,n A = MATRICES Matrices are rectangular arrays of real or complex numbers With them, we define arithmetic operations that are generalizations of those for real and complex numbers The general form a matrix of

More information

Linear Algebra and Matrix Inversion

Linear Algebra and Matrix Inversion Jim Lambers MAT 46/56 Spring Semester 29- Lecture 2 Notes These notes correspond to Section 63 in the text Linear Algebra and Matrix Inversion Vector Spaces and Linear Transformations Matrices are much

More information

Matrices A brief introduction

Matrices A brief introduction Matrices A brief introduction Basilio Bona DAUIN Politecnico di Torino Semester 1, 2014-15 B. Bona (DAUIN) Matrices Semester 1, 2014-15 1 / 41 Definitions Definition A matrix is a set of N real or complex

More information

Lecture 1 INF-MAT : Chapter 2. Examples of Linear Systems

Lecture 1 INF-MAT : Chapter 2. Examples of Linear Systems Lecture 1 INF-MAT 4350 2010: Chapter 2. Examples of Linear Systems Tom Lyche Centre of Mathematics for Applications, Department of Informatics, University of Oslo August 26, 2010 Notation The set of natural

More information

Chapter 1: Systems of linear equations and matrices. Section 1.1: Introduction to systems of linear equations

Chapter 1: Systems of linear equations and matrices. Section 1.1: Introduction to systems of linear equations Chapter 1: Systems of linear equations and matrices Section 1.1: Introduction to systems of linear equations Definition: A linear equation in n variables can be expressed in the form a 1 x 1 + a 2 x 2

More information

William Stallings Copyright 2010

William Stallings Copyright 2010 A PPENDIX E B ASIC C ONCEPTS FROM L INEAR A LGEBRA William Stallings Copyright 2010 E.1 OPERATIONS ON VECTORS AND MATRICES...2 Arithmetic...2 Determinants...4 Inverse of a Matrix...5 E.2 LINEAR ALGEBRA

More information

Direct Methods for Solving Linear Systems. Simon Fraser University Surrey Campus MACM 316 Spring 2005 Instructor: Ha Le

Direct Methods for Solving Linear Systems. Simon Fraser University Surrey Campus MACM 316 Spring 2005 Instructor: Ha Le Direct Methods for Solving Linear Systems Simon Fraser University Surrey Campus MACM 316 Spring 2005 Instructor: Ha Le 1 Overview General Linear Systems Gaussian Elimination Triangular Systems The LU Factorization

More information

Elementary Row Operations on Matrices

Elementary Row Operations on Matrices King Saud University September 17, 018 Table of contents 1 Definition A real matrix is a rectangular array whose entries are real numbers. These numbers are organized on rows and columns. An m n matrix

More information

arxiv: v1 [cs.sc] 29 Jul 2009

arxiv: v1 [cs.sc] 29 Jul 2009 An Explicit Construction of Gauss-Jordan Elimination Matrix arxiv:09075038v1 [cssc] 29 Jul 2009 Yi Li Laboratory of Computer Reasoning and Trustworthy Computing, University of Electronic Science and Technology

More information

LINEAR SYSTEMS, MATRICES, AND VECTORS

LINEAR SYSTEMS, MATRICES, AND VECTORS ELEMENTARY LINEAR ALGEBRA WORKBOOK CREATED BY SHANNON MARTIN MYERS LINEAR SYSTEMS, MATRICES, AND VECTORS Now that I ve been teaching Linear Algebra for a few years, I thought it would be great to integrate

More information

MTH 102A - Linear Algebra II Semester

MTH 102A - Linear Algebra II Semester MTH 0A - Linear Algebra - 05-6-II Semester Arbind Kumar Lal P Field A field F is a set from which we choose our coefficients and scalars Expected properties are ) a+b and a b should be defined in it )

More information

Section 9.2: Matrices. Definition: A matrix A consists of a rectangular array of numbers, or elements, arranged in m rows and n columns.

Section 9.2: Matrices. Definition: A matrix A consists of a rectangular array of numbers, or elements, arranged in m rows and n columns. Section 9.2: Matrices Definition: A matrix A consists of a rectangular array of numbers, or elements, arranged in m rows and n columns. That is, a 11 a 12 a 1n a 21 a 22 a 2n A =...... a m1 a m2 a mn A

More information

Numerical Analysis Lecture Notes

Numerical Analysis Lecture Notes Numerical Analysis Lecture Notes Peter J Olver 3 Review of Matrix Algebra Vectors and matrices are essential for modern analysis of systems of equations algebrai, differential, functional, etc In this

More information

Review of Vectors and Matrices

Review of Vectors and Matrices A P P E N D I X D Review of Vectors and Matrices D. VECTORS D.. Definition of a Vector Let p, p, Á, p n be any n real numbers and P an ordered set of these real numbers that is, P = p, p, Á, p n Then P

More information

Chapter 3. Basic Properties of Matrices

Chapter 3. Basic Properties of Matrices 3.1. Basic Definitions and Notations 1 Chapter 3. Basic Properties of Matrices Note. This long chapter (over 100 pages) contains the bulk of the material for this course. As in Chapter 2, unless stated

More information

Linear Algebra Practice Final

Linear Algebra Practice Final . Let (a) First, Linear Algebra Practice Final Summer 3 3 A = 5 3 3 rref([a ) = 5 so if we let x 5 = t, then x 4 = t, x 3 =, x = t, and x = t, so that t t x = t = t t whence ker A = span(,,,, ) and a basis

More information

Math Camp II. Basic Linear Algebra. Yiqing Xu. Aug 26, 2014 MIT

Math Camp II. Basic Linear Algebra. Yiqing Xu. Aug 26, 2014 MIT Math Camp II Basic Linear Algebra Yiqing Xu MIT Aug 26, 2014 1 Solving Systems of Linear Equations 2 Vectors and Vector Spaces 3 Matrices 4 Least Squares Systems of Linear Equations Definition A linear

More information

EE731 Lecture Notes: Matrix Computations for Signal Processing

EE731 Lecture Notes: Matrix Computations for Signal Processing EE731 Lecture Notes: Matrix Computations for Signal Processing James P. Reilly c Department of Electrical and Computer Engineering McMaster University September 22, 2005 0 Preface This collection of ten

More information

Components and change of basis

Components and change of basis Math 20F Linear Algebra Lecture 16 1 Components and change of basis Slide 1 Review: Isomorphism Review: Components in a basis Unique representation in a basis Change of basis Review: Isomorphism Definition

More information

MATH 2030: EIGENVALUES AND EIGENVECTORS

MATH 2030: EIGENVALUES AND EIGENVECTORS MATH 2030: EIGENVALUES AND EIGENVECTORS Determinants Although we are introducing determinants in the context of matrices, the theory of determinants predates matrices by at least two hundred years Their

More information

MATH 315 Linear Algebra Homework #1 Assigned: August 20, 2018

MATH 315 Linear Algebra Homework #1 Assigned: August 20, 2018 Homework #1 Assigned: August 20, 2018 Review the following subjects involving systems of equations and matrices from Calculus II. Linear systems of equations Converting systems to matrix form Pivot entry

More information

Linear Algebra M1 - FIB. Contents: 5. Matrices, systems of linear equations and determinants 6. Vector space 7. Linear maps 8.

Linear Algebra M1 - FIB. Contents: 5. Matrices, systems of linear equations and determinants 6. Vector space 7. Linear maps 8. Linear Algebra M1 - FIB Contents: 5 Matrices, systems of linear equations and determinants 6 Vector space 7 Linear maps 8 Diagonalization Anna de Mier Montserrat Maureso Dept Matemàtica Aplicada II Translation:

More information

MaTp qhoe SbIq CAeH e cy6pe3yat, TaHTHBIX. IIOAHHOMIIaAbHbIX nocaeaobateabhoctefl OCTaTKOB B HHTeFpaABHblX 06AaCTXX

MaTp qhoe SbIq CAeH e cy6pe3yat, TaHTHBIX. IIOAHHOMIIaAbHbIX nocaeaobateabhoctefl OCTaTKOB B HHTeFpaABHblX 06AaCTXX Matrix computation of polynomial remainder domains Reliable Computing 1 (4) (1995), pp. 375-381 subresultant sequences in integral ALKIVIADIS G. AKRITAS, EVGENIA K. AKRITAS, and GENADII I. MALASCHONOK

More information

Matrix & Linear Algebra

Matrix & Linear Algebra Matrix & Linear Algebra Jamie Monogan University of Georgia For more information: http://monogan.myweb.uga.edu/teaching/mm/ Jamie Monogan (UGA) Matrix & Linear Algebra 1 / 84 Vectors Vectors Vector: A

More information

Matrix Algebra. Matrix Algebra. Chapter 8 - S&B

Matrix Algebra. Matrix Algebra. Chapter 8 - S&B Chapter 8 - S&B Algebraic operations Matrix: The size of a matrix is indicated by the number of its rows and the number of its columns. A matrix with k rows and n columns is called a k n matrix. The number

More information

1 Matrices and Systems of Linear Equations

1 Matrices and Systems of Linear Equations Linear Algebra (part ) : Matrices and Systems of Linear Equations (by Evan Dummit, 207, v 260) Contents Matrices and Systems of Linear Equations Systems of Linear Equations Elimination, Matrix Formulation

More information

MAC Module 3 Determinants. Learning Objectives. Upon completing this module, you should be able to:

MAC Module 3 Determinants. Learning Objectives. Upon completing this module, you should be able to: MAC 2 Module Determinants Learning Objectives Upon completing this module, you should be able to:. Determine the minor, cofactor, and adjoint of a matrix. 2. Evaluate the determinant of a matrix by cofactor

More information

Solving Linear Systems Using Gaussian Elimination. How can we solve

Solving Linear Systems Using Gaussian Elimination. How can we solve Solving Linear Systems Using Gaussian Elimination How can we solve? 1 Gaussian elimination Consider the general augmented system: Gaussian elimination Step 1: Eliminate first column below the main diagonal.

More information

Matrix Operations: Determinant

Matrix Operations: Determinant Matrix Operations: Determinant Determinants Determinants are only applicable for square matrices. Determinant of the square matrix A is denoted as: det(a) or A Recall that the absolute value of the determinant

More information

Math113: Linear Algebra. Beifang Chen

Math113: Linear Algebra. Beifang Chen Math3: Linear Algebra Beifang Chen Spring 26 Contents Systems of Linear Equations 3 Systems of Linear Equations 3 Linear Systems 3 2 Geometric Interpretation 3 3 Matrices of Linear Systems 4 4 Elementary

More information

MATH 3511 Lecture 1. Solving Linear Systems 1

MATH 3511 Lecture 1. Solving Linear Systems 1 MATH 3511 Lecture 1 Solving Linear Systems 1 Dmitriy Leykekhman Spring 2012 Goals Review of basic linear algebra Solution of simple linear systems Gaussian elimination D Leykekhman - MATH 3511 Introduction

More information

Scientific Computing: Dense Linear Systems

Scientific Computing: Dense Linear Systems Scientific Computing: Dense Linear Systems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course MATH-GA.2043 or CSCI-GA.2112, Spring 2012 February 9th, 2012 A. Donev (Courant Institute)

More information

Things we can already do with matrices. Unit II - Matrix arithmetic. Defining the matrix product. Things that fail in matrix arithmetic

Things we can already do with matrices. Unit II - Matrix arithmetic. Defining the matrix product. Things that fail in matrix arithmetic Unit II - Matrix arithmetic matrix multiplication matrix inverses elementary matrices finding the inverse of a matrix determinants Unit II - Matrix arithmetic 1 Things we can already do with matrices equality

More information

Linear Algebra Primer

Linear Algebra Primer Introduction Linear Algebra Primer Daniel S. Stutts, Ph.D. Original Edition: 2/99 Current Edition: 4//4 This primer was written to provide a brief overview of the main concepts and methods in elementary

More information

Matrices. Chapter Definitions and Notations

Matrices. Chapter Definitions and Notations Chapter 3 Matrices 3. Definitions and Notations Matrices are yet another mathematical object. Learning about matrices means learning what they are, how they are represented, the types of operations which

More information

Lecture Notes in Linear Algebra

Lecture Notes in Linear Algebra Lecture Notes in Linear Algebra Dr. Abdullah Al-Azemi Mathematics Department Kuwait University February 4, 2017 Contents 1 Linear Equations and Matrices 1 1.2 Matrices............................................

More information

Daily Update. Math 290: Elementary Linear Algebra Fall 2018

Daily Update. Math 290: Elementary Linear Algebra Fall 2018 Daily Update Math 90: Elementary Linear Algebra Fall 08 Lecture 7: Tuesday, December 4 After reviewing the definitions of a linear transformation, and the kernel and range of a linear transformation, we

More information

Linear Algebra: Lecture Notes. Dr Rachel Quinlan School of Mathematics, Statistics and Applied Mathematics NUI Galway

Linear Algebra: Lecture Notes. Dr Rachel Quinlan School of Mathematics, Statistics and Applied Mathematics NUI Galway Linear Algebra: Lecture Notes Dr Rachel Quinlan School of Mathematics, Statistics and Applied Mathematics NUI Galway November 6, 23 Contents Systems of Linear Equations 2 Introduction 2 2 Elementary Row

More information

Algebra & Trig. I. For example, the system. x y 2 z. may be represented by the augmented matrix

Algebra & Trig. I. For example, the system. x y 2 z. may be represented by the augmented matrix Algebra & Trig. I 8.1 Matrix Solutions to Linear Systems A matrix is a rectangular array of elements. o An array is a systematic arrangement of numbers or symbols in rows and columns. Matrices (the plural

More information

II. Determinant Functions

II. Determinant Functions Supplemental Materials for EE203001 Students II Determinant Functions Chung-Chin Lu Department of Electrical Engineering National Tsing Hua University May 22, 2003 1 Three Axioms for a Determinant Function

More information

MATH 425-Spring 2010 HOMEWORK ASSIGNMENTS

MATH 425-Spring 2010 HOMEWORK ASSIGNMENTS MATH 425-Spring 2010 HOMEWORK ASSIGNMENTS Instructor: Shmuel Friedland Department of Mathematics, Statistics and Computer Science email: friedlan@uic.edu Last update April 18, 2010 1 HOMEWORK ASSIGNMENT

More information

MTH5112 Linear Algebra I MTH5212 Applied Linear Algebra (2017/2018)

MTH5112 Linear Algebra I MTH5212 Applied Linear Algebra (2017/2018) MTH5112 Linear Algebra I MTH5212 Applied Linear Algebra (2017/2018) COURSEWORK 3 SOLUTIONS Exercise ( ) 1. (a) Write A = (a ij ) n n and B = (b ij ) n n. Since A and B are diagonal, we have a ij = 0 and

More information

Problem Set 9 Due: In class Tuesday, Nov. 27 Late papers will be accepted until 12:00 on Thursday (at the beginning of class).

Problem Set 9 Due: In class Tuesday, Nov. 27 Late papers will be accepted until 12:00 on Thursday (at the beginning of class). Math 3, Fall Jerry L. Kazdan Problem Set 9 Due In class Tuesday, Nov. 7 Late papers will be accepted until on Thursday (at the beginning of class).. Suppose that is an eigenvalue of an n n matrix A and

More information

Linear Algebra and Vector Analysis MATH 1120

Linear Algebra and Vector Analysis MATH 1120 Faculty of Engineering Mechanical Engineering Department Linear Algebra and Vector Analysis MATH 1120 : Instructor Dr. O. Philips Agboola Determinants and Cramer s Rule Determinants If a matrix is square

More information

Prepared by: M. S. KumarSwamy, TGT(Maths) Page

Prepared by: M. S. KumarSwamy, TGT(Maths) Page Prepared by: M. S. KumarSwamy, TGT(Maths) Page - 50 - CHAPTER 3: MATRICES QUICK REVISION (Important Concepts & Formulae) MARKS WEIGHTAGE 03 marks Matrix A matrix is an ordered rectangular array of numbers

More information