arxiv: v2 [math.na] 9 Jun 2009

Transcription

1 ON THE CHOLESKY METHOD arxiv: v [mathna] 9 Jun 009 Christian Rakotonirina Institut Supérieur de Technologie d Antananarivo, IST-T, BP 8, Madagascar rakotopierre@refermg June 9, 009 Abstract In this paper, we prove that if the matrix of the linear system is symmetric, the Cholesky decomposition can be obtained from the Gauss elimination method without pivoting, without proving that the matrix of the system is positive definite MSC: Primary 5A06 Keywords: Linear system, Gauss elimination, Cholesky decomposition Introduction The direct methods for solving linear system, Gauss elimination method, LU decomposition and Cholesky method are we known We agreed with some authors [],[] that the LU decomposition and the Cholesky method are helpful for solving many linear systems of the same matrix, whose difference is only the constants at the right hand side The Gauss elimination method with or without pivoting can lead us to the LU decomposition The Gauss elimination method with pivoting applied to linear system with symmetric matrix can t lead us to the Cholesky decomposition because pivoting alters the symmetry However, sometimes we don t need pivoting Since the Gauss elimination can lead us to the LU decomposition, we think that it is better to solve at first one of these linear systems by the Gauss elimination and the others by LU decomposition So, we wi be aowed to solve at first one of these linear systems by the Gauss eliminaton and the others by Cholesky method, in the case where the matrix is symmetric positive definite, if Gauss elimination can lead us to the Cholesky method In this paper, we wi see that there exist relation between Gauss elimination without pivoting and the Cholesky method That is Gauss elimination without pivoting can lead us to Cholesky decomposition We wi prove this relation by using the LU decomposition We organize the paper as the foowing In the second section we represent the LU decomposition by using the Gauss elimination method In the third

2 section we wi prove, with the help of the LU decomposition we can have the Cholesky decomposition from the Gauss elimination method At the last section an example wi be tread for clarify the method Gauss elimination Let us consider the foowing system of linear n equations and n unknowns a x + a + + a n x n = b a x + a + + a n x n = b a i x + a i + + a in x n = b i a n x + a n + + a nn x n = b n which can be written under matricial form AX = B () where A = (a ij ) i,j n, X =, B = b x x n If a 0, Gauss elimination in the first column is written x n x n = b (0) a () + + n x n = b () i + + in x n = b () i n + + nnx n = b () n with j = a j and ij = which may matriciay be written b b n aiaj aaij a, A X = B () and can be obtained in multiplying () by the lower triangular matrix[], [4]

3 G = A = G A and B = G B a(0) a(0) a(0) n The Gauss elimination at the second column can be obtained by multiplying to the relation () the lower triangular matrix G = a() 0 a() 4 0 a() n The matricial equation () becomes A X = B with A = G G A and B = G G B In continuing so, we have finay, UX = B () with U = G n G G A an upper triangular matrix and B = G n G G B We can check easily that the inverse of G l is

4 G l = a (l ) (l+)l a (l ) 0 0 a (l ) nl a (l ) So, G n G n G G is an invertible matrix and the equation () becomes LUX = B with L = G G Gn G n and we have the decomposition of A as product of lower triangular matrix by an upper triangular matrix A = LU One can check easily that L = 0 a (l ) (l+) (l+) (l+)l 0 a (l ) n (n) a (l ) nl a (l ) 4

5 Cholesky method Now suppose A is a symmetric positive definite matrix Then, the Cholesky method consists to decompose A as the product A = G T G with G is a upper triangular matrix and G T his transpose Let us at first generalize this decomposition Definition Let A = (a ij ) i,j n a complex symmetric matrix Let us ca Gauss matrix of A the upper triangular matrix U(A), obtained after transforming A by the Gauss elimination above Proposition Let A = (a ij ) i,j n a complex symmetric matrix, such that det(a) 0, u u u n 0 u u n U(A) = 0 0 u nn the Gauss matrix of A Then A can be decomposed as the product A = G T G with u u u u u n u 0 u u u u n G = u 0 0 unn nn with u ii a root squared of the complex number u ii Proof U(A) = n 0 n 0 0 a nn (n ) 5

6 L(A) = (l+) n (l+) (n) a (l ) (l+)l a (l ) a (l ) nl a (l ) 0 A = L(A)D DU(A) with D = q 0 q a (n ) nn Let G = DU(A) Since A symmetric, hence L(A)D = G T Example Consider the foowing two systems of linear equations x + = x x = = 7 x + x + 4 = x + = x x = = x + x + 4 = whose difference is only the right hand side and their matrix is symmetric So let us solve the first one by the Gauss elimination method, and the second one 6

7 by the Cholesky method or LU method x x = x x x x x x = x x = = x x = = =, 4x + = 6, x =, 4 4 =, =, x + =, x = Now, let us move to the second equation, which { can be written, after the G Proposition, G T GX = B and solved in writing T Y = B GX = Y y y y y 4 = y =, + y =, y =, + y =, y = 0, + y 4 =, y 4 = 0 x x = =, x + = 0, x =, =, = 7 4, x =, x =

8 References [] B Démidovitch and I Maron Eléments de Calcul NumériqueEditions Mir, 979 [] JP Nougier Méthodes de Calcul Numérique Masson Paris, 987 [] David Kincaid and Ward Cheney Numerical Mathematics and Computing Brooks/Cole Publishing Co, Pacific Grove, CA, fourth edition, 999 ISBN [4] E Pav Steven Numerical Methods Course Notes spav/pub/numaspdf 8