arxiv: v3 [math.na] 1 Jan 2015

Size: px
Start display at page:

Download "arxiv: v3 [math.na] 1 Jan 2015"

Transcription

1 On Solving Pentadiagonal Linear Systems via Transformations arxiv: v3 [mathna] 1 Jan 2015 A A KARAWIA Computer Science Unit Deanship of Educational Services Qassim University POBox 6595 Buraidah Saudi Arabia kraoieh@quedusa Abstract Many authors studied numerical algorithms for solving the linear systems of the pentadiagonal type The well-known Fast Pentadiagonal System Solver algorithm is an example of such algorithms The current article is describes new numerical and symbolic algorithms for solving pentadiagonal linear systems via transformations New algorithms are natural generalization of the work presented in [Moawwad El-Mikkawy and Faiz Atlan Algorithms for Solving Linear Systems of Equations of Tridiagonal Type via Transformations Applied Mathematics ] The symbolic algorithms remove the cases where the numerical algorithms fail The computational cost of our algorithms is given Some examples are given in order to illustrate the effectiveness of the proposed algorithms All of the experiments are performed on a computer with the aid of programs written in MATLAB Keywords:Pentadiagonal matrix; Backward pentadiagonal; Permutation matrix; Linear systems; Algorithm; MATLAB AMS Subject Classification:15A15; 15A23; 68W30; 11Y05; 33F10; F21; G10 1 Introduction The pentadiagonal linear systems denoted by (PLS) take the forms: PX = Y (11) where P is n by n pentadiagonal matrix given by d 1 a 1 b c 2 d 2 a 2 b e 3 c 3 d 3 a 3 b e 4 c 4 d 4 a 4 b P = n 4 (12) 0 0 e n 2 c n 2 d n 2 a n 2 b n e n 1 c n 1 d n 1 a n e n c n d n and X = (x 1 x 2 x n ) t Y = (y 1 y 2 y n ) t are vectors of length n This kind of linear systems is well known in the literature [1-11] and often these types of linear systems are widely used in areas of science and engineering for example in numerical solution of ordinary and partial differential equations (ODE and PDE) interpolation problems boundary value problems (BVP) parallel Home Address: Mathematics Department Faculty of Science Mansoura University Mansoura Egypt E- mail:abibka@mansedueg

2 computing Physics matrix algebra[4-13] In [7] the author presented an efficient computational algorithm for solving periodic pentadiagonal linear systems The algorithm is based on the LU factorization of the periodic pentadiagonal matrix New algorithms are described for solving periodic pentadiagonal linear systems based on the use of any pentadiagonal linear solver and the author described a symbolic algorithm for solving pentadiagonal linear systems[8] In [9] the authors discussed the general nonsymmetric problem and proposed an algorithm for solving nonsymmetric penta-diagonal Toeplitz linear systems A fast algorithm for solving a large system with a symmetric Toeplitz penta-diagonal coefficient matrix is presented[10] This efficient method is based on the idea of a system perturbation followed by corrections and is competitive with standard methods In [11] the authors described an efficient computational algorithm and symbolic algorithm for solving nearly pentadiagonal linear systems based on the LU factorization of the nearly pentadiagonal matrix In this paper we show that more efficient algorithms are derived via transformations that can be regarded as a natural generalization of the efficient algorithms in [14] The current paper is organized as follows: In Section 2 new numerical algorithms for solving a pentadiagonal linear system are presented New symbolic algorithms for solving a pentadiagonal linear system are constructed in Section 3 In Section 4 three illustrative examples are presented Conclusions of the work are given in Section 5 2 Numerical Algorithms for Solving PLS In this section we shall focus on the construction of new numerical algorithms for computing the solution of pentadiagonal linear system For this purpose it is convenient to give five vectors α = (α 1 α 2 α n 1 ) β = (β 1 β 2 β n 2 ) Z = (z 1 z 2 z n ) γ = (γ 2 γ 3 γ n ) and µ = ( µ n ) where α i = { a1 i = 1 a i β i 1γ i i = 23n 1 (21) and β i = b i i = 23n 1 (22) y 1 i = 1 y z i = 2 z 1γ 2 i = 2 (23) y i z i 2e i z i 1γ i i = 34n { γ i = c 2 i = 2 c i α i 2 e i i = 34n d 1 i = 1 = d 2 α 1 γ 2 i = 2 d i β i 2 e i α i 1 γ i i = 34n By using the vectors α β Z γ and µ together with the suitable elementary row operations we see that the system (11) may be transformed to the equivalent linear system: 1 α 1 β α 2 β α 3 β α 4 β α n 2 β n α n x 1 x 2 x 3 x 4 x n 2 x n 1 x n = z 1 z 2 z 3 z 4 z n 2 z n 1 z n (24) (25) (26)

3 The transformed system (26) is easy to solve by a backward substitution Consequently the PLS (11) can be solved using the following algorithm: Algorithm 21 First numerical algorithm for solving pentadiagonal linear system To find the solution of PLS (11) using the transformed system (26) we may proceed as follows: INPUT order of the matrix n and the components d i a i b i c i e i f i i = 12n(a n = b n = b n 1 = c 1 = e 1 = e 2 = 0) OUTPUT The solution vector x = (x 1 x 2 x n ) t Step 1: Use DETGPENTA algorithm [13] to check the non-singularity of the coefficient matrix of the system (13) Step 2: If det(p) = 0 then Exit and Print Message ( No solutions ) end if Step 3: Set = d 1 α 1 = a1 β 1 = b1 and z 1 = y1 Step 4: Set γ 2 = c 2 = d 2 α 1 γ 2 α 2 = a2 β1γ2 β 2 = b2 and z 2 = y2 z1γ2 Step 5: For i=34n-2 do γ i = c i α i 2 e i = d i β i 2 e i α i 1 γ i α i = ai βi 1γi β i = bi z i = yi zi 2ei zi 1γi End do γ n 1 = c n 1 α n 3 e n 1 µ n 1 = d n 1 β n 3 e n 1 α n 2 γ n 1 α n 1 = an 1 βn 2γn 1 µ n 1 γ n = c n α n 2 e n µ n = d n β n 2 e n α n 1 γ n z n 1 = yn 1 zn 2en 1 zn 2γn 1 µ n 1 z n = yn zn 1en zn 1γn µ n Step 6: Compute the solution vector X = (x 1 x 2 x n ) t using x n = z n x n 1 = z n 1 α n 1 x n For i=n-2 n-3 1 do x i = z i α i x i+1 β i x i+2 End do The numerical Algorithm 21 will be referred to as PTRANS-I algorithm The computational cost of PTRANS-I algorithm is 19n 29 operations The conditions 0i = 12n are sufficient for its validity In a similar manner we may consider five vectors σ = (σ 2 σ 3 σ n ) φ = (φ 3 φ 4 φ n ) W = (w 1 w 2 w n ) ρ = (ρ 1 ρ 2 ρ n 1 ) and ψ = (ψ 1 ψ 2 ) where σ i = { cn c i φ i+1ρ i i = n i = n 1n 22 (27) φ i = e i i = nn 13 (28) y n i = n y n 1 w nρ n 1 w i = 1 i = n 1 y i w i+2b i w i+1ρ i i = n 2n 31 (29) { an 1 i = n 1 ρ i = a i σ i+2 b i i = n 2n 31 (210)

4 and d n = d n 1 σ n ρ n 1 d i φ i+2 b i σ i+1 ρ i i = n i = n 1 i = n 2n 31 (211) Now we will present another algorithm for solving PLS As in PTRANS-I algorithm by using the vectors σ φ W ρ and ψ together with the suitable elementary row operations we see that the system (11) may be transformed to the equivalent linear system: σ φ 3 σ φ 4 σ φ n 2 σ n φ n 1 σ n φ n σ n 1 x 1 x 2 x 3 x 4 x n 2 x n 1 x n = w 1 w 2 w 3 w 4 w n 2 w n 1 w n (212) The transformed system (212) is easy to solve by a forward substitution Consequently the PLS (11) can be solved using the following algorithm: Algorithm 22 Second numerical algorithm for solving pentadiagonal linear system To find the solution of PLS (11) using the transformed system (212) we may proceed as follows: INPUT order of the matrix n and the components d i a i b i c i e i f i i = 12n(a n = b n = b n 1 = c 1 = e 1 = e 2 = 0) OUTPUT The solution vector x = (x 1 x 2 x n ) t Step 1: Use DETGPENTA algorithm [13] to check the non-singularity of the coefficient matrix of the system (13) Step 2: If det(p) = 0 then Exit and Print Message ( No solutions ) end if Step 3: Set = d n σ n = cn φ n = en and w n = yn Step 4: Set ρ n 1 = a n 1 1 = d n 1 σ n ρ n 1 σ n 1 = cn 1 φnρn 1 y n 1 w nρ n 1 1 Step 5: For i=n-2 n-3 3 do ρ i = a i σ i+2 b i = d i φ i+2 b i σ i+1 ρ i σ i = ci φi+1ρi φ i = ei w i = yi wi+2bi wi+1ρi End do ρ 2 = a 2 σ 4 b 2 ψ 2 = d 2 φ 4 b 2 σ 3 ρ 2 σ 2 = c2 φ4ρ2 ψ 2 ρ 1 = a 1 σ 3 b 1 ψ 1 = d 1 φ 3 b 1 σ 2 ρ 1 w 2 = y2 w4b2 w3ρ2 ψ 2 w 1 = y1 w3b1 w2ρ1 ψ 1 Step 6: Compute the solution vector X = (x 1 x 2 x n ) t using x = w 1 x 2 = w 2 σ 2 x 1 For i=3 4 n do 1 φ n 1 = en 1 1 and w n 1 =

5 x i = w i σ i x i 1 φ i x i 2 End do The numerical Algorithm 22 will be referred to as PTRANS-II algorithm The computational cost of PTRANS-II algorithm is 19n 29 operations Also the conditions 0i = 12n are sufficient for its validity If = 0 or = 0 for any i {12n} then PTRANS-I and PTRANS-II algorithm fail to solve pentadiagonal linear systems respectively So in the next section we developed two symbolic algorithms in order to remove the cases where the numerical algorithms fail The parameter p in the following symbolic algorithms is just a symbolic name It is a dummy argument and its actual value is zero 3 Symbolic Algorithms for Solving PLS In this section we shall focus on the construction of new symbolic algorithms for computing the solution of pentadiagonal linear systems The following algorithm is a symbolic version of PTRANS-I algorithm: Algorithm 31 First symbolic algorithm for solving pentadiagonal linear system To find the solution of PLS (11) using the transformed system (26) we may proceed as follows: INPUT order of the matrix n and the components d i a i b i c i e i f i i = 12n(a n = b n = b n 1 = c 1 = e 1 = e 2 = 0) OUTPUT The solution vector x = (x 1 x 2 x n ) t Step 1: Use DETGPENTA algorithm [13] to check the non-singularity of the coefficient matrix of the system (13) Step 2: If det(p) = 0 then Exit and Print Message ( No solutions ) end if Step 3: Set = d 1 If = 0 then = p end if Step 4: Set α 1 = a1 β 1 = b1 z 1 = y1 and γ 2 = c 2 Step 5: Set = d 2 α 1 γ 2 If = 0 then = p end if Step 6: Set α 2 = a2 β1γ2 β 2 = b2 and z 2 = y2 z1γ2 Step 7: For i=34n-2 do γ i = c i α i 2 e i = d i β i 2 e i α i 1 γ i If = 0 then = p end if α i = ai βi 1γi β i = bi z i = yi zi 2ei zi 1γi End do γ n 1 = c n 1 α n 3 e n 1 µ n 1 = d n 1 β n 3 e n 1 α n 2 γ n 1 If µ n 1 = 0 then µ n 1 = p end if α n 1 = an 1 βn 2γn 1 µ n 1 γ n = c n α n 2 e n µ n = d n β n 2 e n α n 1 γ n If µ n = 0 then µ n = p end if z n 1 = yn 1 zn 2en 1 zn 2γn 1 µ n 1 z n = yn zn 1en zn 1γn µ n Step 8: Compute the solution vector X = (x 1 x 2 x n ) t using x n = z n x n 1 = z n 1 α n 1 x n For i=n-2 n-3 1 do x i = z i α i x i+1 β i x i+2 End do Step 9: Substitute p = 0 in all expressions of the solution vector x i i = 12n The symbolic Algorithm 31 will be referred to as SPTRANS-I algorithm Now we are going to give the symbolic version of PTRANS-II algorithm:

6 Algorithm 32 Second symbolic algorithm for solving pentadiagonal linear system To find the solution of PLS (11) using the transformed system (212) we may proceed as follows: INPUT order of the matrix n and the components d i a i b i c i e i f i i = 12n(a n = b n = b n 1 = c 1 = e 1 = e 2 = 0) OUTPUT The solution vector x = (x 1 x 2 x n ) t Step 1: Use DETGPENTA algorithm [13] to check the non-singularity of the coefficient matrix of the system (13) Step 2: If det(p) = 0 then Exit and Print Message ( No solutions ) end if Step 3: Set = d n If = 0 then = p end if Step 4: σ n = cn φ n = en w n = yn and ρ n 1 = a n 1 Step 5: Set 1 = d n 1 σ n ρ n 1 If 1 = 0 then 1 = p end if Step 6: σ n 1 = cn 1 φnρn 1 1 Step 7: For i=n-2 n-3 3 do ρ i = a i σ i+2 b i = d i φ i+2 b i σ i+1 ρ i If = 0 then = p end if σ i = ci φi+1ρi φ i = ei φ n 1 = en 1 1 and w n 1 = yn 1 wnρn 1 1 w i = yi wi+2bi wi+1ρi End do ρ 2 = a 2 σ 4 b 2 ψ 2 = d 2 φ 4 b 2 σ 3 ρ 2 If ψ 2 = 0 then ψ 2 = p end if σ 2 = c2 φ4ρ2 ψ 2 ρ 1 = a 1 σ 3 b 1 ψ 1 = d 1 φ 3 b 1 σ 2 ρ 1 If ψ 1 = 0 then = p end if w 2 = y2 w4b2 w3ρ2 ψ 2 w 1 = y1 w3b1 w2ρ1 ψ 1 Step 8: Compute the solution vector X = (x 1 x 2 x n ) t using x = w 1 x 2 = w 2 σ 2 x 1 For i=3 4 n do x i = w i σ i x i 1 φ i x i 2 End do Step 9: Substitute p = 0 in all expressions of the solution vector x i i = 12n The symbolic Algorithm 32 will be referred to as SPTRANS-II algorithm Corollary 31 (generalization version of Corollary 21 in [14]) Let ˆP be the backward matrix of the pentadiagonal matrix P in (12) and given by: ˆP = 0 0 b 1 a 1 d b 2 a 2 d 2 c b 3 a 3 d 3 c 3 e b 4 a 4 d 4 c 4 e 4 0 b n 2 a n 2 d n 2 c n 2 e n a n 1 d n 1 c n 1 e n d n c n e n 0 0 n 4 (31)

7 Then the backward pentadiagonal linear system ˆPV = Y V = (v 1 v 2 v n ) t (32) has the solution: v i = x n i+1 i = 12 n where j is the floor function of j and X = (x 1 x 2 x n ) t is the solution vector of the linear system (11) Proof: Consider the n n permutation matrix M defined by: M = (33) For this matrix we have: Since M 1 = M (34) ˆP = PM (35) Then using (34) and (35) the result follows Corollary 32 (generalization version of Corollary 22 in [14]) The determinants of the coefficient matrices P and ˆP in (12) and (31) are given respectively by: and det(p) = det(ˆp) = ( 1) n(n 1) 2 n = i=1 n i=1 n (36) i=1 = ( 1) n(n 1) 2 where µ n and ψ 1 ψ 2 satisfy (25) and (211) respectively Proof: Using (26) (212) and (35) the result follows 4 ILLUSTRATIVE EXAMPLES n (37) In this section we are going to give three examples for the sake of illustration All experiments performed in MATLAB R2014a with an Intel(R) Core(TM) i7-4700mq CPU@240GHz 240 GHz Example 41(Case I: 0 and 0 for all i) Find the solution of the following pentadiagonal linear system of size x x x x x x x x x x 10 i=1 = Solution: We have n = 10 d = ( ) t a = ( ) t b = ( ) t c = ( ) t e = ( ) t and y = ( ) t i)- Applying the PTRANS-I algorithm it yields (41)

8 µ = ( )t det(p) = 10 i=1 = PTRANS-I(ndabcey)=( ) t ii)- Applying the PTRANS-II algorithm it yields ψ = ( )t det(p) = 10 i=1 = PTRANS-II(ndabcey)=( ) t Example 42(Case II: = 0 and = 0 for some i) Find the solution of the following pentadiagonal linear system of size x x x 3 = 3 9 (42) x 4 6 Solution: We have n = 4 d = (3 2 13) t a = (275) t b = (11) t c = (0 322) t e = (0031) t and y = (6396) t The numerical algorithms PTRANS-I and PTRANS-II fail to solve the pentadiagonal linear system (42) since = 0 i)- Applying the SPTRANS-I algorithm it yields µ = (3p 2 8p 21 p ) t det(p) = ( 4 i=1 ) p=0 = 126 SPTRANS-I(ndabcey)=(( (25p 42) (16p 42) 21 (8p 21) 21(p 2) 2(8p 21) (9p 21) (8p 21) )t ) p=0 = (1111) t ii)- Applying the SPTRANS-II algorithm it yields ψ = ( )t det(p) = 4 i=1 = 126 SPTRANS-II(ndabcey)=(1111) t Example 43 We consider the following n n pentadiagonal linear system in order to demonstrate the efficiency of algorithms 31 and x 1 x 2 x 3 x 4 x n 2 x n 1 x n = It can be verified that the exact solution is x = (111) t In Table 1 we give a comparison of the absolute error and running time between PTRANS-I PTRANS-II algorithms Algorithm 3[8] and A\b function in Matlab to compute x for different sizes

9 Table1 n x x and CPU time(s) PTRANS-I PTRANS-II Algorithm 3[8] A\b(MATLAB) Table1indicatesthat the valueofabsoluteerrorforlargevaluesofnforptrans-iiislessthan the other algorithms Also note that from Table 1 it is clear that the value of the runing time for Algorithm 3[8] is less than the other algorithms for large sizes Acknowledgements The author wishes to thank anonymous referees for useful comments that enhanced the quality of this paper The author is grateful to Prof Dr MEA El-Mikkawy for providing him with the references [14] and [15] 5 CONCLUSION There are many numerical algorithms in current use for solving linear systems of pentadiagonal type All numerical algorithms including the PTRANS-I and PTRANS-II algorithms of the current paper fail to solve the pentadiagonallinear system if = 0 and = 0 for any i {12n} The symbolic algorithms SPTRANS-I and SPTRANS-II of the current paper are constructed in order to remove the cases where the numerical algorithms fail From some numerical examples we have learned that SPTRANS-II algorithm works as well as Algorithm 3[8] and (A\y)MATLAB algorithms Hence it may become a useful tool for solving linear systems of pentadiagonal type References [1] TA Davis Direct Methods for Sparse Linear Systems SIAM Philadelphia 2006 [2] JW Demmel Applied Numerical Linear Algebra SIAM 1997 [3] GH Golub CF Van Loan Matrix Computations third ed The Johns Hopkins University Press Baltimore and London 1996 [4] J P Killingbeck G Jolicard The Folding Algorithm for Pentadiagonal Matrices Physics Letters A 166 (1992) [5] J Dongarra A Sameh On Some Parallel Banded Solvers Parallel Computing 1 (1984) [6] U Meier A Parallel Partition Method for Solving Banded Systems of Linear Equations Parallel Computing 2 (1985) [7] A A Karawia A computational algorithm for solving periodic pentadiagonal linear systems Applied Mathematics and Computation 174(2006) [8] T Sogabe New algorithms for solving periodic tridiagonal and periodic pentadiagonal linear systems Applied Mathematics and Computation 202(2008) [9] L Du T Sogabe S Zhang An algorithm for solving nonsymmetric penta-diagonal Toeplitz linear systemsoriginal Applied Mathematics and Computation 244(2014)10-15 [10] SS Nemani A fast algorithm for solving Toeplitz penta-diagonal systemsoriginal Applied Mathematics and Computation 215(2010) [11] A A Karawia and S A El-Shehawy Nearly Pentadiagonal Linear Systems Journal of Natural Sciences and Mathematics Qassim University 5(2012)

10 [12] J M McNally Fast Algorithm for Solving Diagonally Dominant Symmetric Pentadiagonal Toeplitz Systems Journal of Computational and Applied Mathematics 234 (2010) [13] T Sogabe A Fast Numerical Algorithm for the Determinant of a Pentadiagonal Matrix Applied Mathematics and Computation 196 (2008) [14] M El-Mikkawy F Atlan Algorithms for Solving Linear Systems of Equations of Tridiagonal Type via Transformations Applied Mathematics 5(2014) [15] M El-Mikkawy A Fast and Reliable Algorithm for Evaluating nth Order Pentadiagonal Determinants Applied Mathematics and Computation 202 (1) (2008)

On the Inverting of a General Heptadiagonal Matrix

On the Inverting of a General Heptadiagonal Matrix British Journal of Applied Science & Technology 18(5): 1-, 2016; Article no.bjast.313 ISSN: 2231-0843, NLM ID: 101664541 SCIENCEDOMAIN international www.sciencedomain.org On the Inverting of a General

More information

ANONSINGULAR tridiagonal linear system of the form

ANONSINGULAR tridiagonal linear system of the form Generalized Diagonal Pivoting Methods for Tridiagonal Systems without Interchanges Jennifer B. Erway, Roummel F. Marcia, and Joseph A. Tyson Abstract It has been shown that a nonsingular symmetric tridiagonal

More information

OUTLINE 1. Introduction 1.1 Notation 1.2 Special matrices 2. Gaussian Elimination 2.1 Vector and matrix norms 2.2 Finite precision arithmetic 2.3 Fact

OUTLINE 1. Introduction 1.1 Notation 1.2 Special matrices 2. Gaussian Elimination 2.1 Vector and matrix norms 2.2 Finite precision arithmetic 2.3 Fact Computational Linear Algebra Course: (MATH: 6800, CSCI: 6800) Semester: Fall 1998 Instructors: { Joseph E. Flaherty, aherje@cs.rpi.edu { Franklin T. Luk, luk@cs.rpi.edu { Wesley Turner, turnerw@cs.rpi.edu

More information

On the Preconditioning of the Block Tridiagonal Linear System of Equations

On the Preconditioning of the Block Tridiagonal Linear System of Equations On the Preconditioning of the Block Tridiagonal Linear System of Equations Davod Khojasteh Salkuyeh Department of Mathematics, University of Mohaghegh Ardabili, PO Box 179, Ardabil, Iran E-mail: khojaste@umaacir

More information

Chapter 2. Ma 322 Fall Ma 322. Sept 23-27

Chapter 2. Ma 322 Fall Ma 322. Sept 23-27 Chapter 2 Ma 322 Fall 2013 Ma 322 Sept 23-27 Summary ˆ Matrices and their Operations. ˆ Special matrices: Zero, Square, Identity. ˆ Elementary Matrices, Permutation Matrices. ˆ Voodoo Principle. What is

More information

A Method for Constructing Diagonally Dominant Preconditioners based on Jacobi Rotations

A Method for Constructing Diagonally Dominant Preconditioners based on Jacobi Rotations A Method for Constructing Diagonally Dominant Preconditioners based on Jacobi Rotations Jin Yun Yuan Plamen Y. Yalamov Abstract A method is presented to make a given matrix strictly diagonally dominant

More information

arxiv: v2 [math.na] 21 May 2018

arxiv: v2 [math.na] 21 May 2018 SHORT-MT: Optimal Solution of Linear Ordinary Differential Equations by Conjugate Gradient Method arxiv:1805.01085v2 [math.na] 21 May 2018 Wenqiang Yang 1, Wenyuan Wu 1, and Robert M. Corless 2 1 Chongqing

More information

arxiv: v4 [quant-ph] 8 Mar 2013

arxiv: v4 [quant-ph] 8 Mar 2013 Decomposition of unitary matrices and quantum gates Chi-Kwong Li, Rebecca Roberts Department of Mathematics, College of William and Mary, Williamsburg, VA 2387, USA. (E-mail: ckli@math.wm.edu, rlroberts@email.wm.edu)

More information

Cholesky factorisation of linear systems coming from finite difference approximations of singularly perturbed problems

Cholesky factorisation of linear systems coming from finite difference approximations of singularly perturbed problems Cholesky factorisation of linear systems coming from finite difference approximations of singularly perturbed problems Thái Anh Nhan and Niall Madden Abstract We consider the solution of large linear systems

More information

We first repeat some well known facts about condition numbers for normwise and componentwise perturbations. Consider the matrix

We first repeat some well known facts about condition numbers for normwise and componentwise perturbations. Consider the matrix BIT 39(1), pp. 143 151, 1999 ILL-CONDITIONEDNESS NEEDS NOT BE COMPONENTWISE NEAR TO ILL-POSEDNESS FOR LEAST SQUARES PROBLEMS SIEGFRIED M. RUMP Abstract. The condition number of a problem measures the sensitivity

More information

THE solution of the absolute value equation (AVE) of

THE solution of the absolute value equation (AVE) of The nonlinear HSS-like iterative method for absolute value equations Mu-Zheng Zhu Member, IAENG, and Ya-E Qi arxiv:1403.7013v4 [math.na] 2 Jan 2018 Abstract Salkuyeh proposed the Picard-HSS iteration method

More information

Scientific Computing

Scientific Computing Scientific Computing Direct solution methods Martin van Gijzen Delft University of Technology October 3, 2018 1 Program October 3 Matrix norms LU decomposition Basic algorithm Cost Stability Pivoting Pivoting

More information

Dense LU factorization and its error analysis

Dense LU factorization and its error analysis Dense LU factorization and its error analysis Laura Grigori INRIA and LJLL, UPMC February 2016 Plan Basis of floating point arithmetic and stability analysis Notation, results, proofs taken from [N.J.Higham,

More information

Numerical Linear Algebra

Numerical Linear Algebra Numerical Linear Algebra Direct Methods Philippe B. Laval KSU Fall 2017 Philippe B. Laval (KSU) Linear Systems: Direct Solution Methods Fall 2017 1 / 14 Introduction The solution of linear systems is one

More information

Lecture 12. Linear systems of equations II. a 13. a 12. a 14. a a 22. a 23. a 34 a 41. a 32. a 33. a 42. a 43. a 44)

Lecture 12. Linear systems of equations II. a 13. a 12. a 14. a a 22. a 23. a 34 a 41. a 32. a 33. a 42. a 43. a 44) 1 Introduction Lecture 12 Linear systems of equations II We have looked at Gauss-Jordan elimination and Gaussian elimination as ways to solve a linear system Ax=b. We now turn to the LU decomposition,

More information

OPTIMAL SCALING FOR P -NORMS AND COMPONENTWISE DISTANCE TO SINGULARITY

OPTIMAL SCALING FOR P -NORMS AND COMPONENTWISE DISTANCE TO SINGULARITY published in IMA Journal of Numerical Analysis (IMAJNA), Vol. 23, 1-9, 23. OPTIMAL SCALING FOR P -NORMS AND COMPONENTWISE DISTANCE TO SINGULARITY SIEGFRIED M. RUMP Abstract. In this note we give lower

More information

Solving linear equations with Gaussian Elimination (I)

Solving linear equations with Gaussian Elimination (I) Term Projects Solving linear equations with Gaussian Elimination The QR Algorithm for Symmetric Eigenvalue Problem The QR Algorithm for The SVD Quasi-Newton Methods Solving linear equations with Gaussian

More information

Hani Mehrpouyan, California State University, Bakersfield. Signals and Systems

Hani Mehrpouyan, California State University, Bakersfield. Signals and Systems Hani Mehrpouyan, Department of Electrical and Computer Engineering, Lecture 26 (LU Factorization) May 30 th, 2013 The material in these lectures is partly taken from the books: Elementary Numerical Analysis,

More information

Key words. conjugate gradients, normwise backward error, incremental norm estimation.

Key words. conjugate gradients, normwise backward error, incremental norm estimation. Proceedings of ALGORITMY 2016 pp. 323 332 ON ERROR ESTIMATION IN THE CONJUGATE GRADIENT METHOD: NORMWISE BACKWARD ERROR PETR TICHÝ Abstract. Using an idea of Duff and Vömel [BIT, 42 (2002), pp. 300 322

More information

12/1/2015 LINEAR ALGEBRA PRE-MID ASSIGNMENT ASSIGNED BY: PROF. SULEMAN SUBMITTED BY: M. REHAN ASGHAR BSSE 4 ROLL NO: 15126

12/1/2015 LINEAR ALGEBRA PRE-MID ASSIGNMENT ASSIGNED BY: PROF. SULEMAN SUBMITTED BY: M. REHAN ASGHAR BSSE 4 ROLL NO: 15126 12/1/2015 LINEAR ALGEBRA PRE-MID ASSIGNMENT ASSIGNED BY: PROF. SULEMAN SUBMITTED BY: M. REHAN ASGHAR Cramer s Rule Solving a physical system of linear equation by using Cramer s rule Cramer s rule is really

More information

Introduction to Mathematical Programming

Introduction to Mathematical Programming Introduction to Mathematical Programming Ming Zhong Lecture 6 September 12, 2018 Ming Zhong (JHU) AMS Fall 2018 1 / 20 Table of Contents 1 Ming Zhong (JHU) AMS Fall 2018 2 / 20 Solving Linear Systems A

More information

We wish to solve a system of N simultaneous linear algebraic equations for the N unknowns x 1, x 2,...,x N, that are expressed in the general form

We wish to solve a system of N simultaneous linear algebraic equations for the N unknowns x 1, x 2,...,x N, that are expressed in the general form Linear algebra This chapter discusses the solution of sets of linear algebraic equations and defines basic vector/matrix operations The focus is upon elimination methods such as Gaussian elimination, and

More information

On the application of different numerical methods to obtain null-spaces of polynomial matrices. Part 2: block displacement structure algorithms.

On the application of different numerical methods to obtain null-spaces of polynomial matrices. Part 2: block displacement structure algorithms. On the application of different numerical methods to obtain null-spaces of polynomial matrices Part 2: block displacement structure algorithms JC Zúñiga and D Henrion Abstract Motivated by some control

More information

Finite Difference Methods (FDMs) 1

Finite Difference Methods (FDMs) 1 Finite Difference Methods (FDMs) 1 1 st - order Approxima9on Recall Taylor series expansion: Forward difference: Backward difference: Central difference: 2 nd - order Approxima9on Forward difference: Backward

More information

Ann. Funct. Anal. 5 (2014), no. 2, A nnals of F unctional A nalysis ISSN: (electronic) URL:

Ann. Funct. Anal. 5 (2014), no. 2, A nnals of F unctional A nalysis ISSN: (electronic) URL: Ann Funct Anal 5 (2014), no 2, 127 137 A nnals of F unctional A nalysis ISSN: 2008-8752 (electronic) URL:wwwemisde/journals/AFA/ THE ROOTS AND LINKS IN A CLASS OF M-MATRICES XIAO-DONG ZHANG This paper

More information

On the Berlekamp/Massey Algorithm and Counting Singular Hankel Matrices over a Finite Field

On the Berlekamp/Massey Algorithm and Counting Singular Hankel Matrices over a Finite Field On the Berlekamp/Massey Algorithm and Counting Singular Hankel Matrices over a Finite Field Matthew T Comer Dept of Mathematics, North Carolina State University Raleigh, North Carolina, 27695-8205 USA

More information

Journal of Symbolic Computation. On the Berlekamp/Massey algorithm and counting singular Hankel matrices over a finite field

Journal of Symbolic Computation. On the Berlekamp/Massey algorithm and counting singular Hankel matrices over a finite field Journal of Symbolic Computation 47 (2012) 480 491 Contents lists available at SciVerse ScienceDirect Journal of Symbolic Computation journal homepage: wwwelseviercom/locate/jsc On the Berlekamp/Massey

More information

A Note on Eigenvalues of Perturbed Hermitian Matrices

A Note on Eigenvalues of Perturbed Hermitian Matrices A Note on Eigenvalues of Perturbed Hermitian Matrices Chi-Kwong Li Ren-Cang Li July 2004 Let ( H1 E A = E H 2 Abstract and à = ( H1 H 2 be Hermitian matrices with eigenvalues λ 1 λ k and λ 1 λ k, respectively.

More information

Numerical Solution Techniques in Mechanical and Aerospace Engineering

Numerical Solution Techniques in Mechanical and Aerospace Engineering Numerical Solution Techniques in Mechanical and Aerospace Engineering Chunlei Liang LECTURE 3 Solvers of linear algebraic equations 3.1. Outline of Lecture Finite-difference method for a 2D elliptic PDE

More information

Scientific Computing with Case Studies SIAM Press, Lecture Notes for Unit VII Sparse Matrix

Scientific Computing with Case Studies SIAM Press, Lecture Notes for Unit VII Sparse Matrix Scientific Computing with Case Studies SIAM Press, 2009 http://www.cs.umd.edu/users/oleary/sccswebpage Lecture Notes for Unit VII Sparse Matrix Computations Part 1: Direct Methods Dianne P. O Leary c 2008

More information

1.Chapter Objectives

1.Chapter Objectives LU Factorization INDEX 1.Chapter objectives 2.Overview of LU factorization 2.1GAUSS ELIMINATION AS LU FACTORIZATION 2.2LU Factorization with Pivoting 2.3 MATLAB Function: lu 3. CHOLESKY FACTORIZATION 3.1

More information

I-v k e k. (I-e k h kt ) = Stability of Gauss-Huard Elimination for Solving Linear Systems. 1 x 1 x x x x

I-v k e k. (I-e k h kt ) = Stability of Gauss-Huard Elimination for Solving Linear Systems. 1 x 1 x x x x Technical Report CS-93-08 Department of Computer Systems Faculty of Mathematics and Computer Science University of Amsterdam Stability of Gauss-Huard Elimination for Solving Linear Systems T. J. Dekker

More information

Numerical Linear Algebra

Numerical Linear Algebra Numerical Linear Algebra Decompositions, numerical aspects Gerard Sleijpen and Martin van Gijzen September 27, 2017 1 Delft University of Technology Program Lecture 2 LU-decomposition Basic algorithm Cost

More information

Program Lecture 2. Numerical Linear Algebra. Gaussian elimination (2) Gaussian elimination. Decompositions, numerical aspects

Program Lecture 2. Numerical Linear Algebra. Gaussian elimination (2) Gaussian elimination. Decompositions, numerical aspects Numerical Linear Algebra Decompositions, numerical aspects Program Lecture 2 LU-decomposition Basic algorithm Cost Stability Pivoting Cholesky decomposition Sparse matrices and reorderings Gerard Sleijpen

More information

On the application of different numerical methods to obtain null-spaces of polynomial matrices. Part 1: block Toeplitz algorithms.

On the application of different numerical methods to obtain null-spaces of polynomial matrices. Part 1: block Toeplitz algorithms. On the application of different numerical methods to obtain null-spaces of polynomial matrices. Part 1: block Toeplitz algorithms. J.C. Zúñiga and D. Henrion Abstract Four different algorithms are designed

More information

Chapter 4 Systems of Linear Equations; Matrices

Chapter 4 Systems of Linear Equations; Matrices Chapter 4 Systems of Linear Equations; Matrices Section 5 Inverse of a Square Matrix Learning Objectives for Section 4.5 Inverse of a Square Matrix The student will be able to identify identity matrices

More information

Lecture 9 Approximations of Laplace s Equation, Finite Element Method. Mathématiques appliquées (MATH0504-1) B. Dewals, C.

Lecture 9 Approximations of Laplace s Equation, Finite Element Method. Mathématiques appliquées (MATH0504-1) B. Dewals, C. Lecture 9 Approximations of Laplace s Equation, Finite Element Method Mathématiques appliquées (MATH54-1) B. Dewals, C. Geuzaine V1.2 23/11/218 1 Learning objectives of this lecture Apply the finite difference

More information

NUMERICAL MATHEMATICS & COMPUTING 7th Edition

NUMERICAL MATHEMATICS & COMPUTING 7th Edition NUMERICAL MATHEMATICS & COMPUTING 7th Edition Ward Cheney/David Kincaid c UT Austin Engage Learning: Thomson-Brooks/Cole wwwengagecom wwwmautexasedu/cna/nmc7 October 16, 2011 Ward Cheney/David Kincaid

More information

Algebraic Equations. 2.0 Introduction. Nonsingular versus Singular Sets of Equations. A set of linear algebraic equations looks like this:

Algebraic Equations. 2.0 Introduction. Nonsingular versus Singular Sets of Equations. A set of linear algebraic equations looks like this: Chapter 2. 2.0 Introduction Solution of Linear Algebraic Equations A set of linear algebraic equations looks like this: a 11 x 1 + a 12 x 2 + a 13 x 3 + +a 1N x N =b 1 a 21 x 1 + a 22 x 2 + a 23 x 3 +

More information

1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i )

1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i ) Direct Methods for Linear Systems Chapter Direct Methods for Solving Linear Systems Per-Olof Persson persson@berkeleyedu Department of Mathematics University of California, Berkeley Math 18A Numerical

More information

Customizable triangular factorizations of matrices

Customizable triangular factorizations of matrices Linear Algebra and its Applications 382 (2004) 35 54 www.elsevier.com/locate/laa Customizable triangular factorizations of matrices Pengwei Hao Center for Information Science, Peing University, Beijing

More information

CS412: Lecture #17. Mridul Aanjaneya. March 19, 2015

CS412: Lecture #17. Mridul Aanjaneya. March 19, 2015 CS: Lecture #7 Mridul Aanjaneya March 9, 5 Solving linear systems of equations Consider a lower triangular matrix L: l l l L = l 3 l 3 l 33 l n l nn A procedure similar to that for upper triangular systems

More information

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 6

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 6 CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 6 GENE H GOLUB Issues with Floating-point Arithmetic We conclude our discussion of floating-point arithmetic by highlighting two issues that frequently

More information

Lecture 9: Elementary Matrices

Lecture 9: Elementary Matrices Lecture 9: Elementary Matrices Review of Row Reduced Echelon Form Consider the matrix A and the vector b defined as follows: 1 2 1 A b 3 8 5 A common technique to solve linear equations of the form Ax

More information

Computation of a canonical form for linear differential-algebraic equations

Computation of a canonical form for linear differential-algebraic equations Computation of a canonical form for linear differential-algebraic equations Markus Gerdin Division of Automatic Control Department of Electrical Engineering Linköpings universitet, SE-581 83 Linköping,

More information

MATHEMATICAL METHODS INTERPOLATION

MATHEMATICAL METHODS INTERPOLATION MATHEMATICAL METHODS INTERPOLATION I YEAR BTech By Mr Y Prabhaker Reddy Asst Professor of Mathematics Guru Nanak Engineering College Ibrahimpatnam, Hyderabad SYLLABUS OF MATHEMATICAL METHODS (as per JNTU

More information

On the Computations of Eigenvalues of the Fourth-order Sturm Liouville Problems

On the Computations of Eigenvalues of the Fourth-order Sturm Liouville Problems Int. J. Open Problems Compt. Math., Vol. 4, No. 3, September 2011 ISSN 1998-6262; Copyright c ICSRS Publication, 2011 www.i-csrs.org On the Computations of Eigenvalues of the Fourth-order Sturm Liouville

More information

INTEGER POWERS OF ANTI-BIDIAGONAL HANKEL MATRICES

INTEGER POWERS OF ANTI-BIDIAGONAL HANKEL MATRICES Indian J Pure Appl Math, 49: 87-98, March 08 c Indian National Science Academy DOI: 0007/s36-08-056-9 INTEGER POWERS OF ANTI-BIDIAGONAL HANKEL MATRICES João Lita da Silva Department of Mathematics and

More information

A Review of Matrix Analysis

A Review of Matrix Analysis Matrix Notation Part Matrix Operations Matrices are simply rectangular arrays of quantities Each quantity in the array is called an element of the matrix and an element can be either a numerical value

More information

For δa E, this motivates the definition of the Bauer-Skeel condition number ([2], [3], [14], [15])

For δa E, this motivates the definition of the Bauer-Skeel condition number ([2], [3], [14], [15]) LAA 278, pp.2-32, 998 STRUCTURED PERTURBATIONS AND SYMMETRIC MATRICES SIEGFRIED M. RUMP Abstract. For a given n by n matrix the ratio between the componentwise distance to the nearest singular matrix and

More information

arxiv: v1 [math.na] 6 Aug 2010

arxiv: v1 [math.na] 6 Aug 2010 GERSCHGORIN S THEOREM FOR GENERALIZED EIGENVALUE PROBLEMS IN THE EUCLIDEAN METRIC arxiv:10081202v1 [mathna] 6 Aug 2010 YUJI NAKATSUKASA Abstract We present Gerschgorin-type eigenvalue inclusion sets applicable

More information

Polynomials 6c Classifying the Zeros of a Polynomial Functions

Polynomials 6c Classifying the Zeros of a Polynomial Functions Polynomials 6c Classifying the Zeros of a Polynomial Functions Standards: A APR.2, A APR.3, F IF.7c, N CN.9 Learning Target(s): How many zeros does a polynomial have? How can we find all the exact zeros

More information

LU Factorization a 11 a 1 a 1n A = a 1 a a n (b) a n1 a n a nn L = l l 1 l ln1 ln 1 75 U = u 11 u 1 u 1n 0 u u n 0 u n...

LU Factorization a 11 a 1 a 1n A = a 1 a a n (b) a n1 a n a nn L = l l 1 l ln1 ln 1 75 U = u 11 u 1 u 1n 0 u u n 0 u n... .. Factorizations Reading: Trefethen and Bau (1997), Lecture 0 Solve the n n linear system by Gaussian elimination Ax = b (1) { Gaussian elimination is a direct method The solution is found after a nite

More information

Finite Difference Method

Finite Difference Method Finite Difference Method for BVP ODEs Dec 3, 2014 1 Recall An ordinary differential equation is accompanied by auxiliary conditions. In the analytical method, these conditions are used to evaluate the

More information

2 Computing complex square roots of a real matrix

2 Computing complex square roots of a real matrix On computing complex square roots of real matrices Zhongyun Liu a,, Yulin Zhang b, Jorge Santos c and Rui Ralha b a School of Math., Changsha University of Science & Technology, Hunan, 410076, China b

More information

Cholesky factorisations of linear systems coming from a finite difference method applied to singularly perturbed problems

Cholesky factorisations of linear systems coming from a finite difference method applied to singularly perturbed problems Cholesky factorisations of linear systems coming from a finite difference method applied to singularly perturbed problems Thái Anh Nhan and Niall Madden The Boundary and Interior Layers - Computational

More information

Solution of Linear Equations

Solution of Linear Equations Solution of Linear Equations (Com S 477/577 Notes) Yan-Bin Jia Sep 7, 07 We have discussed general methods for solving arbitrary equations, and looked at the special class of polynomial equations A subclass

More information

Matrix decompositions

Matrix decompositions Matrix decompositions How can we solve Ax = b? 1 Linear algebra Typical linear system of equations : x 1 x +x = x 1 +x +9x = 0 x 1 +x x = The variables x 1, x, and x only appear as linear terms (no powers

More information

Using Godunov s Two-Sided Sturm Sequences to Accurately Compute Singular Vectors of Bidiagonal Matrices.

Using Godunov s Two-Sided Sturm Sequences to Accurately Compute Singular Vectors of Bidiagonal Matrices. Using Godunov s Two-Sided Sturm Sequences to Accurately Compute Singular Vectors of Bidiagonal Matrices. A.M. Matsekh E.P. Shurina 1 Introduction We present a hybrid scheme for computing singular vectors

More information

Main matrix factorizations

Main matrix factorizations Main matrix factorizations A P L U P permutation matrix, L lower triangular, U upper triangular Key use: Solve square linear system Ax b. A Q R Q unitary, R upper triangular Key use: Solve square or overdetrmined

More information

Boundary value problems on triangular domains and MKSOR methods

Boundary value problems on triangular domains and MKSOR methods Applied and Computational Mathematics 2014; 3(3): 90-99 Published online June 30 2014 (http://www.sciencepublishinggroup.com/j/acm) doi: 10.1164/j.acm.20140303.14 Boundary value problems on triangular

More information

NAG Library Routine Document F08FPF (ZHEEVX)

NAG Library Routine Document F08FPF (ZHEEVX) NAG Library Routine Document (ZHEEVX) Note: before using this routine, please read the Users Note for your implementation to check the interpretation of bold italicised terms and other implementation-dependent

More information

A Note on the Pin-Pointing Solution of Ill-Conditioned Linear System of Equations

A Note on the Pin-Pointing Solution of Ill-Conditioned Linear System of Equations A Note on the Pin-Pointing Solution of Ill-Conditioned Linear System of Equations Davod Khojasteh Salkuyeh 1 and Mohsen Hasani 2 1,2 Department of Mathematics, University of Mohaghegh Ardabili, P. O. Box.

More information

Linear Algebra Linear Algebra : Matrix decompositions Monday, February 11th Math 365 Week #4

Linear Algebra Linear Algebra : Matrix decompositions Monday, February 11th Math 365 Week #4 Linear Algebra Linear Algebra : Matrix decompositions Monday, February 11th Math Week # 1 Saturday, February 1, 1 Linear algebra Typical linear system of equations : x 1 x +x = x 1 +x +9x = 0 x 1 +x x

More information

Introduction to PDEs and Numerical Methods Lecture 7. Solving linear systems

Introduction to PDEs and Numerical Methods Lecture 7. Solving linear systems Platzhalter für Bild, Bild auf Titelfolie hinter das Logo einsetzen Introduction to PDEs and Numerical Methods Lecture 7. Solving linear systems Dr. Noemi Friedman, 09.2.205. Reminder: Instationary heat

More information

NAG Library Routine Document F08UBF (DSBGVX)

NAG Library Routine Document F08UBF (DSBGVX) NAG Library Routine Document (DSBGVX) Note: before using this routine, please read the Users Note for your implementation to check the interpretation of bold italicised terms and other implementation-dependent

More information

Numerical Methods I: Numerical linear algebra

Numerical Methods I: Numerical linear algebra 1/3 Numerical Methods I: Numerical linear algebra Georg Stadler Courant Institute, NYU stadler@cimsnyuedu September 1, 017 /3 We study the solution of linear systems of the form Ax = b with A R n n, x,

More information

The restarted QR-algorithm for eigenvalue computation of structured matrices

The restarted QR-algorithm for eigenvalue computation of structured matrices Journal of Computational and Applied Mathematics 149 (2002) 415 422 www.elsevier.com/locate/cam The restarted QR-algorithm for eigenvalue computation of structured matrices Daniela Calvetti a; 1, Sun-Mi

More information

Direct methods for symmetric eigenvalue problems

Direct methods for symmetric eigenvalue problems Direct methods for symmetric eigenvalue problems, PhD McMaster University School of Computational Engineering and Science February 4, 2008 1 Theoretical background Posing the question Perturbation theory

More information

Section 5.6. LU and LDU Factorizations

Section 5.6. LU and LDU Factorizations 5.6. LU and LDU Factorizations Section 5.6. LU and LDU Factorizations Note. We largely follow Fraleigh and Beauregard s approach to this topic from Linear Algebra, 3rd Edition, Addison-Wesley (995). See

More information

(Linear equations) Applied Linear Algebra in Geoscience Using MATLAB

(Linear equations) Applied Linear Algebra in Geoscience Using MATLAB Applied Linear Algebra in Geoscience Using MATLAB (Linear equations) Contents Getting Started Creating Arrays Mathematical Operations with Arrays Using Script Files and Managing Data Two-Dimensional Plots

More information

Residual iterative schemes for largescale linear systems

Residual iterative schemes for largescale linear systems Universidad Central de Venezuela Facultad de Ciencias Escuela de Computación Lecturas en Ciencias de la Computación ISSN 1316-6239 Residual iterative schemes for largescale linear systems William La Cruz

More information

Applied Linear Algebra in Geoscience Using MATLAB

Applied Linear Algebra in Geoscience Using MATLAB Applied Linear Algebra in Geoscience Using MATLAB Contents Getting Started Creating Arrays Mathematical Operations with Arrays Using Script Files and Managing Data Two-Dimensional Plots Programming in

More information

A New Block Algorithm for Full-Rank Solution of the Sylvester-observer Equation.

A New Block Algorithm for Full-Rank Solution of the Sylvester-observer Equation. 1 A New Block Algorithm for Full-Rank Solution of the Sylvester-observer Equation João Carvalho, DMPA, Universidade Federal do RS, Brasil Karabi Datta, Dep MSc, Northern Illinois University, DeKalb, IL

More information

GAUSSIAN ELIMINATION AND LU DECOMPOSITION (SUPPLEMENT FOR MA511)

GAUSSIAN ELIMINATION AND LU DECOMPOSITION (SUPPLEMENT FOR MA511) GAUSSIAN ELIMINATION AND LU DECOMPOSITION (SUPPLEMENT FOR MA511) D. ARAPURA Gaussian elimination is the go to method for all basic linear classes including this one. We go summarize the main ideas. 1.

More information

NUMERICAL METHODS. lor CHEMICAL ENGINEERS. Using Excel', VBA, and MATLAB* VICTOR J. LAW. CRC Press. Taylor & Francis Group

NUMERICAL METHODS. lor CHEMICAL ENGINEERS. Using Excel', VBA, and MATLAB* VICTOR J. LAW. CRC Press. Taylor & Francis Group NUMERICAL METHODS lor CHEMICAL ENGINEERS Using Excel', VBA, and MATLAB* VICTOR J. LAW CRC Press Taylor & Francis Group Boca Raton London New York CRC Press is an imprint of the Taylor & Francis Croup,

More information

Homework 2 Foundations of Computational Math 2 Spring 2019

Homework 2 Foundations of Computational Math 2 Spring 2019 Homework 2 Foundations of Computational Math 2 Spring 2019 Problem 2.1 (2.1.a) Suppose (v 1,λ 1 )and(v 2,λ 2 ) are eigenpairs for a matrix A C n n. Show that if λ 1 λ 2 then v 1 and v 2 are linearly independent.

More information

DEPARTMENT OF MATHEMATICS. The University of Queensland. MATH3203 Scientific Computation: Algorithmic Design and Implementation

DEPARTMENT OF MATHEMATICS. The University of Queensland. MATH3203 Scientific Computation: Algorithmic Design and Implementation DEPARTMENT OF MATHEMATICS The University of Queensland MATH303 Scientific Computation: Algorithmic Design and Implementation Section A Boundary Value Problem in dimension Semester, 00 A simplified problem

More information

MATRICES. a m,1 a m,n A =

MATRICES. a m,1 a m,n A = MATRICES Matrices are rectangular arrays of real or complex numbers With them, we define arithmetic operations that are generalizations of those for real and complex numbers The general form a matrix of

More information

Math 671: Tensor Train decomposition methods

Math 671: Tensor Train decomposition methods Math 671: Eduardo Corona 1 1 University of Michigan at Ann Arbor December 8, 2016 Table of Contents 1 Preliminaries and goal 2 Unfolding matrices for tensorized arrays The Tensor Train decomposition 3

More information

PARTIAL DIFFERENTIAL EQUATIONS

PARTIAL DIFFERENTIAL EQUATIONS MATHEMATICAL METHODS PARTIAL DIFFERENTIAL EQUATIONS I YEAR B.Tech By Mr. Y. Prabhaker Reddy Asst. Professor of Mathematics Guru Nanak Engineering College Ibrahimpatnam, Hyderabad. SYLLABUS OF MATHEMATICAL

More information

NAG Library Routine Document F07HAF (DPBSV)

NAG Library Routine Document F07HAF (DPBSV) NAG Library Routine Document (DPBSV) Note: before using this routine, please read the Users Note for your implementation to check the interpretation of bold italicised terms and other implementation-dependent

More information

NAG Library Routine Document F08JDF (DSTEVR)

NAG Library Routine Document F08JDF (DSTEVR) F08 Least-squares and Eigenvalue Problems (LAPACK) NAG Library Routine Document (DSTEVR) Note: before using this routine, please read the Users Note for your implementation to check the interpretation

More information

ELEMENTARY LINEAR ALGEBRA

ELEMENTARY LINEAR ALGEBRA ELEMENTARY LINEAR ALGEBRA K R MATTHEWS DEPARTMENT OF MATHEMATICS UNIVERSITY OF QUEENSLAND First Printing, 99 Chapter LINEAR EQUATIONS Introduction to linear equations A linear equation in n unknowns x,

More information

NAG Library Routine Document F08FAF (DSYEV)

NAG Library Routine Document F08FAF (DSYEV) NAG Library Routine Document (DSYEV) Note: before using this routine, please read the Users Note for your implementation to check the interpretation of bold italicised terms and other implementation-dependent

More information

(Inv) Computing Invariant Factors Math 683L (Summer 2003)

(Inv) Computing Invariant Factors Math 683L (Summer 2003) (Inv) Computing Invariant Factors Math 683L (Summer 23) We have two big results (stated in (Can2) and (Can3)) concerning the behaviour of a single linear transformation T of a vector space V In particular,

More information

A Backward Stable Hyperbolic QR Factorization Method for Solving Indefinite Least Squares Problem

A Backward Stable Hyperbolic QR Factorization Method for Solving Indefinite Least Squares Problem A Backward Stable Hyperbolic QR Factorization Method for Solving Indefinite Least Suares Problem Hongguo Xu Dedicated to Professor Erxiong Jiang on the occasion of his 7th birthday. Abstract We present

More information

arxiv:math/ v1 [math.na] 12 Jul 2004

arxiv:math/ v1 [math.na] 12 Jul 2004 arxiv:math/0407177v1 [math.na] 12 Jul 2004 On improving the accuracy of Horner s and Goertzel s algorithms Alica Smoktunowicz and Iwona Wróbel Faculty of Mathematics and Information Science, Warsaw University

More information

Linear Algebra Section 2.6 : LU Decomposition Section 2.7 : Permutations and transposes Wednesday, February 13th Math 301 Week #4

Linear Algebra Section 2.6 : LU Decomposition Section 2.7 : Permutations and transposes Wednesday, February 13th Math 301 Week #4 Linear Algebra Section. : LU Decomposition Section. : Permutations and transposes Wednesday, February 1th Math 01 Week # 1 The LU Decomposition We learned last time that we can factor a invertible matrix

More information

ETNA Kent State University

ETNA Kent State University C 8 Electronic Transactions on Numerical Analysis. Volume 17, pp. 76-2, 2004. Copyright 2004,. ISSN 1068-613. etnamcs.kent.edu STRONG RANK REVEALING CHOLESKY FACTORIZATION M. GU AND L. MIRANIAN Abstract.

More information

JUST THE MATHS UNIT NUMBER 9.3. MATRICES 3 (Matrix inversion & simultaneous equations) A.J.Hobson

JUST THE MATHS UNIT NUMBER 9.3. MATRICES 3 (Matrix inversion & simultaneous equations) A.J.Hobson JUST THE MATHS UNIT NUMBER 93 MATRICES 3 (Matrix inversion & simultaneous equations) by AJHobson 931 Introduction 932 Matrix representation of simultaneous linear equations 933 The definition of a multiplicative

More information

ACM106a - Homework 2 Solutions

ACM106a - Homework 2 Solutions ACM06a - Homework 2 Solutions prepared by Svitlana Vyetrenko October 7, 2006. Chapter 2, problem 2.2 (solution adapted from Golub, Van Loan, pp.52-54): For the proof we will use the fact that if A C m

More information

MATH2210 Notebook 2 Spring 2018

MATH2210 Notebook 2 Spring 2018 MATH2210 Notebook 2 Spring 2018 prepared by Professor Jenny Baglivo c Copyright 2009 2018 by Jenny A. Baglivo. All Rights Reserved. 2 MATH2210 Notebook 2 3 2.1 Matrices and Their Operations................................

More information

Lectures on Linear Algebra for IT

Lectures on Linear Algebra for IT Lectures on Linear Algebra for IT by Mgr. Tereza Kovářová, Ph.D. following content of lectures by Ing. Petr Beremlijski, Ph.D. Department of Applied Mathematics, VSB - TU Ostrava Czech Republic 11. Determinants

More information

arxiv: v2 [quant-ph] 5 Dec 2013

arxiv: v2 [quant-ph] 5 Dec 2013 Decomposition of quantum gates Chi Kwong Li and Diane Christine Pelejo Department of Mathematics, College of William and Mary, Williamsburg, VA 23187, USA E-mail: ckli@math.wm.edu, dcpelejo@gmail.com Abstract

More information

Name: INSERT YOUR NAME HERE. Due to dropbox by 6pm PDT, Wednesday, December 14, 2011

Name: INSERT YOUR NAME HERE. Due to dropbox by 6pm PDT, Wednesday, December 14, 2011 AMath 584 Name: INSERT YOUR NAME HERE Take-home Final UWNetID: INSERT YOUR NETID Due to dropbox by 6pm PDT, Wednesday, December 14, 2011 The main part of the assignment (Problems 1 3) is worth 80 points.

More information

11.2 Reduction of a Symmetric Matrix to Tridiagonal Form: Givens and Householder Reductions

11.2 Reduction of a Symmetric Matrix to Tridiagonal Form: Givens and Householder Reductions 11.2 Reduction of a Symmetric Matrix to Tridiagonal Form 469 for (j=i+1;j= p) p=d[k=j]; if (k!= i) { d[k]=d[i]; d[i]=p; for (j=1;j

More information

Matrix decompositions

Matrix decompositions Matrix decompositions How can we solve Ax = b? 1 Linear algebra Typical linear system of equations : x 1 x +x = x 1 +x +9x = 0 x 1 +x x = The variables x 1, x, and x only appear as linear terms (no powers

More information

ON DIVISION ALGEBRAS*

ON DIVISION ALGEBRAS* ON DIVISION ALGEBRAS* BY J. H. M. WEDDERBURN 1. The object of this paper is to develop some of the simpler properties of division algebras, that is to say, linear associative algebras in which division

More information

Numerical Linear Algebra

Numerical Linear Algebra Chapter 3 Numerical Linear Algebra We review some techniques used to solve Ax = b where A is an n n matrix, and x and b are n 1 vectors (column vectors). We then review eigenvalues and eigenvectors and

More information