for Linear Systems With Strictly Diagonally Dominant Matrix

Similar documents
Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Convexity preserving interpolation by splines of arbitrary degree

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16

Vector Norms. Chapter 7 Iterative Techniques in Matrix Algebra. Cauchy-Bunyakovsky-Schwarz Inequality for Sums. Distances. Convergence.

The Order Relation and Trace Inequalities for. Hermitian Operators

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 13

Perron Vectors of an Irreducible Nonnegative Interval Matrix

Inexact Newton Methods for Inverse Eigenvalue Problems

1 GSW Iterative Techniques for y = Ax

Solution of Linear System of Equations and Matrix Inversion Gauss Seidel Iteration Method

Deriving the X-Z Identity from Auxiliary Space Method

A Hybrid Variational Iteration Method for Blasius Equation

The Jacobsthal and Jacobsthal-Lucas Numbers via Square Roots of Matrices

Relaxation Methods for Iterative Solution to Linear Systems of Equations

A property of the elementary symmetric functions

On Finite Rank Perturbation of Diagonalizable Operators

Math 217 Fall 2013 Homework 2 Solutions

APPENDIX A Some Linear Algebra

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 17. a ij x (k) b i. a ij x (k+1) (D + L)x (k+1) = b Ux (k)

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)

[7] R.S. Varga, Matrix Iterative Analysis, Prentice-Hall, Englewood Clis, New Jersey, (1962).

General viscosity iterative method for a sequence of quasi-nonexpansive mappings

Slobodan Lakić. Communicated by R. Van Keer

ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system

THE Hadamard product of two nonnegative matrices and

Eigenvalues of Random Graphs

Randić Energy and Randić Estrada Index of a Graph

CSCE 790S Background Results

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

ρ some λ THE INVERSE POWER METHOD (or INVERSE ITERATION) , for , or (more usually) to

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)

The lower and upper bounds on Perron root of nonnegative irreducible matrices

SELECTED SOLUTIONS, SECTION (Weak duality) Prove that the primal and dual values p and d defined by equations (4.3.2) and (4.3.3) satisfy p d.

SL n (F ) Equals its Own Derived Group

Errors for Linear Systems

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

Lecture 3. Ax x i a i. i i

Difference Equations

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2

Lecture 21: Numerical methods for pricing American type derivatives

MATH Homework #2

ON THE GENERAL ALGEBRAIC INVERSE EIGENVALUE PROBLEMS. 1. Introduction

STEINHAUS PROPERTY IN BANACH LATTICES

1 Matrix representations of canonical matrices

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

The Degrees of Nilpotency of Nilpotent Derivations on the Ring of Matrices

More metrics on cartesian products

2.3 Nilpotent endomorphisms

Algebraic Solutions to Multidimensional Minimax Location Problems with Chebyshev Distance

arxiv: v2 [math.na] 16 May 2018

Norms, Condition Numbers, Eigenvalues and Eigenvectors

Singular Value Decomposition: Theory and Applications

LECTURE 9 CANONICAL CORRELATION ANALYSIS

The internal structure of natural numbers and one method for the definition of large prime numbers

Game Theory. Lecture Notes By Y. Narahari. Department of Computer Science and Automation Indian Institute of Science Bangalore, India February 2008

One-sided finite-difference approximations suitable for use with Richardson extrapolation

= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system.

Solutions to exam in SF1811 Optimization, Jan 14, 2015

A new Approach for Solving Linear Ordinary Differential Equations

Quantum Mechanics I - Session 4

Uniqueness of Weak Solutions to the 3D Ginzburg- Landau Model for Superconductivity

Lecture 12: Discrete Laplacian

9 Characteristic classes

Hyper-Sums of Powers of Integers and the Akiyama-Tanigawa Matrix

MMA and GCMMA two methods for nonlinear optimization

Determinants Containing Powers of Generalized Fibonacci Numbers

The Exact Formulation of the Inverse of the Tridiagonal Matrix for Solving the 1D Poisson Equation with the Finite Difference Method

THERE ARE INFINITELY MANY FIBONACCI COMPOSITES WITH PRIME SUBSCRIPTS

A FORMULA FOR COMPUTING INTEGER POWERS FOR ONE TYPE OF TRIDIAGONAL MATRIX

Maejo International Journal of Science and Technology

The Minimum Universal Cost Flow in an Infeasible Flow Network

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens

Dynamic Systems on Graphs

Overlapping additive and multiplicative Schwarz iterations for H -matrices

Formulas for the Determinant

On the symmetric character of the thermal conductivity tensor

FACTORIZATION IN KRULL MONOIDS WITH INFINITE CLASS GROUP

Spin-rotation coupling of the angularly accelerated rigid body

Lecture 5 Decoding Binary BCH Codes

Affine transformations and convexity

On a direct solver for linear least squares problems

Supplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso

First day August 1, Problems and Solutions

MEM 255 Introduction to Control Systems Review: Basics of Linear Algebra

BOUNDEDNESS OF THE RIESZ TRANSFORM WITH MATRIX A 2 WEIGHTS

ONE EXPRESSION FOR THE SOLUTIONS OF SECOND ORDER DIFFERENCE EQUATIONS JERZY POPENDA

Random Walks on Digraphs

Discrete Mathematics. Laplacian spectral characterization of some graphs obtained by product operation

Module 9. Lecture 6. Duality in Assignment Problems

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede

ON THE JACOBIAN CONJECTURE

Norm Bounds for a Transformed Activity Level. Vector in Sraffian Systems: A Dual Exercise

A CHARACTERIZATION OF ADDITIVE DERIVATIONS ON VON NEUMANN ALGEBRAS

Fixed point method and its improvement for the system of Volterra-Fredholm integral equations of the second kind

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

Transcription:

MATHEMATICS OF COMPUTATION, VOLUME 35, NUMBER 152 OCTOBER 1980, PAGES 1269-1273 On an Accelerated Overrelaxaton Iteratve Method for Lnear Systems Wth Strctly Dagonally Domnant Matrx By M. Madalena Martns* Abstract. We consder a lnear system Ax = b of n smultaneous equatons, where A s a strctly dagonally domnant matrx. We get bounds for the spectral radus of the matrx., r, uj',, whch s accocated wth the Accelerated Overrelaxaton teratve method (AOR). Suffcent condtons for the convergence of that method wll be gven, whch mprove the results of Theorem 3, Secton 4 of [2], appled to ths type of matrces. 1. Introducton. We want the soluton x of a lnear system (1.1) Ax = b, where A s an (n, r) real-matrx and x and b are n-real-vectors. We assume A s strctly dagonally domnant. There are several mportant teratve methods for the approxmaton of (1.1). We wll take the (AOR) of [1]. For that, the matrx s expressed as the matrx sum (1.2) A=I-E-F, where / s the dentty and E and F are respectvely strctly lower and upper trangular n, r) matrces. From the (AOR) method we can wrte the followng equatons: (1.3) X(+D = (/ _ rey [(l - coy + (co - r)^ + cof]x(,) + co(/ - retxb, 1 = 0, 1,2,- So, Lr w wll be the pont-(aor)-matrx assocated wth the matrx A, (1.4) Lr>w = (/ - re)~x [(1 - wx + (w - r)e + cof], and PÍLr u) the correspondng spectral radus. 2. Bounds for plr ^). As we assume A strctly dagonally domnant, A s nonsngular and verfes n (2.1) \\> Z Ityl =l'2' >" Receved October 18, 1979; revsed March 18, 1980. 1980 Mathematcs Subject Classfcaton. Prmary 65F10. *Ths work was done when the author was "equparado a bolsero pelo Insttuto Naconal de Investgaçâb Centífca". 1269 1980 Amercan Mathematcal Socety 002 5-571 8/80/0000-0167/$02.25

1270 M- MADALENA MARTINS Bounds for PÍLrw) are obtaned from Theorem 1. If A o/(l.l) s a strctly dagonally domnant matrx, then PÍLr u) satsfes the followng: (2.2) 11 - col - Ico - r\e - co /;. Ico - r\e + \w\ft + 1 - col T-ttm^-< p(l-) < T-ThTí^-' = 1, 2,..., n, where \r\ < 1 /e and e, f are respectvely the -row sums of the modul of the entres of E and F, respectvely. Proof. Snce the egenvalues of Lr ^ are gven from (2-3) det(l,w-a/) = 0 after some manpulatons, t s easy to verfy that to solve (2.3) s equvalent to solvng (2.4) det ß = 0, where Q s r(x-l) + co _^, ^ X-l+co X-l+co If we take the parameter r, co, X, n order that Q be strctly dagonally domnant, we get (2.5) IX-1 +co > co+ (X-l)r e; + Icol/;., /=1,..., t- Then, the values of X satsfyng (2.5) wll not satsfy (2.4) and cannot be egenvalues of (2.3). From (2.5), as X can take any value, we have or X - 1 - col > Ico - r\e, + Xr e,. + w /f, = 1.n, X (1 - r e,) > Ico - re,. + Icol/;. + 1 - col, í = 1,..., n. Assumng \r\ < l/e, we have 1 - \r\et If X satsfes ths nequalty, t cannot be an egenvalue of Lr LJ, and then Ico-rle,.+ co /;- + l-col pa^xmax-j-^- forlrk-. In order to get the lower bound, from (2.5) we wrte 11 - col - IXI > Ico - r\e + Xr e(- + Icol/;., 1=1,2,...,«, and

AN ACCELERATED OVERRELAXATION ITERATIVE METHOD 1271 1 -co - Ico -r\e - Icol/; X < mn- -. í 1 + Me,- Snce the values of X satsfyng ths nequalty are not egenvalues of Lr u, then 1 -co - co-r e, - \œ\f p(l^)> mn- -^-, =l,...,n. Q.E.D. As t s well known, for convenent values of r and co, the (AOR) method becomes the well-known teratve methods: r = 0, co = 1 Jacob Method, r = 1, co = 1 Gauss-Sedel Method, r = 0, co Smultaneous Overrelaxaton Method, r = co Successve Overrelaxaton Method. Takng these values, we get from (2.2) the known results (2-6a) P(L0l) <max(e,-+/;.), (2.6b) pl1,)<max ~-, l - e (2.6c) p(l0>j < max M(e, +/,) + 1 - co, M/z + U-wl (2-6d) P(-co,c)<max ', ' -. - Me,- 3. Convergence of the (AOR) Method. Theorem 2. If A o/(l.l) s a strctly dagonally domnant matrx and co > r > 0, then a suffcent condton for the convergence of the {AOR) method s Proof. 0<co< 2 1 + max(e,. + f )' From [1, Secton 3], wth A strctly dagonally domnant, the (AOR) method s convergent f0<co<l,0<r<l. be less than 1 f From (2.2) we see that p(l,.jcj) wll (3.1) co-rk,. + Icol/;-+ II-col + r e,. < 1, z = l,...,n. Wth co > r > 0 these condtons wll be fulflled. Takng /(Ô) = (5 - r)e,. + 6/j. + (1-5) + re,., we see that /(5) s a nonncreasng functon of ô f 0 < 5 < 1 and /(0) = 1, /(l) = e + f{ < 1. Wth 5 > 1, /(Ô) s an ncreasng functon wth /(ô) = 1 for 5=2/(14- e,. + /.). Then p{l ) < 1 f 2 1 + max (e,. + f ) and the (AOR) method wll be convergent. Q.E.D.

1272 M. MADALENA MARTINS Let us consder a frst-degree lnear statonary teratve method (3-2) x(,+ 1) = G*(0-M/=o,,2,...> wth G a known n x n matrx, d a known n-vector, and x^0' an arbtrary ntal approxmaton for the soluton x. The followng method (3.3) x(''+1) = [(1 -coy + cog]*(,) +corf,. = 012_, wll be called the extrapolated method of (3.2). We recall now, the Theorem of Extrapolaton [2, p. 2], as we need t n the sequel. Theorem 3 (Theorem of Extrapolaton). The suffcent condtons for the convergence of (3.3) are: (1) The orgnal (3.2) s convergent, (2) 0 < co < 2/(1 + p{g)). Settng r = 0 n (1.3), we obtan *(< +!) = [( - cox + co{e + F)]x + w =0(1(2>.. Ths s the extrapolated Jacob method, where co s the extrapolaton parameter. After some computaton, t s easy to verfy that (1.3) s the extrapolated SOR method, when r = 0 and ts extrapolaton parameter s co/r. Theorem 4. If A from (1.1) s strctly dagonally domnant, then p{l0jj) < 1 provded 0 < co < 2/(1 + p(l01)). Proof. Bearng n mnd that A strctly dagonally domnant mples p{l01) < 1 [4, p. 73], t s an mmedate consequence of Theorem 3. Theorem 5. If A o/(l.l) s strctly dagonally domnant, then p{lr, co) < 1 wth 0 < r < 1 provded 0 < co < 2r/(l + p{lrr)). Proof. From (2.6d) we easly deduce that the SOR method wll converge wth 0 < r < 1 (A s strctly dagonally domnant). Then, by the Theorem of Extrapolaton, the AOR method wll converge for 0<r<landO<co< 2r/(l + p(lr>,)). Theorem 6. The AOR method s convergent,.e. p{lr^) < 1, for: () 0 < r < co and 0 < co < 2/(1 + max,-(e,- + f )) f 2r < 2 1 +PÍLr r) " 1 + maxe,. + f ) ' (n) 0 < r < 1 and 0 < co < 2r/(l + p{lr r)) or 1 < r < co and 0 < co < 2/(1 + max,-(e,. + f )) f 2r 2 1 +PLr>r) 1 +max(e,-+/;.) '

Proof. an accelerated overrelaxaton teratve method 1273 These results come from Theorems 2 and 5. They mprove the results of Theorem 3, Secton 4 of [2], when the matrx A of (1.1) s strctly dagonally domnant: ( 2r p{lr U})<l f 0 < r < 1 and 0 < co < max-jl, { +. Acknowledgment. The author wshes to thank Professor Fernanda de Olvera and Professor Gracano de Olvera for ther suggestons and crtcsm durng the wrtng of ths paper. Department of Mathematcs Unversty of Combra Combra, Portugal 1. A. HADJIDIMOS, "Accelerated overrelaxaton method,"math. Comp., v. 32, 1978, pp. 149-157. 2. A. HADJIDIMOS & A. YEYIOS, The Prncple of Extrapolaton n Connecton wth the Accelerated Overrelaxaton (AOR) Method, T. R. No. 16, Department of Mathematcs, Unversty of Ioannna, Ioannna, Greece, 1978. 3. G. AVDELAS, A. HADJIDIMOS & A. YEYIOS, Some Theoretcal and Computatonal Results Concernng the Accelerated Overrelaxaton (AOR) Method, T. R. No. 8, Department of Mathematcs, Unversty of Ioannna, Ioannna, Greece, 1978. 4. R. S. VARGA, Matrx Iteratve Analyss, Prentce-Hall, Englewood Clffs, N. J., 1962. 5. D. M. YOUNG, Iteratve Soluton of Large Lnear Systems, Academc Press, New York and London, 1971.