Preprint BUW-SC 11/1. Bergische Universität Wuppertal. Fachbereich C Mathematik und Naturwissenschaften. Mathematik

Transcription

1 Preprint BUW-SC 11/1 Bergische Universität Wupperta Fachbereich C Mathematik und Naturwissenschaften Mathematik A. Brandt, J. Brannick, K. Kah, and I. Livshits Bootstrap AMG Januar

2

3 BOOTSTRAP AMG A. BRANDT, J. BRANNICK, K. KAHL, AND I. LIVSHITS Key words. Bootstrap agebraic mutigrid, east squares interpoation, mutigrid eigensover, adaptive reaxation AMS subject cassification. 65F10, 65N55, 65F30 Abstract. We deveop an Agebraic Mutigrid setup scheme based on the Bootstrap framework for muti-scae scientific computation. Our approach uses a weighted east squares definition of interpoation, based on a set of test vectors that are computed by a Bootstrap setup cyce and then improved by a mutigrid eigensover and a oca residua-based adaptive reaxation process. To emphasize the robustness, efficiency, and fexibiity of the individua components of the proposed approach, we incude extensive numerica resuts of the method appied to scaar eiptic partia differentia equations discretized on structured meshes. As a first test probem, we consider the Lapace equation discretized on a uniform quadriatera mesh, a probem for which mutigrid is we understood. Then, we consider various more chaenging variabe coefficient systems coming from covariant finite-difference approximations of the two dimensiona Gauge Lapacian system, a commony used mode probem in AMG agorithm deveopment for inear systems arising in attice fied theory computations. 1. Introduction. We deveop Bootstrap Agebraic Mutigrid (BAMG) techniques for soving systems Au = f, (1.1) where A C n n is assumed to be Hermitian and positive definite. AMG approaches for soving (1.1) typicay invove a stationary inear iterative method (smoother), appied to the fine-grid system, and a coarse-grid correction. The corresponding two-grid method gives rise to the error propagation operator E T G = (I MA)(I P (P H AP ) 1 P H A)(I MA), (1.2) where P : C nc C n with n c < n is the interpoation operator, M is the approximate inverse of A that defines the smoother, and for any matrix B C n m, B H denotes the conjugate transpose. A mutigrid agorithm is then obtained by recursivey soving the coarse-grid probem, invoving A c = P H AP, using the two-grid method. The efficiency of such an approach depends on the proper interpay between the smoother and the coarsegrid correction. Typicay, the AMG smoothing operator, M, is fixed and the coarse-grid correction is formed to compensate for its deficiencies. The primary task in defining a mutigrid method is then the seection of the sequence of interpoation operators. A genera two-grid process for constructing P is described by the foowing generic agorithm: 1. Given the set of n variabes on the fine grid, choose a set of n c coarse variabes such that n c < n. 2. Choose a sparsity pattern for interpoation, P C n nc. 3. Define the weights of the interpoation operator, i.e., the entries of P. Cassica AMG as originay introduced in [4, 5] and its widey used impementation by Ruge and Stüben [20] can be seen as important miestones in the deveopment of such agebraic setup agorithms. The Ruge-Stüben agorithm exhibits optima efficiency for many chaenging probems, often substantiay outperforming traditiona iterative methods. However, the agorithm and, hence, its effectiveness depend on the foowing probem specific properties: Department of Mathematics, University of Caifornia Los Angees, Los Angees CA, 90095, USA (abrandt@math.uca.edu). Department of Mathematics, Pennsyvania State University, University Park, PA 16802, USA (brannick@psu.edu). Brannick s work was supported by the Nationa Science Foundation under grants OCI and DMS Fachbereich Mathematik und Naturwissenschaften, Bergische Universität Wupperta, D Wupperta, Germany, (kkah@math.uni-wupperta.de). Kah s work was supported by the Deutsche Forschungsgemeinschaft through the Coaborative Research Centre SFB-TR 55 Hadron physics from Lattice QCD Department of Mathematica Sciences, Ba State University, Muncie IN, 47306, USA (iivshits@bsu.edu), Livshits work was supported by DOE subcontract B and NSF DMS

4 2 A. BRANDT, J. BRANNICK, K. KAHL, AND I. LIVSHITS The notion of strength-of-connection used in coarsening variabes and forming interpoation can be defined from the entries of the system matrix. The eigenvectors with sma in absoute vaue eigenvaues (owest eigenvectors) are ocay smooth in directions of such strong connections. These owest eigenvector(s) of the system matrix provide a sufficienty accurate oca representation of the other ow eigenvectors not effectivey treated by the MG reaxation scheme. For probems where a or some of these properties are vioated, efficiency of Ruge-Stüben AMG deteriorates. This oss in efficiency is often due to the ow accuracy of interpoation for vectors yieding sma normaized residuas [1], i.e., vectors x such that Ax 0. For simpe point-wise reaxation schemes, such as the Gauss Seide iteration we use in our tests, these components coincide with the error not effectivey reduced by the reaxation scheme and, hence, are often referred to as the agebraicay smooth components of the error. The Bootstrap framework for muti-scae scientific computation [3] provides genera techniques for anaysis, deveopment, and practica appication of robust mutieve methods. In the context of MG agorithms, the Bootstrap process 1 aows the user to input any features of the probem at hand (e.g., nested grids and kerne components) and then uses this knowedge to iterativey improve itsef unti optima performance is achieved. The genera setup agorithm used in this scheme incorporates severa practica toos and measures derived from the evoving MG sover, incuding: Compatibe reaxation, used in identifying suitabe smoothing schemes and coarse variabe sets [2, 7, 11, 13]. Loca weighted east squares approximations of a set of test vectors, used in a greedy agorithm to determine an agebraic distance based measure of strength of connection [3] and to define AMG interpoation [13, 17, 19]. The Bootstrap cycing scheme, used to compute sufficienty accurate sets of test vectors [13, 14]. Adaptive reaxation [2, 13] and amost zero modes [3], used to improve both the AMG setup cyce and sover. Many of the Bootstrap ideas are themseves appicabe to a wide range of muti-scae probems in computationa science. Our focus in this paper is on combining severa of these techniques to deveop a robust scheme for computing AMG interpoation. A preiminary form of the Bootstrap process for defining AMG interpoation first appeared in [5], where the use of reaxation appied to the homogenous system to produce a singe prototype to somehow define Cassica AMG interpoation was discussed. More recenty, such Bootstrap setup agorithms were deveoped for Smoothed Aggregation Mutigrid (adaptive SA, see [15]), Eement-free AMG (see [22] pp ), and Cassica AMG (adaptive AMG, see [8,9]). The main new ingredient in these more recent BAMG approaches is the idea to appy the current AMG sover to the homogenous system to both test its performance and improve the prototypes used in computing the sequence of AMG interpoation operators. The agorithm we consider here combines a BAMG cyce with a weighted east squares form of interpoation. An additiona feature unique to our approach is the use of a MG eigensover derived from the existing MG structure to enhance the prototypes needed in the definition of east squares interpoation. We mention that simiar MG techniques for using eigenvectors to define AMG interpoation were roughy outined in [18, 20]. In another reated work [10], a MG eigensover was deveoped to compute an initia SA hierarchy, after which it is abandoned and the usua adaptive SA setup process is invoked. An outine of the remainder of this paper is as foows. First, in Section 2, we present the weighted east squares process for computing interpoation and the idea of adaptive reaxation. In addition, we derive sufficient conditions guaranteeing the uniqueness of the soution to the east squares probem and compute 1 Generay, the term bootstrap refers to the idea that a process coud better evove by improving the process used for its improvement (thus obtaining a compounding effect over time.) As a computing term, bootstrapping (from an od expression pu onesef up by one s bootstraps ) has been used since at east 1958 to refer to a technique by which a simpe computer program activates a more compex system of programs that utimatey ead to a sef-sustaining process that proceeds without externa hep from manuay entered instructions.

5 BOOTSTRAP AMG 3 an expicit form of the minimizer. Our approach for computing the set of test vectors using Bootstrap techniques is described in Section 3. Then in Section 4, we present resuts of the method appied to the scaar Lapace equation discretized on a uniform mesh and severa chaenging variabe coefficient probems. We end with concuding remarks in Section Least squares interpoation. The basic idea of the east squares (LS) interpoation approach is to approximate a set of test vectors, V = {v (1),..., v (k) } C n, minimizing the interpoation error for these vectors in a east squares sense. In the context considered here, namey, appying the LS process to construct a Cassica AMG form of interpoation, each row of P, denoted by p i, is defined as the minimizer of a oca east squares functiona: For each i F find p i such that L(p i ) = k κ=1 ω κ v (κ) {i} (p i ) j v (κ) {j} j C i 2 min, (2.1) where C i C with C and F = Ω \ C denoting the coarse-grid and fine-grid variabes, respectivey. Here, the notation v Ω denotes the canonica restriction of the vector v to the set Ω Ω := {1,.., n}. In the definition of L in (2.1), for exampe, v {i} is simpy the ith entry of v. Simiary, we can define the canonica restriction of a matrix, V = ( v (1) v (k)), to a set Ω: V Ω = ( v (1) Ω ) v (k), Ω where V Ω C Ω k. The weights ω κ > 0 can be chosen to refect the energy (e.g., in A-norm v A = Av, v ) of the test vectors. We give our specific choice in the numerica experiments section Uniqueness of the soution to the oca east squares probem and an expicit form of its minimizer. To derive conditions on the uniqueness of the soution to minimization probem (2.1) and compute an expicit form of the minimizer, we consider a cassica inear agebra formuation of the LS probem. Let W = ω 1... C k k, V = ( v (1) v (k)) C n k, and V Ω = ( v (1) Ω ) v (k). Then, Ω k κ=1 ω κ v (κ) ω k {i} (p i ) j v (κ) j C i {j} 2 = V {i} W 1 2 pi V Ci W , where the weights of the individua terms in the LS functiona are now represented by a scaing defined by the matrix W. An equivaent east squares formuation of (2.1) is then L(p i ) = V {i} W 1 2 pi V Ci W min. (2.2) The minimizer of L in (2.2) and necessary conditions for its uniqueness are now easy to compute. derivative of the east squares functiona L with respect to (p i ) j is The (p i ) j L(p i ) = 2 k κ=1 ( ) ( ) ω κ v (κ) {i} p iv (κ) C i v (κ) C i j.

6 4 A. BRANDT, J. BRANNICK, K. KAHL, AND I. LIVSHITS Setting L(p i ) = 0 yieds Thus, if rank(v Ci W 1 2 ) = C i, then V Ci W VC H i is uniquey defined by p i V Ci W V H C i = V {i} W V H C i. is non-singuar and the soution to the LS minimization probem p i = V {i} W VC H ( VCi i W VC H ) 1 i. We note that if the restricted vectors V Ci form a basis for the oca inear space C ni, n i = C i, then the soutions to the oca LS minimization probems are unique. This in turn suggests setting a ower bound on the number of vectors, k, used in the east squares fit: k max i F C i =: c. Further, as we show numericay in Section 4, the accuracy of the LS interpoation operator and, hence, the performance of the resuting sover generay improves with increasing k, up to some vaue proportiona to c. Our numerica experience suggests that the number of test vectors need not be arger than 2c to obtain a sufficienty accurate P. In fact, these sets of interpoation points can often be adequatey chosen by natura considerations. For exampe, they can be chosen as the sets of geometrica neighbors with i in their convex hu. If a chosen set is inadequate, the east squares procedure wi show bad fitness (arge interpoation errors, i.e, vaues of the LS functiona) and the set must then be improved. The east squares procedure can aso be used to detect variabes in the sets C i that can be discarded without significant accuracy oss. Thus, this approach aows creating interpoation with whatever needed accuracy which is as sparse as possibe. Note that it is aso possibe to adjust the number of test vectors on-the-fy if rank deficiency of any of the operators V Ci is detected. Simiary, many rows of P wi typicay have ess than c nonzero entries, that is, C i < c. In such cases, fewer prototypes may be used in the LS process. We do not pursue this idea in the paper because it is not expected to resut in a significant reduction in setup costs, and further as our numerica resuts show, the quaity of the sover generay improves with an increased number of prototypes Equivaence of adaptive reaxation and a modified east squares functiona. A main assumption of Cassica AMG is that the reaxation scheme used in the MG agorithm efficienty reduces the residua when appied to the current approximation. This assumption is in fact centra to the definition of Cassica AMG interpoation, which is derived by setting the oca (point-wise) residua to zero. In [2], the idea of appying additiona oca reaxations to the equations i F for which the corresponding vaue of the residua is arge was proposed as a possibe approach for improving performance of Cassica AMG for certain probems (e.g., probems with singuarities). Assuming a ii 0, a Jacobi version of this iteration reads v (κ) {i} = v(κ) {i} 1 r (κ) a {i}, (2.3) ii with r (κ) = Av (κ). Simiar approaches can aso be empoyed for more genera reaxation schemes. In [13], it was observed that the impicit appication of the oca Jacobi reaxation in (2.3) to the prototypes used in the LS definition of interpoation is equivaent to an operator induced form of east squares interpoation constructed using an Eement-free AMG type approach (see [22]). This equivaence of the LS approach with an additiona oca reaxation step was aso formuated and discussed in a sighty different scope in [17], where it was defined as a residua-based LS fit: L(p i ) = k κ=1 ω κ v (κ) {i} 1 r (κ) a {i} 2 (p i ) j v (κ) {j} min, (2.4) ii j C i

7 BOOTSTRAP AMG 5 which in turn was shown to be consistent with a Cassica AMG operator induced form of LS interpoation. We mention that the work in [17] focuses on defining different versions of the LS interpoation operators using a set of reaxed test vectors; it does not address the question of how to use the Bootstrap process to compute these vectors. Deveoping the Bootstrap setup scheme for defining east squares interpoation is the main focus and contribution of the work we present here. Another interesting observation regarding the above residua form of the LS functiona is that the Eement-free AMG and Cassica AMG forms of LS interpoation considered in [13,17] differ from the origina definition ony when the test vectors with arge weights, ω k, are not sufficienty accurate, i.e., the residuas they produce are not uniformy cose to zero. In fact, our idea of appying adaptive reaxation to the test vector with argest weight (2.4) and then ony to the equations with arge reative vaues of the residua was motivated by these observations. We incude resuts and additiona discussion of both approaches in the numerica experiments section. 3. The Bootstrap agorithm. In its simpest form, the Bootstrap process for computing the test vectors used in constructing the LS interpoation operators proceeds by appying reaxation to the homogenous system, A x = 0, (3.1) on each grid, = 0,..., L 1; assuming that a priori knowedge of the agebraicay smooth error is not avaiabe, these vectors are initiaized randomy on the finest grid, whereas on a coarser grids they are defined by restricting the test vectors computed on the previous finer grid. Given interpoation, the coarse-grid operators are computed using the variationa definition. Once an initia MG hierarchy has been computed, the current sets of prototypes are further enhanced on a grids using the existing mutigrid structure. Specificay, the given hierarchy is used to formuate a mutigrid eigensover which is then appied to an appropriatey chosen generaized eigenprobem to compute additiona test vectors. This overa process is then repeated with the current AMG method repacing reaxation as the sover for the homogenous systems in (3.1). Severa subte detais must be addressed when formuating the mutigrid eigensover (MGE), namey, (1) the specific formuation for the MGE hierarchy as we as the sorting and fitering of the coarsest-grid eigenvectors within the cyce; (2) deciding on an efficient cycing strategy when integrating the MGE into the BAMG process; and (3) measuring and improving the accuracy of the test vectors computed by the MGE (eigen-approximations) as they are transferred to increasingy finer grids. We describe our formuation of the MGE next Defining the MGE hierarchy: the generaized eigenvaue probem. Given the computed BAMG hierarchy of operators A = A 0, A 1,..., A L and their corresponding interpoation operators P+1, = 0,..., L 1, define the composite interpoation operators and the sequence of subspaces of C n spanned by their coumns as P = P P 1, = 1,..., L (3.2) C n range (P 1 )... range (P L ). For any vector x C n we then have x, x A = P x, P x A, where n is the probem size on grid. Defining T = P H P, it foows that x, x A x, x T = P x, P x A P x, P x 2, (3.3)

8 6 A. BRANDT, J. BRANNICK, K. KAHL, AND I. LIVSHITS impying that on any grid, given a vector w C n and λ R, such that, A w = λ T w, (3.4) we have RQ(P w ) = P w, P w A P w, P w 2 = λ. (3.5) The resut foows from equation (3.3) appied to w, the eigenvector of the generaized eigenvaue probem (3.4), and the reations A = P H AP and T = P H P. Note that RQ( ) is simpy the Raeigh quotient and, hence, equation (3.5) reates the eigenpairs on different grids and can be used to define a MGE. Our agorithm begins by computing the k e eigenvectors with the smaest eigenvaues of the coarsest-grid operator W L = {w (κ) L A Lw (κ) L = λ(κ) L T Lw (κ) L, λ(κ) L R, κ = 1,..., k e}. Since the size of A L is sma, these eigenpairs, ( w (κ) L, ) λ(κ) L, are computed directy. Then, on any given grid, the existing interpoation operator P 1 is used to transfer these vectors to the next finer grid. We note that if w is a soution to (3.4) on grid then ( P 1 ) H A 1 P 1 w = λ ( P 1 ) H T 1 P 1 w, and so w 1 = P 1 w is an approximate soution to the generaized eigenvaue probem. Next, a smoothing iteration is appied to the homogenous probem on grid 1: Then, the approximation to λ 1 is recomputed: (A 1 λ 1 T 1 ) w 1 = 0, λ 1 = λ. (3.6) λ 1 = A 1w 1, w 1 2 T 1 w 1, w 1 2. We note that this procedure resembes an inverse Rayeigh quotient iteration found in eigenvaue computations (see [23]), with inversion repaced by severa reaxations steps. Agorithm 1 describes one variant of the MGE process for enriching the sets of test vectors Integrating the MGE and BAMG processes: cycing strategies. Combining the Bootstrap cyce with the MGE can be done using a variety of cycing strategies. The two types of cycing schemes we consider are outined in Figure 3.1. The top pot is a visuaization of two successive iterations of a V -cyce scheme, which we refer to as a doube V -cyce (or V 2 -cyce). In genera, a V µ -cyce denotes an agorithm that uses µ such V -cyces. We note that this scheme makes use of the MGE as defined by Agorithm 1, which does not update interpoation unti it reaches the finest grid. The pot in the bottom of the figure outines our second approach, in which the approximations produced by the MGE on grid are used to recompute the hierarchy at each of the coarser grids, + 1, + 2,..., L, before advancing to the next finer grid 1. Note that it may not be necessary to recompute the hierarchy at each of the intermediate grids; in practice we ony recompute P and update the hierarchy when reaxation appied to the interpoated eigenvector approximations significanty reduces at east one of the Rayeigh quotients (3.5) associated with these approximations by some prescribed toerance.

9 BOOTSTRAP AMG 7 Agorithm 1 for = L,..., 1 do if the current grid is the coarsest grid L then Take W L = {w (κ) L A Lw (κ) L = λ(κ) L ese Given W +1 and P+1 from the initia setup w (κ) = P +1 w(κ) +1, λ(κ) for κ = 1,..., k e do Reax on end for end if end for Cacuate λ (κ) ( A λ (κ) T ) w (κ) = 0 T Lw (κ) L, κ = 1,..., k e} = λ (κ) +1, κ = 1,..., k e = A w (κ), w (κ) 2 T w (κ), w (κ) 2 {Mutigrid eigensover} Reax on Av = 0, v V Reax on (A λt )w = 0, w W Compute W, s.t., Aw = λt w, w W Reax on Av = 0, v V and (A λt )w = 0, w W Fig. 3.1: Bootstrap AMG V 2 -cyce and W-cyce setup schemes Updating the MG eigendecomposition. Consider the generaized eigenvaue probem A j w j = λ j T j w j, on two subsequent grids, j =, 1, with λ denoting the RQ of a given approximation of an eigenvector on the coarser grid and λ 1 denoting the RQ of the vector obtained by appying reaxation to this vector

10 8 A. BRANDT, J. BRANNICK, K. KAHL, AND I. LIVSHITS i C i F Fig. 4.1: Interpoation reations for our choice of fu-coarsening for i F \ C. interpoated to the next finer one. Define the eigenvaue approximation measure τ (, 1) λ τ (, 1) λ = λ λ 1. (3.7) λ 1 At any stage of the MGE iteration, a arge vaue of τ (, 1) λ indicates that the hierarchy shoud be recomputed to incorporate this reaxed eigenvector approximation. Otherwise, reaxation has not significanty changed this vector and it is accuratey represented by the existing interpoation operator P 1. In this way, the MGE serves as a technique for efficienty identifying components that must be interpoated accuratey (e.g., the ow modes of A), and for determining if the current P approximates them sufficienty we. 4. Numerica resuts. In this section, we present numerica tests of our BAMG-MGE setup agorithm appied to a series of test probems. We consider isotropic systems defined on two-dimensiona equidistant quadriatera meshes. Fixing the coarse grids and the sparsity pattern of interpoation, we study the performance of the LS and MGE techniques for computing the entries in P. We begin with tests for the Lapace operator discretized using finite eements (FE Lapace) and finite differences (FD Lapace). We then transition to a sighty more difficut test probem of symmetric diagona scaings of the Lapace operator. Then, we proceed to tests of our method appied to the Gauge Lapace system (see Appendix A). In a tests, the sets of coarse variabes are defined by fu-coarsening, that is, the coarse grids are obtained by doubing the mesh spacing in each spatia dimension of the reated finer mesh; the coarsening is continued unti the probem size on the coarsest-grid is 7 7 or 8 8, depending on the size of the probem on the finest mesh. We imit interpoation to the nearest neighbors (in terms of the graph of the matrix) and the maxima number of interpoatory points for each i F is thus bounded by four for the probems we consider (see Figure 4.1). We use the weighted east squares approach to define the entries of the interpoation operators, with the weights defined by ω κ = T v (κ), v (κ) A v (κ), v (κ), (4.1) and test the origina east squares definition of interpoation (LS interpoation) as we as the approach that appies additiona adaptive oca reaxations to the test vectors prior to computing the interpoation operator (LSR interpoation). For the resuts reported in Tabe 4.10, we appy the oca reaxation scheme (2.3) to every test vector; for a other tests we appy oca reaxation ony to the singe test vector with the argest weight, ω max, and then ony to 20% of the F-points for which the associated vaue of the residua is argest in absoute vaue. by

11 BOOTSTRAP AMG 9 Let k r = V denote the number of test vectors computed using reaxation in the Bootstrap cyce, k e = W denote the number of additiona eigenvector approximations computed by the MGE, and η be the number of Gauss Seide (GS) iterations used in the BAMG cyce and MGE to compute them. The LS and LSR forms of interpoation are then computed on each eve using the combined sets of k = k r + k e test vectors. On the finest grid, the vectors, v (1),..., v (kr), used to initiaize the Bootstrap process are generated randomy with a norma distribution with expectation zero and variance one, N(0, 1), on a other grids they are defined by restricting the reaxed test vectors from the reated finer grid. We use a V (2, 2) MG sover with GS reaxation for a tests. The reported estimates of the asymptotic convergence rates are computed as foows: ρ = eν A e ν 1 A, where e ν is the error after ν MG iterations. The sover terminates if the method reduces the initia error by a factor 10 8 or if ν = 100 iterations are appied and the method faied to converge to this toerance Lapace s equation. We start the numerica experiments by appying the BAMG cyce and MGE to the two dimensiona Lapace equation u xx u yy = 0, (x, y) (0, 1) 2, u(x, y) = 0, (x, y) Γ, discretized using biinear finite eements (see [21]) on a (N 1) (N 1) equidistant quadriatera mesh. The corresponding discretization yieds the symmetric and positive definite operator A given by the stenci A = For this probem our choices of fu coarsening and sparsity pattern of interpoation yied variationa coarsegrid operators with at most nine non-zero entries per row, impying that the sparsity structure of the finest-grid operator A is preserved on a grids. The resuts reported in Tabe 4.1 are for the LS and LSR based two-grid methods appied to the FE Lapace system on a grid. Overa, we observe that increasing the number of test vectors, k r, used in defining P and increasing the number of smoothing iterations, η, used to compute them, both improve the performance (reduce the convergence rates) of the resuting two-grid sovers. Further, the resuts for the LSR scheme are consistenty better than the resuts for the LS approach. In Tabe 4.2, we report resuts obtained by appying a two-grid method to the FE Lapace system for different probem sizes. The sover is constructed using the LS and LSR formuations for defining P with a fixed numbers of test vectors k r = 8 and smoothing iterations η = 4 independent of the choice of probem size. Here, we see that the convergence rates of both the LS and LSR based two-grid methods increase as the size of the probem is increased, suggesting that appying a constant number of reaxation steps to compute a fixed number of test vectors does not produce a sufficienty accurate oca representation of the agebraicay smooth error for defining east squares interpoation. In Tabe 4.3, we present resuts for the two-grid method obtained by adding the constant vector, 1, to V, again for a fixed number of test vectors k r = and η = 4 reaxation steps used to compute them. Here, we see that incuding the constant vector in V significanty improves the LS and LSR based two-grid sovers. In fact, the method obtained using the LSR approach performs optimay for the probem sizes considered. This demonstrates the fexibiity of the east squares formuation and its abiity to incorporate a priori knowedge of the ow modes of the probem at hand. It aso motivates the use of the MGE in the BAMG process for computing test vectors, as a way to improve their approximation of ow eigenmodes.

12 10 A. BRANDT, J. BRANNICK, K. KAHL, AND I. LIVSHITS k r η (.962).973 (.958).971 (.955).967 (.949).963 (.944) (.866).916 (.827).904 (.806).878 (.786).861 (.759) (.679).803 (.637).775 (.606).734 (.566).709 (.535) (.524).681 (.453).648 (.403).608 (.269).575 (.316) (.374).553 (.326).518 (.287).484 (.165).457 (.138) (.294).451 (.242).425 (.205).381 (.154).305 (.136) (.227).364 (.186).346 (.155).268 (.089).257 (.098) (.169).308 (.140).287 (.123).238 (.054).216 (.061) Tabe 4.1: Asymptotic convergence rate estimates, ρ, of the LS (LSR) based two-grid methods appied to the FE Lapace probem. The sover is constructed using various choices of η and k r. N ρ.267 (.075).648 (.403).886 (.758).966 (.917).990 (.977) Tabe 4.2: Asymptotic convergence rate estimates, ρ, of the LS (LSR) based two-grid methods appied to the FE Lapace probem. The sover is constructed using the LS (LSR) schemes in a V -cyce setup with η = 4 and k r = 8. N ρ.089 (.039).121 (.040).130 (.042).148 (.042).150 (.043) Tabe 4.3: Asymptotic convergence rate estimates, ρ, of the LS (LSR) based two-grid methods appied to the FE Lapace probem. The sover is constructed using the LS (LSR) schemes using a V -cyce setup with η = 4 Gauss Seide iterations to compute the seven initiay random test vectors; the additiona test vector is the constant vector chosen a priori. Next, we consider using the V 2 -cyce setup (see Fig. 3.1). We appy η = 4 iterations of the smoother to k r = 8 initiay random test vectors to generate the MG hierarchy and η = 4 reaxation steps to the k e = 8 additiona test vectors generated by the MGE. As the resuts reported in Tabe 4.4 show, using the MGE to enhance the test vectors consistenty improves the performance of the resuting sovers when compared to the resuts reported in Tabe 4.2, especiay for the LSR scheme. Here, the LSR approach yieds an optima N ρ.041 (.038).062 (.041).075 (.043).125 (.043).971 (.043) Tabe 4.4: Asymptotic convergence rate estimates, ρ, of the LS (LSR) based two-grid methods appied to the FE Lapace probem. The sover is constructed using a V 2 -cyce setup with η = 4 and k r = k e = 8. method, whereas for the LS scheme, as the probem size goes from N = 255 to N = 511, the convergence rate of the sover increases substantiay from ρ.125 to ρ.971. These resuts in turn suggest that the goba weights, ω κ, used in computing interpoation, bias the LS fit to some inadequate oca representations of the agebraicay smooth error, utimatey eading to a poor choice of interpoation for the associated fine-grid variabes. The LSR scheme is however abe to compensate for this in a very efficient manner. An

13 BOOTSTRAP AMG 11 aternative approach woud be to define the weights used in the LS fit ocay (i.e., for each i F) we mention that athough we have studied this idea extensivey, we have not yet derived an effective strategy for defining oca weights. To further iustrate the efficacy of the MGE when combined with the LSR form of P for this probem, we report the eigenvaue approximation measures, τ (L,1) λ defined in Equation (3.7), computed using the eight smaest eigenvaues of the coarsest-grid operator and the associated Rayeigh quotients of the finest-grid test vectors generated using the V 2 -cyce setup agorithm. Additionay, we report the two-norms of the differences between the eight eigenvectors with smaest eigenvaues of the coarsest-grid system interpoated to the finest grid using the composite interpoation operators defined in (3.2) and the eigenvectors of the finest-grid system computed directy. The resuts are reported in Tabe 4.5. Here, we see that the eigenvaue approximation measures are uniformy sma for the k e = 8 computed eigenvector approximations and further that the eigenvector approximations interpoated form the coarsest grid to the finest one approximate we the targeted eigenvectors of the finest grid system, i.e., the eigenvectors associated with the smaest eigenvaues of A. We mention further that the eigenvector approximation measures consistenty detect the accuracy of the eigenvector approximations computed using the MGE. i τ (L,1) λ i P L vi L v i Tabe 4.5: Reative eigenvaue approximation measures τ (L,1) λ i and eigenvector approximation estimates of the 8 smaest eigenvaues for the FE Lapace probem, computed within a V 2 -cyce setup with η = 4 and k r = k e = 8. Next, we provide pots of the eigenvector approximations computed using a V-cyce setup agorithm with η = 4 and k r = k e = 8 and of the associated eigenvectors of the finest grid operator computed directy. Figure 4.2(a) contains pots of the eigenvector with the smaest eigenvaue on each eve of the MGE computed using a singe V-cyce setup, and Figure 4.2(b) contains a pot of the eigenvector with the smaest eigenvaue of the system matrix on the finest grid computed directy. The pots demonstrate the abiity of the MGE (buit using smoothed random test vectors) to recover the smaest eigenvector of the finest-grid FE Lapace operator. In addition, we provide pots comparing the eigenvector approximations on the finest grid computed using the same V 2 -cyce setup and the eigenvectors of the finest-grid operator computed directy. Figure 4.3(a) contains pots of the finest-grid eigenvector approximations for the four smaest eigenvaues computed using a V 2 -cyce setup and Figure 4.3(b) contains the pots of the eigenvectors of the finest-grid operator with the four smaest eigenvaues computed directy. Again, the pots iustrate that the MGE is abe to recover the ow eigenvectors of the fine-grid system. N ρ.042 (.038).062 (.041).073 (.043).130 (.043).161 (.044) Tabe 4.6: Asymptotic convergence rate estimates, ρ, of the LS (LSR) based MG sovers appied to the FE Lapace probem. The sover is constructed using a W -cyce setup (see Figure 3.1) with η = 4 and k r = k e = 8. We now consider tests of the W -cyce setup, iustrated at the bottom of Figure 3.1. In Tabe 4.6, we present resuts for this scheme again with k r = k e = 8. We notice a marked improvement in the performance

14 12 A. BRANDT, J. BRANNICK, K. KAHL, AND I. LIVSHITS (a) Mutigrid representation of the coarsest-grid eigenvector (b) Finest grid Fig. 4.2: Comparison of the eigenvector corresponding to the smaest eigenvaue in 4.2(a) computed in a V -cyce setup with η = 4 and k r = k e = 8 and the associated finest grid eigenvector in 4.2(b) corresponding to the smaest eigenvaue of the FE Lapace probem computed directy. (a) Finest grid representation of the coarsest-grid eigenvectors (b) Finest grid Fig. 4.3: Visuaization of the finest-grid eigenvector approximations of the four smaest eigenvaues computed using a V 2 -cyce setup with η = 4 and k r = 8 in 4.3(a) and the associated exact finest-grid eigenvectors corresponding to the four smaest eigenvaues in 4.3(b). of the LS-based sover constructed using a W -cyce setup over that of the sover constructed using a V -cyce setup and note that the LSR scheme again scaes optimay with probem size. The ast resut we present for the FE Lapace system is reated to the computationa compexity of the BAMG-MGE setup. In Figure 4.4, we show the time, t, spent in the setup phase as a function of the number of the finest-grid variabes, N 2. The numerica tests were performed using an 2.53GHz Inte Core 2 Duo

15 BOOTSTRAP AMG 13 processor with 4GB 1066MHz DDR3 SDRAM. The resuts suggest that the computationa compexity for both setup cycing strategies is neary optima (grows ineary with the probem size) when appied to this probem W cyce doube V cyce t N 2 x 10 5 Fig. 4.4: Tota wa cock times for the V 2 - and W -cyce setup agorithms with η = 4 and k r = k e = 8 appied to the FE Lapace probem, versus the probem-size N The Gauge Lapace system. In this section, we consider soving the two-dimensiona Gauge Lapace system [6, 12, 16] with periodic boundary conditions, a probem that is typicay used for testing potentia AMG agorithms for soving the Dirac equation in more genera attice gauge theories, e.g., Quantum Chromodynamics (QCD). A detaied discussion of the Gauge Lapace system and its spectra properties is provided in Appendix A. The 2D Gauge Lapacian (GL) can be viewed as a stochastic variant of the standard Lapace operator discretized using centra finite differences. Specificay, using stenci notation the Gauge Lapace operator is given by where A(U) = U z ex U z y x 4 + m Ux z, (4.2) U z ey y U = {U z µ U(1), µ = x, y, z Ω} and m R. Here, z denotes a grid point on the computationa domain Ω. The off-diagona entries of the system matrix are often referred to as Gauge configurations which vary according to a specific probabiity distribution. In our tests, we consider coections of constant gauge variabes, namey, U constant, as we as stochastic distributions. Our abeing of the unknowns and gauge variabes is iustrated in Figure A.1, where e µ denotes the unit vector in the µ-direction, i.e., it describes a shift on the attice by one attice site in the µ-direction. In a tests, we use the same coarsening and sparsity structure of P as for the FE Lapace system (see Figure 4.1), and coarsen the equations unti the dimension of the coarsest system is 8 8. We note that the GL operator is Hermitian and we define m such that λ min = N 2, resuting in positive definite yet i-conditioned system matices.

16 14 A. BRANDT, J. BRANNICK, K. KAHL, AND I. LIVSHITS Numerica resuts for the Gauge Lapacian with constant U. In Section 4.1, we demonstrated the effectiveness of the BAMG-MGE approach for the biinear finite eement discretization of Lapace s equation. Here, we test the method for the GL system with various choices of U constant. In Tabe 4.7, we report resuts for a V 3 -cyce setup agorithm appied to GL system with U 1. Taking m = 0, this yieds the FD Lapace operator discretized using centra finite differences, up to a scaing by h 2. As the resuts reported in Tabe 4.7 show, we obtain a very efficient mutigrid sover for this probem with the LSR approach it reduces the error by an order of magnitude at each iteration; whereas the performance of the LS scheme deteriorates as the probem size is increased. N ρ.080 (.055).090 (.056).094 (.055).089 (.053).727 (.052) Tabe 4.7: Asymptotic convergence rate estimates, ρ, of the MG method obtained by using the LS (LSR) schemes in a V 3 -cyce setup with η = 4 and k r = k e = 8. As a next test, we appy this same approach for U 1. This operator resuts from appying a symmetric diagona scaing to the FD Lapace probem, such that the kerne of the scaed operator aternates between 1 and 1. The resuts of our experiments are reported in Tabe 4.8. Again the resuts suggest that the LSR scheme with a V 3 -cyce setup is abe to efficienty sove this probem. N ρ.074 (.059).080 (.057).095 (.055).126 (.053).998 (.052) Tabe 4.8: Asymptotic convergence rate estimates, ρ, of the MG method obtained by using the LS (LSR) schemes in a V 3 -cyce setup with η = 4 and k r = k e = 8. Next, in Tabe 4.9, we report resuts for the GL operator with U e i π 7, giving the stenci e i π 7 A(U) = e 7 (4 + m) e i π 7. e i π 7 Again, we use a V 3 -cyce setup. We note that the resuting system is not equivaent to a diagona scaing of N ρ.058 (.056).054 (.054).055 (.051).051 (.049).056 (.048) Tabe 4.9: Asymptotic convergence rate estimates, ρ, of the MG method obtained using the LS (LSR) schemes in a V 3 -cyce setup with η = 4 and k r = k e = 8. the FD Lapace operator (see Appendix A for detais). Nonetheess, the LSR approach with V 3 -cyce setup yieds an efficient sover for this system as we Numerica resuts for the Gauge Lapacian with stochastic distributions of the gauge variabes. We concude our experiments with tests for the GL operators A(U) for various reaizations of the gauge variabes. In interesting cases, they are weaky correated among neighboring grid points. In genera, their distribution depends on a parameter β. The case β = yieds U z µ = 1 for µ = x, y and a z Ω. As we discuss in the appendix, as the gauge variabes become ess correated, the support of the ow eigenvectors

17 BOOTSTRAP AMG 15 of A(U) in turn become increasingy oca (see Figure A.3). Further, the number of ocay supported ow modes of A(U) generay increases as the probem size is increased, making it difficut to define an effective MG interpoation operator for the system. We report asymptotic convergence rates of the stand aone MG sover and the number of iterations it takes the associated MG preconditioned Conjugate Gradient method to reduce the initia residua by a factor of The resuts are contained in Tabe β \N W.242 W.416 W.286 W.648 W.478 W.658 V V W.284 W.264 W.225 W.576 W.389 W.672 V V W.120 W.225 W.223 W.586 W.349 W.433 V V Tabe 4.10: Asymptotic convergence rate estimates, ρ, of the MG method obtained using the LS scheme (on the eft) and LSR scheme (on the right) from V 3 - and W -cyce setup agorithms with η = 4, k r = 8, and k e = 16. The provided integer vaues denote the number of MG preconditioned Conjugate Gradient iterations needed to reduce the reative residua by a factor of An important observation here is that the improved sover performance observed for the LSR approach over the LS one for the GL system with stochastic distributions of the gauge variabes is far ess pronounced than it was for the FE Lapace system and the GL system with constant gauge variabes. Reca that, for these tests we appy the adaptive reaxation scheme to a the test vectors before constructing the LSR form of P. We note that even when appying the adaptive reaxation technique to a test vectors, the convergence rates reported for the LSR-based sover are ony marginay better than those reported for the LS-based scheme. Overa, the ack of scaing of the stand-aone method when going to arger grid sizes can perhaps be expained by the fact that the coarsest grid is not fine enough to accuratey represent a of the ocay supported eigenvectors with sma eigenvaues. Due to the stochastic nature of the configurations used in defining the entries of the system matrix, it is not cear that a direct comparison of the method for different probem sizes is reevant. Perhaps a more meaningfu observation here is that for the AMG preconditioned Conjugate Gradient sover, the number of iterations is roughy constant for a probem sizes and configurations. This in turn suggests that in the stand-aone mutigrid sover ony a few error components are not efficienty backuced. There are severa possibe ways to remedy this. First, as we did in the tests, we coud try to capture as many of the components in our BAMG-MGE setup as possibe and then treat the remaining components by recombining successive iterates, for exampe by using the mutigrid sover as a preconditioner for a Kryov subspace method (e.g., the Conjugate Gradient method). Aternativey, we coud treat these ocay supported vectors by a bock smoother, an idea coser to the mindset of geometric mutigrid. As a fina iustration, we demonstrate that even for these more chaenging tests the MGE is abe to efficienty compute eigenvector approximations of the eigenvectors of the finest-eve system. Figure 4.5 contains pots of the moduus of the eigenvector approximations with smaest eigenvaue computed using a V 2 -cyce setup. Again, we observe that the BAMG-MGE cyce efficienty generates an accurate mutigrid representation of the eigenvector with the smaest eigenvaue. 5. Concuding Remarks. In this paper, we deveoped and tested a Bootstrap approach for computing mutigrid interpoation operators. As in any efficient mutigrid sover, these operators have to be accurate for the owest eigenvectors of the probem s finest-grid operator. Here, this is achieved by defining interpoation to fit, in a east squares sense, a set of test vectors that coectivey approximate the agebraicay smooth

18 16 A. BRANDT, J. BRANNICK, K. KAHL, AND I. LIVSHITS (a) Mutigrid representation of the coarsest-grid eigenvector (b) Finest grid Fig. 4.5: Comparison of the MGE representation of the eigenvector approximations with smaest eigenvaue on each eve (Figure 4.5(a)) with the associated finest-grid eigenvector with smaest eigenvaue (Figure 4.5(b)). error. We have shown that using east squares interpoation with a BAMG cyce, a MGE, and adaptive reaxation eads to an efficient AMG setup agorithm and sover for the scaar test probems considered. A numerica experiments presented in the paper were for scaar partia differentia equations discretized on structured grids, using fu coarsening and interpoation with a fixed sparsity pattern. This aowed us to concentrate on deveoping and testing techniques for computing the interpoation and the impact of the BAMG setup, the MGE, and adaptive reaxation on the accuracy of the resuting interpoation operators. Our future research wi focus on the use of compatibe reaxation as an efficient too for choosing coarse-grid variabes and the use of agebraic distance to define the sparsity structure of the corresponding interpoation operator. Appendix A. The Gauge Lapacian system. The Gauge Lapace operator is a commony used test probem in AMG agorithm deveopment for attice formuations of the Dirac equation arising in Lattice Gauge Theories. The attice Dirac operator describes a discretized system of couped PDEs. For the sake of definiteness, Wison s origina discretization gives the nearest-neighbor couping of the unknowns which, for a two-dimensiona space and a given U(1) background gauge fied, can be written in spin-permuted ordering as ( ) A(U) B(U) D = B(U) H, A(U) where U denotes a discrete reaization of the so-caed gauge fied. The gauge configuration U can be understood as a coection of ink variabes of U(1), i.e., compex numbers with moduus one, U = {U z µ U(1), µ = x, y, z Ω}. As stated earier, our abeing of the unknowns and gauge inks is iustrated in Figure A.1. Herein, e µ is the unit vector in the µ-direction, i.e., it describes a shift on the attice by one attice site in the µ-direction. The diagona bocks, A(U), are referred to as Gauge Lapacians. The action of A(U) on a vector ψ C N 2

19 BOOTSTRAP AMG 17 U z+ey y U z+ex+ey y U z ex+ey x z + e y U z+ey x z + e x + e y U z+ex+ey x U z y U z+ex y U z ex x z U z x z + e x U z+ex x U z ey y U z+ex ey y Fig. A.1: Naming convention on the attice. at a attice site z Ω reads and the action of B(U) on ψ at site z Ω is given by (A(U)ψ) z = (4 + m)ψ z U z ex x ψ z ex (A.1) U z ey y ψ z ey U z xψ z+ex U z y ψ z+ey, (B(U)ψ) z = Uxψ z z+ex Ux z ex ψ z ex + i ( ) Uy z ψ z+ey Uy z ey ψ z ey. In our numerica experiments, we consider soving the Gauge Lapace system A(U)ψ = ϕ, for different choices of the shift m and configurations of U. In interesting cases, the off-diagona entries of A(U) are weaky correated among neighboring grid points. In genera, their distribution depends on a parameter β. The case β = yieds U z µ = 1 for µ = x, y and a z Ω. As β 0, the gauge variabes θ z µ in U z µ := e iθz µ become ess correated 2 and the support of the ow eigenvectors becomes increasingy oca. A.1. Spectra properties of the Gauge Lapacian. From (A.1), it foows that the GL matrix is Hermitian. We define the constant, m, so that the resuting matrix A has as its smaest eigenvaue λ min = N 2, with N denoting the number of grid points in a given direction of the two-dimensiona grid. This choice in turn yieds positive definite yet i-conditioned system GL systems. An important issue to consider when deveoping sovers for the Gauge Lapacian is the oca character of its agebraicay smooth error. Figure A.2 contains pots of the moduus, rea and imaginary parts, of the eigenvector with the smaest eigenvaue of the system matrix in (A.1). In Figure A.3, we provide a pot of the error for β = 5 on a grid computed using 50 Gauss-Seide reaxations. Here, we see two main reasons why standard Agebraic Mutigrid approaches break down when appied to this probem the agebraicay smooth error is ocay supported and it is not smooth among neighboring grid points in regions where it is nonzero. 2 In the reported resuts, we use gauge variabes generated using a code suppied to us by R. Brower from Boston University. The gauge data is avaiabe in ASCII format onine at

20 18 A. BRANDT, J. BRANNICK, K. KAHL, AND I. LIVSHITS Fig. A.2: Moduus, rea and imaginary parts of the eigenvector to the smaest eigenvaue for β = 5 on a grid. Fig. A.3: Moduus, rea and imaginary parts of agebraicay smooth error after 50 GS iterations appied to a random initia guess for β = 5 on a grid, which for our choice of simpe point-wise smoother is a inear combination of the ow eigenvectors of the fine grid system. To further anayze the properties of the GL operator, we consider the notion of a gauge transformation. A gauge transformation g : Ω U(1) z g z of a gauge configuration U = {U z µ} U(1) is defined by U z µ ḡ z U z µg z+eµ. That is, a gauge transformation can be represented as a diagona matrix G = diag(g z ), z Ω. Thus, the action of the gauge transformation on a gauge covariant operator Z(U) is given by Z(U) G H Z(U)G. (A.2) In the case of U U(1), we obtain the gauge transformation of U under the gauge transformation g : z e iψz by U z µ = e iθz µ g e iψz e iθz µ e iψ z+eµ. (A.3) Note that the U(1) gauge transformation G in equation (A.2) fufis G H G = I and G.,i 2 = 1, i = 1,..., m, that is, the gauge transformation is a unitary simiarity transformation of the matrix Z(U). Hence, if x 1,..., x m are the eigenvectors of Z(U) corresponding to the eigenvaues λ 1,..., λ m, then G H x 1,..., G H x m

21 BOOTSTRAP AMG 19 are the eigenvectors of G H Z(U)G corresponding to the same eigenvaues. Accordingy, we define an equivaence reation between two operators Z(U 1 ), Z(U 2 ), with gauge configurations U i, i = 1, 2 as Z(U 1 ) Z(U 2 ) there exists G s.t. Z(U 1 ) = G H Z(U 2 )G. Appying this definition we have that for a given constant configuration (Uµ z e iθ ) on an N N equidistant attice, if θ fufis θ = 2πk N, for some k {0,..., N 1}, then A(U) A(U 0 ) where U 0 denotes the case when U 1. Thus, for certain distributions of U, A(U) is simpy a diagonay scaed Lapacian, whereas, in others the system is not equivaent. We note that an effective AMG agorithm shoud sove the Lapace-equivaent systems with performance simiar to its performance for the standard Lapacian, whereas the performance in the non-equivaent case is not predictabe. A more detaied study of this system can be found in [13]. (A.4) REFERENCES [1] A. Brandt. Agebraic mutigrid theory: The symmetric case. App. Math. Comput., 19(1-4):23 56, [2] A. Brandt. Genera highy accurate agebraic coarsening. Eectron. Trans. Numer. Ana., 10:1 20, [3] A. Brandt. Mutiscae scientific computation: review In T. J. Barth, T. F. Chan, and R. Haimes, editors, Mutiscae and Mutiresoution Methods: Theory and Appications, pages Springer, Heideberg, [4] A. Brandt, S. McCormick, and J. Ruge. Agebraic mutigrid (AMG) for automatic mutigrid soution with appication to geodetic computations. Technica report, Coorado State University, Fort Coins, Coorado, [5] A. Brandt, S. McCormick, and J. Ruge. Agebraic mutigrid (amg) for sparse matrix equations. In D. J. Evans, editor, Sparsity and Its Appications. Cambridge University Press, Cambridge, [6] J. Brannick, R. Brower, M. Cark, J. Osborn, and C. Rebbi. Adaptive mutigrid agorithm for attice QCD. Phys. Rev. Lett., 100, [7] J. Brannick and R. Fagout. Compatibe reaxation and coarsening in agebraic mutigrid. SIAM J. Sci. Comput., 32(3): , [8] J. Brannick and L.Zikatanov. Agebraic mutigrid methods based on compatibe reaxation and energy minimization. In O. B. Widund and D. E. Keyes, editors, Domain decomposition methods in science and engineering XVI, voume 55, pages Springer, [9] M. Brezina, R. Fagout, S. MacLachan, T. Manteuffe, S. McCormick, and J. Ruge. Adaptive amg (aamg). SIAM J. Sci. Comput., 26: , [10] M. Brezina, T. Manteuffe, S. McCormick, J. Ruge, G. Sanders, and P. Vassievski. A generaized eigensover based on smoothed aggregation (ges-sa) for initiaizing smoothed aggregation (sa) mutigrid. Numer. Linear Agebra App., 15: , [11] R. Fagout and P. Vassievski. On generaizing the amg framework. SIAM J. Numer. Ana., 42(4): , [12] K. Kah. An agebraic mutieve approach for a mode probem for disordered physica systems. Master s thesis, Bergische Universität Wupperta, Fachbereich Mathematik und Naturwissenschaften, [13] K. Kah. Adaptive Agebraic Mutigrid for Lattice QCD Computations. PhD thesis, Bergische Universität Wupperta, Fachbereich Mathematik und Naturwissenschaften, Wupperta, [14] I. Livshits. One-dimensiona agorithm for finding eigenbasis of the schrödinger operator. SIAM J. Sci. Comput., 30(1): , [15] R. Fagout M. Brezina, S. MacLachan, T. Manteuffe, S. McCormick, and J. Ruge. Adaptive smoothed aggregation (αsa). SIAM J. Sci. Comput., 25(6): , [16] S. MacLachan and C. Oosteree. Agebraic mutigrid sovers for compex-vaued matrices. SIAM J. Sci. Comput., 30(3): , [17] T. Manteuffe, S. McCormick, M. Park, and J. Ruge. Operator-based interpoation for bootstrap agebraic mutigrid. Numer. Linear Agebra App., 17(2-3): , [18] S. McCormick and J. Ruge. Mutigrid methods for variationa probems. SIAM J. Numer. Ana., 19(5): , [19] D. Ron, I. Safro, and A.Brandt. Reaxation based coarsening and mutiscae graph organization. preprint, [20] J. Ruge and K. Stüben. Agebraic mutigrid. In S. F. McCormick, editor, Mutigrid Methods, voume 3 of Frontiers in Appied Mathematics, pages SIAM, Phiadephia, [21] G. Strang and G. J. Fix. An Anaysis of the Finite Eement Method. Prentice Ha, Engewood Ciffs, [22] P. Vassievski. Mutieve Bock Factorization Preconditioners: Matrix-based Anaysis and Agorithms for Soving Finite Eement Equations. Springer, [23] J. Wikinson. The Agebraic eigenvaue probem. Carendon Press, Oxford, 1965.