Department of Computer Science, University of Illinois at Urbana-Champaign
|
|
- Evan Paul
- 6 years ago
- Views:
Transcription
1 Department of Computer Science, University of Illinois at Urbana-Champaign Probing for Schur Complements and Preconditioning Generalized Saddle-Point Problems Eric de Sturler, Optimization Technology Center, Northwestern University, October 6, 24
2 Collaborators Jörg Liesen, TU Berlin Chris Siefert, Mike Parks, UIUC Armand Beaudoin, UIUC: metal deformation Lihua Zhu, UIUC: metal deformation Alla Sheffer, UBC: surface parameterization
3 Overview Crash course on Krylov subspace methods Saddle-point problems Preconditioners Numerical Example: Surface Parameterization Preconditioning Matrices with Nonzero (2,2) Block Approximating the Schur complement Probing Numerical results Oseen Problem (lid driven cavity) Metal Deformation Conclusions
4 Krylov Methods Crash Course Consider Ax = b. Given x and r = b Ax, compute optimal m m 1 K A, r span r, Ar,, A r : update from ( ) { } Let min ( ) ( ) b A x + z min r Az m z K Ar, 2 z K Ar, 2 ( ) m K m r Ar A r A r 2 m 1 =, then z = Kmζ, and we must solve the following least squares problem AKmζ r Ar A r A r ζ r 2 m Do this accurately and efficiently every iteration for increasing m. Arnoldi recurrence: H AVm = Vm+ 1H m, where v1 = r / r, V 2 m+ 1Vm+ 1 = Im+ 1, and range ( V ) = range( K ) m+ 1 m+ 1 r AV y = V e r V H y = e r H y m m 2 m m+ 1 m m m m 2
5 Krylov Methods Crash Course = b, and relate convergence to polynomials. 2 m 1 xm = x + zm where zm span{ r, Ar, A r,, A r} m r = r Az span{ r, Ar,, A r } Consider Ax m Assume z K min m m A= UΛ U 1 (diagonalizable), then residual at step m 1 = min ( ) min max ( λ) m ( Ar, ) pm( ) = 1 pm( ) = 1λ Λ( A) r Az p A r r U U p For normal matrix this bound is sharp. For highly nonnormal matrix this bound may not be useful. κ ( U ) small: convergence determined by minimal polynomial Clustered eigenvalues yield fast convergence: preconditioning Eigenvalues surrounding origin yields very poor convergence. m
6 Krylov Methods Crash Course 1. A = diag( 1,2, 3,,1) A = diag( 1, 1,1,2,, 49, 52,,1) A = diag( 99, 97,, 1,1, 3,, 97, 99) log1 r GMRES/MINRES #iterations
7 Generalized Saddle-point Problems We consider systems of the type T A B x f C y = g and T A B x f C D y = g Systems of this type arise in a variety of problems: Constrained optimization problems o FETI (type) methods (Mike Parks) o Surface parameterization Systems of PDEs with continuity constraints o Navier-Stokes o Potential flow in porous media o Polycrystal plasticity metal deformation o Electrostatics / electromagnetics
8 Preconditioners Various preconditioners have been proposed Block diagonal preconditioner Constraint preconditioner Block upper triangular Ideal version leads to small number of nonzero eigenvalues, and hence fast convergence for Krylov methods In general we use an approximation to these ideal versions (otherwise too expensive) Typically involve Schur complement type matrix
9 Preconditioners Significant body of work by Elman, Golub, Wathen, Benzi, Silvester, Gould, Nocedal, Hribar, Simoncini, Perugia, BP, Use splitting A= F E (ds&l): 1 T F F E B I S N 1 ( 1 T = CF B ) C M 1 T ( ) 1 M CF B C =, N F B 1 T =, MN I =, ( NM ) 2 NM = U U I U U Oblique projection: ( ) ( ) = NM Principal angles ( ωi = cosϕi) between null( NM ) and range( NM ) play important role in eigenvalue bounds.
10 Preconditioners Preconditioned system: Eigenvalues: λ S I S N x fˆ M y = gˆ 1 + ω 2 max 1 λ ω max S { 1, 1 5 / 2}, λ ( ± ) Further splitting gives fixed point iteration that depends only on x : ( ) x I NM Sx f = + k+ 1 k ( ) Solves related system I ( I NM) S x = f Eigenvalues ( ) 1 1 λ 1 ω R 2 2 max S
11 Preconditioners This approach is applicable to general problems; for details and analysis see ds&l 22. Eigenvalue bounds for general problems Regarding related system o Smaller system to solve o Good bounds on eigenvalues, single cluster o Shows bounds always better than for block diag. prec. o Satisfies constraints o Extends constraint preconditioners to general matrices and is more efficient (CPU and memory). CF B which may be expensive to compute and iterate with. 1 T Problem is that (this type of) iteration involves ( ) 1 In that case, we must look for alternatives.,
12 Invariance Property (also nonzero (2,2)) Aˆ T A B R 2 = RC 1, Preconditioner: F 1 1 T ( RCF B R ) I S N 1 T M, where N = F B R2 1 MN = R MNR = I,NM = NM 2 2 M = R CF B C 1 1 T and ( ) 1 (oblique) projection. This matrix has exactly the same eigenvalues (and bounds) as the original matrix with block diagonal preconditioner. Also leads to the same fixed point iteration/related system I I NM S x = I I NM S x = f ( ( ) ) ( ) ( ) 2
13 Surface Parameterization
14 Example: Texture Mapping
15 Angle-based Flattening Solve mesh flattening as constrained optimization problem. Minimize relative deformation of angles, ( ) 2 2 αij, φij, / φij,, Subject to constraints on valid 2D mesh 1. Angles between and π (orientation), hardly ever a problem (dealt with algorithmically) 2. Angles in triangle sum to π, 3. Angles around interior node sum to 2π, 4. Triangles at an interior node need to agree on edge lengths: nonlinear constraint. ( ) 2 αij, φij, φij, subject to T ( ) ( ) ( ) g2 α g3 α g4 α = ij, min / T Critical point of Lagrangian L( αλ, ) = F( α) + λ g( α) ij,
16 Nonlinear System Critical point of : L(, ) = F( ) + T g( ), L(, ) = Newton iteration: 2, L(, ) =, L(, ) Jacobian: 2 [F( ) + T g( )] [ g( )] T g( ) = A + G k B T T C k B C k (symmetric and indefinite) A = diag 2w i j and depends only on G k g ( 4) ( ) B depends only on g ( 2) ( ) and hence is constant (zero,one) C k depends on g ( 3) and g ( 4) and is partially constant ( g ( 3) )
17 Preconditioning Consider the following choice of blocks F Ek C Ck T k with F T A B = B and E k G k =. Explicit inverse of F known (very good splitting). I Sk Nk x f Mk y = g I I N M S x = f ( ) and ( ) k k k λ S 1 + ω 2 max 1 λ ω max S and ( ) 1 1 λ 1 ω R 2 2 max S
18 Scaling Constraints Scale constraints ( ) 3 g α and g ( ) 4 α by ε and precondition: I εsk εnk x f ε Mk y = ε g Block diagonal preconditioner: 1 1 Related system (after splitting): ε( ) I I N M S x = f ( ) k k k Eigenvalue bounds for the scaled system: Block diagonal preconditioner: Related ( ) 1 1 λ ε 1 ω R 2 2 max 1 + ω 2 max 1 λs λ 1.5ε 1 ω S max S Very fast convergence even for modest ε, (but Newton )
19 Convergence Three Balls GMRES convergence (no scaling) no prec right prec. B(S) (I-F)
20 Convergence Three Balls Computed r n / r = GMRES convergence with scaling = 1 =.1 = no prec right prec. B(S) (I-F)
21 Eigenvalues of B(S) = = =
22 Eigenvalues of Related System = = =
23 Preconditioners nonzero (2,2) First, we consider saddle-point problems with nonzero (2,2) block, such as stabilized finite element discretizations. Block-diagonal preconditioner from splitting (1,1) block T 1 F E B F 1 T 1 C D ( D CF B ) I S N x fˆ M Q = gˆ, Preconditioned system: ( y) where MN = I + Q and ( NM ) 2 = NM + NQM Further splitting leads to fixed point iteration and a smaller ( ) related system: I ( I NM) S x = f
24 Preconditioners nonzero (2,2) I S N Eigenvalues of B( S) = M Q? I N B () = 1 1 M Q 2 4 δ is an eigenvalue of Q and typically small. where j : λ 1, ( 1 + δ ) 1 ( 1 ) 2 j ± + + δj Let null( NM ) U1 and other eigenvectors NM U 2 = U2Θ Eigenvalues of B( S ) from perturbation of B ( ) : 1 + ω 2 max 1 λs λ 2γκ Θ 1 ω max S (typically γκ Θ modest) : ( )( ) 1 ( I ( I NM) S) 1 λ 1+ ω δ + ω δκ 1 ω R Θ max S
25 Approximating the Schur complement Replace Schur complement type matrix by approximation: F 1 1 SF by F 1 1 SF, where 1 S F is approximated directly Preconditioned system I S N M2 or I S N M2 Q 2 where N F B 1 T =, 2 ( ) ( E) M 1 = S C, MN= S S I+ E 1 2 F NM = N I + M = NM + NEM 2 F F , and Bounds: I S N I N S M2 Q = 2 M Q EM EQ
26 Approximating the Schur complement B( S, E) I S N I N S = M2 Q = 2 M Q EM EQ Eigenvalues of B( S,E) from perturbation of (, ) B : ω max λs, E λ γκ Θ S + γκ ˆ V E 1 ω max (typically γκ Θ and γκ ˆ V modest) When D = (and hence QQ, 2 = ) λ S, E 1 1 ω 2 max S 1 ω max 5 λ + E
27 Approximating the Schur complement Splitting as before leads to exactly the same related system. New splitting: I S N I N S M2 Q = 2 M2 M2N I E Linear system: I ( I NM ) E ( x ) 2 S N f MS 2 I E y = + g Eigenvalues cluster around ( E ) 1 λ R 1+ N 1+ M max S, We lose advantages of smaller system and satisfying the constraints.
28 Probing for the Schur Complement 1 T Approximate ( D CF B ) 1 1 T without having ( D CF B ) Probing (Chan&Mathew 92): reconstruct matrix with small bandwidth from products with selected vectors and invert. Based on rapid decay from diagonal in matrix (1D interface). 1 We use decay of F T on mesh with structure of CB,, D to select pattern of large coefficients in matrix to probe for Construct set of vectors to minimize lumping other coeff.s Cheap to use multiple orderings and combine inverses of matrices with small bandwidth (convergence not great) Better to approximate matrix structure for multidimensional problem directly and use incomplete decomposition
29 Oseen problem, driven cavity Software by Elman, Silvester, Wathen, Ramage System (A nonsymmetric): T A B x f B βc y = g viscosity ν=1/1 and stabilization β=1/4
30 Basic Splittings of (1,1) Block.6.4 Unpreconditioned Diagonal Prec. Tridiagonal Prec..2 Imag Real
31 Oseen problem Not constrained to structured splittings A=F-E Multigrid cycle is a (complicated) splitting Use number of V-cycles for F -1. Useful because we can study convergence and eigenvalue (bounds) for sequence of problems with decreasing S. Likewise, we can analyze the effect of approximations to the Schur complement (not as easy)
32 1 V-cycle, Related System: Eigenvalues
33 2 V-cycles, Related System: Eigenvalues
34 4 V-cycles, Related System: Eigenvalues
35 6 V-cycles, Related System: Eigenvalues
36 Exact Schur Complement Convergence for block-diagonal preconditioner for various numbers of V-cycles for the splitting V Cycle 2 V Cycles 3 V Cycles 4 V Cycles 5 V Cycles 6 V Cycles 1 4 r k / r Iteration
37 Inexact Schur Complement - ILU(1.e-4) Convergence for block-diagonal preconditioner for various numbers of V-cycles for the splitting V Cycle 2 V Cycles 3 V Cycles 4 V Cycles 5 V Cycles 6 V Cycles 1 4 r k / r Iteration
38 Exact Schur Complement Convergence for related system using various numbers of V-cycles for the splitting V Cycle 2 V Cycles 3 V Cycles 4 V Cycles 5 V Cycles 6 V Cycles 1 4 r k / r Iteration
39 Inexact Schur Complement - ILU(1.e-4) Convergence for related system using various numbers of V-cycles for the splitting V Cycle 2 V Cycles 3 V Cycles 4 V Cycles 5 V Cycles 6 V Cycles 1 4 r k / r Iteration
40 Exact Schur Complement Eigenvalue perturbations and bounds for block-diagonal preconditioner using various numbers of V-Cycles for splitting
41 Exact Schur Complement Eigenvalue perturbations and bounds for related system using various numbers of V-Cycles for splitting without κ ( Θ)
42 Inexact Schur Complement ILU Convergence for block-diagonal preconditioner using various accuracies for Schur Complement ILU ILU(1e 3) ILU(1e 4) ILU(1e 5) ILU(1e 6) 1 4 r k / r Iteration
43 Inexact Schur Complement - ILU Convergence for related system using various accuracies for Schur Complement ILU ILU(1e 3) ILU(1e 4) ILU(1e 5) ILU(1e 6) 1 4 r k / r Iteration
A Robust Preconditioned Iterative Method for the Navier-Stokes Equations with High Reynolds Numbers
Applied and Computational Mathematics 2017; 6(4): 202-207 http://www.sciencepublishinggroup.com/j/acm doi: 10.11648/j.acm.20170604.18 ISSN: 2328-5605 (Print); ISSN: 2328-5613 (Online) A Robust Preconditioned
More informationFast Iterative Solution of Saddle Point Problems
Michele Benzi Department of Mathematics and Computer Science Emory University Atlanta, GA Acknowledgments NSF (Computational Mathematics) Maxim Olshanskii (Mech-Math, Moscow State U.) Zhen Wang (PhD student,
More informationPreconditioners for the incompressible Navier Stokes equations
Preconditioners for the incompressible Navier Stokes equations C. Vuik M. ur Rehman A. Segal Delft Institute of Applied Mathematics, TU Delft, The Netherlands SIAM Conference on Computational Science and
More informationEfficient Augmented Lagrangian-type Preconditioning for the Oseen Problem using Grad-Div Stabilization
Efficient Augmented Lagrangian-type Preconditioning for the Oseen Problem using Grad-Div Stabilization Timo Heister, Texas A&M University 2013-02-28 SIAM CSE 2 Setting Stationary, incompressible flow problems
More informationAn advanced ILU preconditioner for the incompressible Navier-Stokes equations
An advanced ILU preconditioner for the incompressible Navier-Stokes equations M. ur Rehman C. Vuik A. Segal Delft Institute of Applied Mathematics, TU delft The Netherlands Computational Methods with Applications,
More informationEfficient Solvers for the Navier Stokes Equations in Rotation Form
Efficient Solvers for the Navier Stokes Equations in Rotation Form Computer Research Institute Seminar Purdue University March 4, 2005 Michele Benzi Emory University Atlanta, GA Thanks to: NSF (MPS/Computational
More informationBLOCK-DIAGONAL AND CONSTRAINT PRECONDITIONERS FOR NONSYMMETRIC INDEFINITE LINEAR SYSTEMS. PART I: THEORY
SIAM J. SCI. COMPUT. Vol. 26, No. 5, pp. 1598 1619 c 25 Society for Industrial and Applied Mathematics BLOCK-DIAGONAL AND CONSTRAINT PRECONDITIONERS FOR NONSYMMETRIC INDEFINITE LINEAR SYSTEMS. PART I:
More informationNumerical behavior of inexact linear solvers
Numerical behavior of inexact linear solvers Miro Rozložník joint results with Zhong-zhi Bai and Pavel Jiránek Institute of Computer Science, Czech Academy of Sciences, Prague, Czech Republic The fourth
More informationLinear Solvers. Andrew Hazel
Linear Solvers Andrew Hazel Introduction Thus far we have talked about the formulation and discretisation of physical problems...... and stopped when we got to a discrete linear system of equations. Introduction
More informationOn the accuracy of saddle point solvers
On the accuracy of saddle point solvers Miro Rozložník joint results with Valeria Simoncini and Pavel Jiránek Institute of Computer Science, Czech Academy of Sciences, Prague, Czech Republic Seminar at
More informationAMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 23: GMRES and Other Krylov Subspace Methods; Preconditioning
AMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 23: GMRES and Other Krylov Subspace Methods; Preconditioning Xiangmin Jiao SUNY Stony Brook Xiangmin Jiao Numerical Analysis I 1 / 18 Outline
More informationA Review of Preconditioning Techniques for Steady Incompressible Flow
Zeist 2009 p. 1/43 A Review of Preconditioning Techniques for Steady Incompressible Flow David Silvester School of Mathematics University of Manchester Zeist 2009 p. 2/43 PDEs Review : 1984 2005 Update
More informationON A GENERAL CLASS OF PRECONDITIONERS FOR NONSYMMETRIC GENERALIZED SADDLE POINT PROBLEMS
U..B. Sci. Bull., Series A, Vol. 78, Iss. 4, 06 ISSN 3-707 ON A GENERAL CLASS OF RECONDIIONERS FOR NONSYMMERIC GENERALIZED SADDLE OIN ROBLE Fatemeh anjeh Ali BEIK his paper deals with applying a class
More informationFast solvers for steady incompressible flow
ICFD 25 p.1/21 Fast solvers for steady incompressible flow Andy Wathen Oxford University wathen@comlab.ox.ac.uk http://web.comlab.ox.ac.uk/~wathen/ Joint work with: Howard Elman (University of Maryland,
More informationAdaptive preconditioners for nonlinear systems of equations
Adaptive preconditioners for nonlinear systems of equations L. Loghin D. Ruiz A. Touhami CERFACS Technical Report TR/PA/04/42 Also ENSEEIHT-IRIT Technical Report RT/TLSE/04/02 Abstract The use of preconditioned
More informationM.A. Botchev. September 5, 2014
Rome-Moscow school of Matrix Methods and Applied Linear Algebra 2014 A short introduction to Krylov subspaces for linear systems, matrix functions and inexact Newton methods. Plan and exercises. M.A. Botchev
More informationChebyshev semi-iteration in Preconditioning
Report no. 08/14 Chebyshev semi-iteration in Preconditioning Andrew J. Wathen Oxford University Computing Laboratory Tyrone Rees Oxford University Computing Laboratory Dedicated to Victor Pereyra on his
More informationMathematics and Computer Science
Technical Report TR-2007-002 Block preconditioning for saddle point systems with indefinite (1,1) block by Michele Benzi, Jia Liu Mathematics and Computer Science EMORY UNIVERSITY International Journal
More informationFinding Rightmost Eigenvalues of Large, Sparse, Nonsymmetric Parameterized Eigenvalue Problems
Finding Rightmost Eigenvalues of Large, Sparse, Nonsymmetric Parameterized Eigenvalue Problems AMSC 663-664 Final Report Minghao Wu AMSC Program mwu@math.umd.edu Dr. Howard Elman Department of Computer
More informationON THE ROLE OF COMMUTATOR ARGUMENTS IN THE DEVELOPMENT OF PARAMETER-ROBUST PRECONDITIONERS FOR STOKES CONTROL PROBLEMS
ON THE ROLE OF COUTATOR ARGUENTS IN THE DEVELOPENT OF PARAETER-ROBUST PRECONDITIONERS FOR STOKES CONTROL PROBLES JOHN W. PEARSON Abstract. The development of preconditioners for PDE-constrained optimization
More informationFEM and sparse linear system solving
FEM & sparse linear system solving, Lecture 9, Nov 19, 2017 1/36 Lecture 9, Nov 17, 2017: Krylov space methods http://people.inf.ethz.ch/arbenz/fem17 Peter Arbenz Computer Science Department, ETH Zürich
More informationON THE GENERALIZED DETERIORATED POSITIVE SEMI-DEFINITE AND SKEW-HERMITIAN SPLITTING PRECONDITIONER *
Journal of Computational Mathematics Vol.xx, No.x, 2x, 6. http://www.global-sci.org/jcm doi:?? ON THE GENERALIZED DETERIORATED POSITIVE SEMI-DEFINITE AND SKEW-HERMITIAN SPLITTING PRECONDITIONER * Davod
More informationThe antitriangular factorisation of saddle point matrices
The antitriangular factorisation of saddle point matrices J. Pestana and A. J. Wathen August 29, 2013 Abstract Mastronardi and Van Dooren [this journal, 34 (2013) pp. 173 196] recently introduced the block
More informationMultigrid absolute value preconditioning
Multigrid absolute value preconditioning Eugene Vecharynski 1 Andrew Knyazev 2 (speaker) 1 Department of Computer Science and Engineering University of Minnesota 2 Department of Mathematical and Statistical
More informationStructured Preconditioners for Saddle Point Problems
Structured Preconditioners for Saddle Point Problems V. Simoncini Dipartimento di Matematica Università di Bologna valeria@dm.unibo.it p. 1 Collaborators on this project Mario Arioli, RAL, UK Michele Benzi,
More informationAn Efficient Low Memory Implicit DG Algorithm for Time Dependent Problems
An Efficient Low Memory Implicit DG Algorithm for Time Dependent Problems P.-O. Persson and J. Peraire Massachusetts Institute of Technology 2006 AIAA Aerospace Sciences Meeting, Reno, Nevada January 9,
More informationA comparison of preconditioners for incompressible Navier Stokes solvers
INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN FLUIDS Int. J. Numer. Meth. Fluids (2007) Published online in Wiley InterScience (www.interscience.wiley.com)..1684 A comparison of preconditioners for incompressible
More information9.1 Preconditioned Krylov Subspace Methods
Chapter 9 PRECONDITIONING 9.1 Preconditioned Krylov Subspace Methods 9.2 Preconditioned Conjugate Gradient 9.3 Preconditioned Generalized Minimal Residual 9.4 Relaxation Method Preconditioners 9.5 Incomplete
More informationIterative Methods and Multigrid
Iterative Methods and Multigrid Part 3: Preconditioning 2 Eric de Sturler Preconditioning The general idea behind preconditioning is that convergence of some method for the linear system Ax = b can be
More informationSolving Symmetric Indefinite Systems with Symmetric Positive Definite Preconditioners
Solving Symmetric Indefinite Systems with Symmetric Positive Definite Preconditioners Eugene Vecharynski 1 Andrew Knyazev 2 1 Department of Computer Science and Engineering University of Minnesota 2 Department
More informationIterative solvers for saddle point algebraic linear systems: tools of the trade. V. Simoncini
Iterative solvers for saddle point algebraic linear systems: tools of the trade V. Simoncini Dipartimento di Matematica, Università di Bologna and CIRSA, Ravenna, Italy valeria@dm.unibo.it 1 The problem
More informationPreface to the Second Edition. Preface to the First Edition
n page v Preface to the Second Edition Preface to the First Edition xiii xvii 1 Background in Linear Algebra 1 1.1 Matrices................................. 1 1.2 Square Matrices and Eigenvalues....................
More informationOUTLINE ffl CFD: elliptic pde's! Ax = b ffl Basic iterative methods ffl Krylov subspace methods ffl Preconditioning techniques: Iterative methods ILU
Preconditioning Techniques for Solving Large Sparse Linear Systems Arnold Reusken Institut für Geometrie und Praktische Mathematik RWTH-Aachen OUTLINE ffl CFD: elliptic pde's! Ax = b ffl Basic iterative
More informationDELFT UNIVERSITY OF TECHNOLOGY
DELFT UNIVERSITY OF TECHNOLOGY REPORT 13-10 Comparison of some preconditioners for the incompressible Navier-Stokes equations X. He and C. Vuik ISSN 1389-6520 Reports of the Delft Institute of Applied
More informationKey words. inf-sup constant, iterative solvers, preconditioning, saddle point problems
NATURAL PRECONDITIONING AND ITERATIVE METHODS FOR SADDLE POINT SYSTEMS JENNIFER PESTANA AND ANDREW J. WATHEN Abstract. The solution of quadratic or locally quadratic extremum problems subject to linear(ized)
More informationIndefinite Preconditioners for PDE-constrained optimization problems. V. Simoncini
Indefinite Preconditioners for PDE-constrained optimization problems V. Simoncini Dipartimento di Matematica, Università di Bologna, Italy valeria.simoncini@unibo.it Partly joint work with Debora Sesana,
More informationSolving Large Nonlinear Sparse Systems
Solving Large Nonlinear Sparse Systems Fred W. Wubs and Jonas Thies Computational Mechanics & Numerical Mathematics University of Groningen, the Netherlands f.w.wubs@rug.nl Centre for Interdisciplinary
More informationCombination Preconditioning of saddle-point systems for positive definiteness
Combination Preconditioning of saddle-point systems for positive definiteness Andy Wathen Oxford University, UK joint work with Jen Pestana Eindhoven, 2012 p.1/30 compute iterates with residuals Krylov
More informationEfficient iterative algorithms for linear stability analysis of incompressible flows
IMA Journal of Numerical Analysis Advance Access published February 27, 215 IMA Journal of Numerical Analysis (215) Page 1 of 21 doi:1.193/imanum/drv3 Efficient iterative algorithms for linear stability
More informationRecent advances in approximation using Krylov subspaces. V. Simoncini. Dipartimento di Matematica, Università di Bologna.
Recent advances in approximation using Krylov subspaces V. Simoncini Dipartimento di Matematica, Università di Bologna and CIRSA, Ravenna, Italy valeria@dm.unibo.it 1 The framework It is given an operator
More informationJournal of Computational and Applied Mathematics. Optimization of the parameterized Uzawa preconditioners for saddle point matrices
Journal of Computational Applied Mathematics 6 (009) 136 154 Contents lists available at ScienceDirect Journal of Computational Applied Mathematics journal homepage: wwwelseviercom/locate/cam Optimization
More informationOn solving linear systems arising from Shishkin mesh discretizations
On solving linear systems arising from Shishkin mesh discretizations Petr Tichý Faculty of Mathematics and Physics, Charles University joint work with Carlos Echeverría, Jörg Liesen, and Daniel Szyld October
More informationBlock triangular preconditioner for static Maxwell equations*
Volume 3, N. 3, pp. 589 61, 11 Copyright 11 SBMAC ISSN 11-85 www.scielo.br/cam Block triangular preconditioner for static Maxwell equations* SHI-LIANG WU 1, TING-ZHU HUANG and LIANG LI 1 School of Mathematics
More informationStructured Preconditioners for Saddle Point Problems
Structured Preconditioners for Saddle Point Problems V. Simoncini Dipartimento di Matematica Università di Bologna valeria@dm.unibo.it. p.1/16 Collaborators on this project Mario Arioli, RAL, UK Michele
More informationSome Preconditioning Techniques for Saddle Point Problems
Some Preconditioning Techniques for Saddle Point Problems Michele Benzi 1 and Andrew J. Wathen 2 1 Department of Mathematics and Computer Science, Emory University, Atlanta, Georgia 30322, USA. benzi@mathcs.emory.edu
More informationOn the Superlinear Convergence of MINRES. Valeria Simoncini and Daniel B. Szyld. Report January 2012
On the Superlinear Convergence of MINRES Valeria Simoncini and Daniel B. Szyld Report 12-01-11 January 2012 This report is available in the World Wide Web at http://www.math.temple.edu/~szyld 0 Chapter
More informationSynopsis of Numerical Linear Algebra
Synopsis of Numerical Linear Algebra Eric de Sturler Department of Mathematics, Virginia Tech sturler@vt.edu http://www.math.vt.edu/people/sturler Iterative Methods for Linear Systems: Basics to Research
More informationc 2004 Society for Industrial and Applied Mathematics
SIAM J. MATRIX ANAL. APPL. Vol. 6, No., pp. 377 389 c 004 Society for Industrial and Applied Mathematics SPECTRAL PROPERTIES OF THE HERMITIAN AND SKEW-HERMITIAN SPLITTING PRECONDITIONER FOR SADDLE POINT
More informationBoundary Value Problems - Solving 3-D Finite-Difference problems Jacob White
Introduction to Simulation - Lecture 2 Boundary Value Problems - Solving 3-D Finite-Difference problems Jacob White Thanks to Deepak Ramaswamy, Michal Rewienski, and Karen Veroy Outline Reminder about
More informationIndefinite and physics-based preconditioning
Indefinite and physics-based preconditioning Jed Brown VAW, ETH Zürich 2009-01-29 Newton iteration Standard form of a nonlinear system F (u) 0 Iteration Solve: Update: J(ũ)u F (ũ) ũ + ũ + u Example (p-bratu)
More information7.4 The Saddle Point Stokes Problem
346 CHAPTER 7. APPLIED FOURIER ANALYSIS 7.4 The Saddle Point Stokes Problem So far the matrix C has been diagonal no trouble to invert. This section jumps to a fluid flow problem that is still linear (simpler
More informationAccelerated Solvers for CFD
Accelerated Solvers for CFD Co-Design of Hardware/Software for Predicting MAV Aerodynamics Eric de Sturler, Virginia Tech Mathematics Email: sturler@vt.edu Web: http://www.math.vt.edu/people/sturler Co-design
More information20. A Dual-Primal FETI Method for solving Stokes/Navier-Stokes Equations
Fourteenth International Conference on Domain Decomposition Methods Editors: Ismael Herrera, David E. Keyes, Olof B. Widlund, Robert Yates c 23 DDM.org 2. A Dual-Primal FEI Method for solving Stokes/Navier-Stokes
More informationLecture 3: Inexact inverse iteration with preconditioning
Lecture 3: Department of Mathematical Sciences CLAPDE, Durham, July 2008 Joint work with M. Freitag (Bath), and M. Robbé & M. Sadkane (Brest) 1 Introduction 2 Preconditioned GMRES for Inverse Power Method
More informationStabilization and Acceleration of Algebraic Multigrid Method
Stabilization and Acceleration of Algebraic Multigrid Method Recursive Projection Algorithm A. Jemcov J.P. Maruszewski Fluent Inc. October 24, 2006 Outline 1 Need for Algorithm Stabilization and Acceleration
More informationWHEN studying distributed simulations of power systems,
1096 IEEE TRANSACTIONS ON POWER SYSTEMS, VOL 21, NO 3, AUGUST 2006 A Jacobian-Free Newton-GMRES(m) Method with Adaptive Preconditioner and Its Application for Power Flow Calculations Ying Chen and Chen
More informationOn the choice of abstract projection vectors for second level preconditioners
On the choice of abstract projection vectors for second level preconditioners C. Vuik 1, J.M. Tang 1, and R. Nabben 2 1 Delft University of Technology 2 Technische Universität Berlin Institut für Mathematik
More informationBLOCK ILU PRECONDITIONED ITERATIVE METHODS FOR REDUCED LINEAR SYSTEMS
CANADIAN APPLIED MATHEMATICS QUARTERLY Volume 12, Number 3, Fall 2004 BLOCK ILU PRECONDITIONED ITERATIVE METHODS FOR REDUCED LINEAR SYSTEMS N GUESSOUS AND O SOUHAR ABSTRACT This paper deals with the iterative
More informationChapter 7 Iterative Techniques in Matrix Algebra
Chapter 7 Iterative Techniques in Matrix Algebra Per-Olof Persson persson@berkeley.edu Department of Mathematics University of California, Berkeley Math 128B Numerical Analysis Vector Norms Definition
More informationON AUGMENTED LAGRANGIAN METHODS FOR SADDLE-POINT LINEAR SYSTEMS WITH SINGULAR OR SEMIDEFINITE (1,1) BLOCKS * 1. Introduction
Journal of Computational Mathematics Vol.xx, No.x, 200x, 1 9. http://www.global-sci.org/jcm doi:10.4208/jcm.1401-cr7 ON AUGMENED LAGRANGIAN MEHODS FOR SADDLE-POIN LINEAR SYSEMS WIH SINGULAR OR SEMIDEFINIE
More informationThe Lanczos and conjugate gradient algorithms
The Lanczos and conjugate gradient algorithms Gérard MEURANT October, 2008 1 The Lanczos algorithm 2 The Lanczos algorithm in finite precision 3 The nonsymmetric Lanczos algorithm 4 The Golub Kahan bidiagonalization
More informationThe Nullspace free eigenvalue problem and the inexact Shift and invert Lanczos method. V. Simoncini. Dipartimento di Matematica, Università di Bologna
The Nullspace free eigenvalue problem and the inexact Shift and invert Lanczos method V. Simoncini Dipartimento di Matematica, Università di Bologna and CIRSA, Ravenna, Italy valeria@dm.unibo.it 1 The
More informationarxiv: v1 [math.na] 26 Dec 2013
General constraint preconditioning iteration method for singular saddle-point problems Ai-Li Yang a,, Guo-Feng Zhang a, Yu-Jiang Wu a,b a School of Mathematics and Statistics, Lanzhou University, Lanzhou
More informationPreconditioning for Nonsymmetry and Time-dependence
Preconditioning for Nonsymmetry and Time-dependence Andy Wathen Oxford University, UK joint work with Jen Pestana and Elle McDonald Jeju, Korea, 2015 p.1/24 Iterative methods For self-adjoint problems/symmetric
More informationIterative Linear Solvers and Jacobian-free Newton-Krylov Methods
Eric de Sturler Iterative Linear Solvers and Jacobian-free Newton-Krylov Methods Eric de Sturler Departent of Matheatics, Virginia Tech www.ath.vt.edu/people/sturler/index.htl sturler@vt.edu Efficient
More informationRegularized HSS iteration methods for saddle-point linear systems
BIT Numer Math DOI 10.1007/s10543-016-0636-7 Regularized HSS iteration methods for saddle-point linear systems Zhong-Zhi Bai 1 Michele Benzi 2 Received: 29 January 2016 / Accepted: 20 October 2016 Springer
More information1. Introduction. We consider the solution of systems of linear equations with the following block 2 2 structure:
SIAM J. MATRIX ANAL. APPL. Vol. 26, No. 1, pp. 20 41 c 2004 Society for Industrial and Applied Mathematics A PRECONDITIONER FOR GENERALIZED SADDLE POINT PROBLEMS MICHELE BENZI AND GENE H. GOLUB Abstract.
More informationInexactness and flexibility in linear Krylov solvers
Inexactness and flexibility in linear Krylov solvers Luc Giraud ENSEEIHT (N7) - IRIT, Toulouse Matrix Analysis and Applications CIRM Luminy - October 15-19, 2007 in honor of Gérard Meurant for his 60 th
More informationAlgebraic Multigrid as Solvers and as Preconditioner
Ò Algebraic Multigrid as Solvers and as Preconditioner Domenico Lahaye domenico.lahaye@cs.kuleuven.ac.be http://www.cs.kuleuven.ac.be/ domenico/ Department of Computer Science Katholieke Universiteit Leuven
More informationANALYSIS OF AUGMENTED LAGRANGIAN-BASED PRECONDITIONERS FOR THE STEADY INCOMPRESSIBLE NAVIER-STOKES EQUATIONS
ANALYSIS OF AUGMENTED LAGRANGIAN-BASED PRECONDITIONERS FOR THE STEADY INCOMPRESSIBLE NAVIER-STOKES EQUATIONS MICHELE BENZI AND ZHEN WANG Abstract. We analyze a class of modified augmented Lagrangian-based
More informationIterative Methods and Multigrid
Iterative Methods and Multigrid Part 1: Introduction to Multigrid 2000 Eric de Sturler 1 12/02/09 MG01.prz Basic Iterative Methods (1) Nonlinear equation: f(x) = 0 Rewrite as x = F(x), and iterate x i+1
More informationContents. Preface... xi. Introduction...
Contents Preface... xi Introduction... xv Chapter 1. Computer Architectures... 1 1.1. Different types of parallelism... 1 1.1.1. Overlap, concurrency and parallelism... 1 1.1.2. Temporal and spatial parallelism
More informationIterative Methods for Sparse Linear Systems
Iterative Methods for Sparse Linear Systems Luca Bergamaschi e-mail: berga@dmsa.unipd.it - http://www.dmsa.unipd.it/ berga Department of Mathematical Methods and Models for Scientific Applications University
More informationIterative methods for Linear System of Equations. Joint Advanced Student School (JASS-2009)
Iterative methods for Linear System of Equations Joint Advanced Student School (JASS-2009) Course #2: Numerical Simulation - from Models to Software Introduction In numerical simulation, Partial Differential
More informationITERATIVE METHODS FOR SPARSE LINEAR SYSTEMS
ITERATIVE METHODS FOR SPARSE LINEAR SYSTEMS YOUSEF SAAD University of Minnesota PWS PUBLISHING COMPANY I(T)P An International Thomson Publishing Company BOSTON ALBANY BONN CINCINNATI DETROIT LONDON MADRID
More information6.4 Krylov Subspaces and Conjugate Gradients
6.4 Krylov Subspaces and Conjugate Gradients Our original equation is Ax = b. The preconditioned equation is P Ax = P b. When we write P, we never intend that an inverse will be explicitly computed. P
More informationBlock preconditioners for saddle point systems arising from liquid crystal directors modeling
Noname manuscript No. (will be inserted by the editor) Block preconditioners for saddle point systems arising from liquid crystal directors modeling Fatemeh Panjeh Ali Beik Michele Benzi Received: date
More informationFINDING RIGHTMOST EIGENVALUES OF LARGE SPARSE NONSYMMETRIC PARAMETERIZED EIGENVALUE PROBLEMS
FINDING RIGHTMOST EIGENVALUES OF LARGE SPARSE NONSYMMETRIC PARAMETERIZED EIGENVALUE PROBLEMS Department of Mathematics University of Maryland, College Park Advisor: Dr. Howard Elman Department of Computer
More informationON ORTHOGONAL REDUCTION TO HESSENBERG FORM WITH SMALL BANDWIDTH
ON ORTHOGONAL REDUCTION TO HESSENBERG FORM WITH SMALL BANDWIDTH V. FABER, J. LIESEN, AND P. TICHÝ Abstract. Numerous algorithms in numerical linear algebra are based on the reduction of a given matrix
More informationIN this paper, we investigate spectral properties of block
On the Eigenvalues Distribution of Preconditioned Block wo-by-two Matrix Mu-Zheng Zhu and a-e Qi Abstract he spectral properties of a class of block matrix are studied, which arise in the numercial solutions
More information4.8 Arnoldi Iteration, Krylov Subspaces and GMRES
48 Arnoldi Iteration, Krylov Subspaces and GMRES We start with the problem of using a similarity transformation to convert an n n matrix A to upper Hessenberg form H, ie, A = QHQ, (30) with an appropriate
More informationLinear algebra issues in Interior Point methods for bound-constrained least-squares problems
Linear algebra issues in Interior Point methods for bound-constrained least-squares problems Stefania Bellavia Dipartimento di Energetica S. Stecco Università degli Studi di Firenze Joint work with Jacek
More informationA robust multilevel approximate inverse preconditioner for symmetric positive definite matrices
DICEA DEPARTMENT OF CIVIL, ENVIRONMENTAL AND ARCHITECTURAL ENGINEERING PhD SCHOOL CIVIL AND ENVIRONMENTAL ENGINEERING SCIENCES XXX CYCLE A robust multilevel approximate inverse preconditioner for symmetric
More informationSolving Ax = b, an overview. Program
Numerical Linear Algebra Improving iterative solvers: preconditioning, deflation, numerical software and parallelisation Gerard Sleijpen and Martin van Gijzen November 29, 27 Solving Ax = b, an overview
More informationDIAGONALIZATION. In order to see the implications of this definition, let us consider the following example Example 1. Consider the matrix
DIAGONALIZATION Definition We say that a matrix A of size n n is diagonalizable if there is a basis of R n consisting of eigenvectors of A ie if there are n linearly independent vectors v v n such that
More informationA Chebyshev-based two-stage iterative method as an alternative to the direct solution of linear systems
A Chebyshev-based two-stage iterative method as an alternative to the direct solution of linear systems Mario Arioli m.arioli@rl.ac.uk CCLRC-Rutherford Appleton Laboratory with Daniel Ruiz (E.N.S.E.E.I.H.T)
More informationPreconditioning of Saddle Point Systems by Substructuring and a Penalty Approach
Preconditioning of Saddle Point Systems by Substructuring and a Penalty Approach Clark R. Dohrmann 1 Sandia National Laboratories, crdohrm@sandia.gov. Sandia is a multiprogram laboratory operated by Sandia
More informationNested Krylov methods for shifted linear systems
Nested Krylov methods for shifted linear systems M. Baumann, and M. B. van Gizen Email: M.M.Baumann@tudelft.nl Delft Institute of Applied Mathematics Delft University of Technology Delft, The Netherlands
More informationIntroduction to Iterative Solvers of Linear Systems
Introduction to Iterative Solvers of Linear Systems SFB Training Event January 2012 Prof. Dr. Andreas Frommer Typeset by Lukas Krämer, Simon-Wolfgang Mages and Rudolf Rödl 1 Classes of Matrices and their
More informationIterative methods for Linear System
Iterative methods for Linear System JASS 2009 Student: Rishi Patil Advisor: Prof. Thomas Huckle Outline Basics: Matrices and their properties Eigenvalues, Condition Number Iterative Methods Direct and
More informationComparing iterative methods to compute the overlap Dirac operator at nonzero chemical potential
Comparing iterative methods to compute the overlap Dirac operator at nonzero chemical potential, Tobias Breu, and Tilo Wettig Institute for Theoretical Physics, University of Regensburg, 93040 Regensburg,
More informationPrince Chidyagwai, Scott Ladenheim, and Daniel B. Szyld. Report July 2015
CONSTRAINT PRECONDITIONING FOR THE COUPLED STOKES-DARCY SYSTEM Prince Chidyagwai, Scott Ladenheim, and Daniel B. Szyld Report 5-07-9 July 05 This is a report of the Department of Mathematics at Temple
More informationScientific Computing with Case Studies SIAM Press, Lecture Notes for Unit VII Sparse Matrix
Scientific Computing with Case Studies SIAM Press, 2009 http://www.cs.umd.edu/users/oleary/sccswebpage Lecture Notes for Unit VII Sparse Matrix Computations Part 1: Direct Methods Dianne P. O Leary c 2008
More informationIterative methods for positive definite linear systems with a complex shift
Iterative methods for positive definite linear systems with a complex shift William McLean, University of New South Wales Vidar Thomée, Chalmers University November 4, 2011 Outline 1. Numerical solution
More informationPrince Chidyagwai, Scott Ladenheim, and Daniel B. Szyld. Report July 2015, Revised October 2015
CONSTRAINT PRECONDITIONING FOR THE COUPLED STOKES-DARCY SYSTEM Prince Chidyagwai, Scott Ladenheim, and Daniel B. Szyld Report 5-07-9 July 05, Revised October 05 This is a report of the Department of Mathematics
More informationStructure preserving preconditioner for the incompressible Navier-Stokes equations
Structure preserving preconditioner for the incompressible Navier-Stokes equations Fred W. Wubs and Jonas Thies Computational Mechanics & Numerical Mathematics University of Groningen, the Netherlands
More informationThe solution of the discretized incompressible Navier-Stokes equations with iterative methods
The solution of the discretized incompressible Navier-Stokes equations with iterative methods Report 93-54 C. Vuik Technische Universiteit Delft Delft University of Technology Faculteit der Technische
More informationPreconditioned GMRES Revisited
Preconditioned GMRES Revisited Roland Herzog Kirk Soodhalter UBC (visiting) RICAM Linz Preconditioning Conference 2017 Vancouver August 01, 2017 Preconditioned GMRES Revisited Vancouver 1 / 32 Table of
More informationMaster Thesis Literature Study Presentation
Master Thesis Literature Study Presentation Delft University of Technology The Faculty of Electrical Engineering, Mathematics and Computer Science January 29, 2010 Plaxis Introduction Plaxis Finite Element
More informationNumerical Methods in Matrix Computations
Ake Bjorck Numerical Methods in Matrix Computations Springer Contents 1 Direct Methods for Linear Systems 1 1.1 Elements of Matrix Theory 1 1.1.1 Matrix Algebra 2 1.1.2 Vector Spaces 6 1.1.3 Submatrices
More information