Structured Preconditioners for Saddle Point Problems
|
|
- Pearl Harper
- 5 years ago
- Views:
Transcription
1 Structured Preconditioners for Saddle Point Problems V. Simoncini Dipartimento di Matematica Università di Bologna p.1/16
2 Collaborators on this project Mario Arioli, RAL, UK Michele Benzi, Emory University (GA) Ilaria Perugia, Università di Pavia Miro Rozloznik, Institute of Computer Science, Academy of Science, Prague. p.2/16
3 Motivational Application Constrained minimization problem subject to Bu = g minimize J(u) = 1 Au, u f, u 2 A n n symmetric, B m n, m n Lagrange multipliers approach Karush-Kuhn-Tucker (KKT) system. p.3/16
4 Application problems Computational Fluid Dynamics Elasticity problems Mixed (FE) formulations of II and IV order elliptic PDEs Linearly Constrained Programs Linear Regression in Statistics Weighted Least Squares (Image restoration).... p.4/16
5 The algebraic Saddle Point Problem A B 0 BT u v = f g A sym. pos.semidef., B full rank. p.5/16
6 The algebraic Saddle Point Problem A B BT C u v = f g A sym. pos.semidef., B full rank A sym. pos.semidef., B rank defic., C sym. [semi]def.. p.5/16
7 The algebraic Saddle Point Problem A B BT C u v = f g A sym. pos.semidef., B full rank A sym. pos.semidef., B rank defic., C sym. [semi]def. A nonsym., B and C as above. p.5/16
8 The algebraic Saddle Point Problem A B BT C u v = f g A sym. pos.semidef., B full rank A sym. pos.semidef., B rank defic., C sym. [semi]def. A nonsym., B and C as above A sym, Mx = b M sym. indef. With n positive and m negative real eigenvalues. p.5/16
9 Typical Sparsity pattern (3D problem) nz = 768. p.6/16
10 Spectral properties M = A B 0 BT 0 < λ n λ 1 eigs of A 0 < σ m σ 1 sing. vals of B. p.7/16
11 Spectral properties M = A B 0 BT 0 < λ n λ 1 eigs of A 0 < σ m σ 1 sing. vals of B (Rusten & Winther 1992) Λ(M) subset of» q 1 2 (λ n λ 2 n + 4σ2 1 ),, 1 2 (λ 1 qλ σ2 m )» λ n, 1 2 (λ 1 + qλ σ2 m ). p.7/16
12 Spectral properties M = A B BT C 0 < λ n λ 1 eigs of A 0 < σ m σ 1 sing. vals of B (Rusten & Winther 1992) Λ(M) subset of» q 1 2 (λ n λ 2 n + 4σ2 1 ), 1 2 (λ 1 qλ σ2 m )» λ n, 1 2 (λ 1 + qλ σ2 m ) (Silvester & Wathen 1994), 0 σ m σ 1 λ n λ max (C) q (λ n + λ max (C)) 2 + 4σ 2 1. p.7/16
13 Spectral properties M = A B BT C 0 < λ n λ 1 eigs of A 0 < σ m σ 1 sing. vals of B (Rusten & Winther 1992) Λ(M) subset of» q 1 2 (λ n λ 2 n + 4σ2 1 ),, 1 2 (λ 1 qλ σ2 m )» λ n, 1 2 (λ 1 + qλ σ2 m ) (Silvester & Wathen 1994), 0 σ m σ 1 λ n λ max (C) q (λ n + λ max (C)) 2 + 4σ 2 1 More results for special cases (e.g. Perugia & S. 2000). p.7/16
14 General preconditioning strategy Find P such that MP 1 û = b û = Pu is easier (faster) to solve than Mu = b. p.8/16
15 General preconditioning strategy Find P such that MP 1 û = b û = Pu is easier (faster) to solve than Mu = b A look at efficiency: - Dealing with P should be cheap - Storage for P should be low - Properties (algebraic/functional) exploited. p.8/16
16 Structure preserving preconditioning Idealized case:. p.9/16
17 Structure preserving preconditioning Idealized case: A nonsing., C = 0: P = A 0 0 B T A 1 B MP 1 eigs 1, 1 2 ± 5 2 MINRES converges in at most 3 iterations (Murphy, Golub & Wathen, 2002). p.9/16
18 Structure preserving preconditioning Idealized case: A nonsing., C = 0: P = A 0 0 B T A 1 B MP 1 eigs 1, 1 2 ± 5 2 MINRES converges in at most 3 iterations (Murphy, Golub & Wathen, 2002) A nonsing., C 0: P = A B 0 B T A 1 B + C MP 1 = I 0 B T A 1 I GMRES converges in at most 2 iterations. p.9/16
19 Block diagonal Preconditioner P = Ã 0 0 C sym. pos. def. Rusten Winther (1992), Silvester Wathen ( ), Klawonn (1998) Fischer Ramage Silvester Wathen ( ),.... p.10/16
20 Block diagonal Preconditioner P = Ã 0 0 C sym. pos. def. Rusten Winther (1992), Silvester Wathen ( ), Klawonn (1998) Fischer Ramage Silvester Wathen ( ),... λ 0 eigs of P 1 2 MP 1 2, λ [ a, b] [c, d]. p.10/16
21 Q = [ Ã B C B T Constraint Preconditioner Axelsson (1979), Ewing Lazarov Lu Vassilevski (1990), Braess Sarazin (1997) Golub Wathen (1998) Vassilevski Lazarov (1996), Lukšan Vlček ( ), Perugia S. Arioli (1999), Keller Gould Wathen (2000) Perugia S. (2000), Gould Hribar Nocedal (2001), Rozloznik S. (2002), Durazzi Ruggiero (2003), Axelsson Neytcheva (2003),... ]. p.11/16
22 Q = [ Ã B C B T Constraint Preconditioner Axelsson (1979), Ewing Lazarov Lu Vassilevski (1990), Braess Sarazin (1997) Golub Wathen (1998) Vassilevski Lazarov (1996), Lukšan Vlček ( ), Perugia S. Arioli (1999), Keller Gould Wathen (2000) Perugia S. (2000), Gould Hribar Nocedal (2001), Rozloznik S. (2002), Durazzi Ruggiero (2003), Axelsson Neytcheva (2003),... ] λ 0 eigs di MQ 1, λ R +, λ {1} [α 0, α 1 ]. p.11/16
23 Q = [ Ã B C B T Constraint Preconditioner Axelsson (1979), Ewing Lazarov Lu Vassilevski (1990), Braess Sarazin (1997) Golub Wathen (1998) Vassilevski Lazarov (1996), Lukšan Vlček ( ), Perugia S. Arioli (1999), Keller Gould Wathen (2000) Perugia S. (2000), Gould Hribar Nocedal (2001), Rozloznik S. (2002), Durazzi Ruggiero (2003), Axelsson Neytcheva (2003),... ] λ 0 eigs di MQ 1, λ R +, λ {1} [α 0, α 1 ] Remark: B T x k = 0 for all iterates x k. p.11/16
24 Q = [ Ã B C B T Constraint Preconditioner Axelsson (1979), Ewing Lazarov Lu Vassilevski (1990), Braess Sarazin (1997) Golub Wathen (1998) Vassilevski Lazarov (1996), Lukšan Vlček ( ), Perugia S. Arioli (1999), Keller Gould Wathen (2000) Perugia S. (2000), Gould Hribar Nocedal (2001), Rozloznik S. (2002), Durazzi Ruggiero (2003), Axelsson Neytcheva (2003),... ] λ 0 eigs di MQ 1, λ R +, λ {1} [α 0, α 1 ] Remark: B T x k = 0 for all iterates x k Q 1 = [ I B T 0 I ] [ I 0 0 (BB T + C) 1 ] [ I 0 B I ]. p.11/16
25 A BT B C u v = A different perspective f M x = d g Polyak 1970,..., Fischer & Ramage & Silvester & Wathen 1997, Bai & Golub & Ng 2003, Sidi 2003, Benzi & Gander & Golub 2003, Benzi & Golub 2004, S. & Benzi 2004,... Λ(M ) in C +. p.12/16
26 A BT B C u v = A different perspective f M x = d g Polyak 1970,..., Fischer & Ramage & Silvester & Wathen 1997, Bai & Golub & Ng 2003, Sidi 2003, Benzi & Gander & Golub 2003, Benzi & Golub 2004, S. & Benzi 2004,... Λ(M ) in C + More refined spectral information possible. p.12/16
27 A BT B C u v = A different perspective f M x = d g Polyak 1970,..., Fischer & Ramage & Silvester & Wathen 1997, Bai & Golub & Ng 2003, Sidi 2003, Benzi & Gander & Golub 2003, Benzi & Golub 2004, S. & Benzi 2004,... Λ(M ) in C + More refined spectral information possible New classes of preconditioners. p.12/16
28 A BT B C u v = A different perspective f M x = d g Polyak 1970,..., Fischer & Ramage & Silvester & Wathen 1997, Bai & Golub & Ng 2003, Sidi 2003, Benzi & Gander & Golub 2003, Benzi & Golub 2004, S. & Benzi 2004,... Λ(M ) in C + More refined spectral information possible New classes of preconditioners General framework for spectral analysis of some inexact preconditioners. p.12/16
29 Spectral properties of M A n n sym. semidef. matrix, B m n, m n M has at least n m real eigenvalues. p.13/16
30 Spectral properties of M A n n sym. semidef. matrix, B m n, m n M has at least n m real eigenvalues Let C = βi. If λ min (A + βi) 4 λ max (B T A 1 B + βi), then all eigenvalues of M are real.. p.13/16
31 Spectral properties of M A n n sym. semidef. matrix, B m n, m n M has at least n m real eigenvalues Let C = βi. If λ min (A + βi) 4 λ max (B T A 1 B + βi), then all eigenvalues of M are real. Let C be sym. Let λ Λ(M ). If I(λ) 0, then 1 2 (λ min(a) + λ min (C)) R(λ) 1 2 (λ max(a) + λ max (C)) If I(λ) = 0 then I(λ) σ max (B). 2 min{λ min (A), λ min (C)} λ (λ max (A) + λ max (C)). cf. Sidi 2003 for C = 0. p.13/16
32 Hermitian Skew-Hermitian Preconditioning M = A BT B C = A 0 0 C + 0 BT B 0 = H + S. p.14/16
33 Hermitian Skew-Hermitian Preconditioning M = A BT B C = A 0 0 C + 0 BT B 0 = H + S Use the preconditioner R = 1 (H + αi)(s + αi) α R, α > 0 2α Bai & Golub & Ng 2003, Benzi & Gander & Golub 2003, Benzi & Golub 2004, S. & Benzi p.14/16
34 Hermitian Skew-Hermitian Preconditioning M = A BT B C = A 0 0 C + 0 BT B 0 = H + S Use the preconditioner R = 1 (H + αi)(s + αi) α R, α > 0 2α Bai & Golub & Ng 2003, Benzi & Gander & Golub 2003, Benzi & Golub 2004, S. & Benzi 2004 Sharp spectral bounds for C = 0 (S. & Benzi 2004). p.14/16
35 General framework P 1 A B BT C Ã B T B C Ã 0, C 0 We can provide a spectral analysis when P is:. p.15/16
36 General framework P 1 A B BT C Ã B T B C Ã 0, C 0 We can provide a spectral analysis when P is: Inexact Constraint Preconditioner. p.15/16
37 General framework P 1 A B BT C Ã B T B C Ã 0, C 0 We can provide a spectral analysis when P is: Inexact Constraint Preconditioner Hermitian Skew-Hermitian Preconditioner (C = βi). p.15/16
38 General framework P 1 A B BT C à B T B C à 0, C 0 We can provide a spectral analysis when P is: Inexact Constraint Preconditioner Hermitian Skew-Hermitian Preconditioner (C = βi) Indefinite Block diagonal Preconditioner  0 0 Ĉ cf. Fischer et al p.15/16
39 Final Considerations Performance of preconditioners is problem dependent. p.16/16
40 Final Considerations Performance of preconditioners is problem dependent Ad-Hoc preconditioners usually designed (information from application problem). p.16/16
41 Final Considerations Performance of preconditioners is problem dependent Ad-Hoc preconditioners usually designed (information from application problem) Non-Hermitian problem not fully understood. p.16/16
42 Final Considerations Performance of preconditioners is problem dependent Ad-Hoc preconditioners usually designed (information from application problem) Non-Hermitian problem not fully understood Visit simoncin. p.16/16
Structured Preconditioners for Saddle Point Problems
Structured Preconditioners for Saddle Point Problems V. Simoncini Dipartimento di Matematica Università di Bologna valeria@dm.unibo.it p. 1 Collaborators on this project Mario Arioli, RAL, UK Michele Benzi,
More informationSpectral Properties of Saddle Point Linear Systems and Relations to Iterative Solvers Part I: Spectral Properties. V. Simoncini
Spectral Properties of Saddle Point Linear Systems and Relations to Iterative Solvers Part I: Spectral Properties V. Simoncini Dipartimento di Matematica, Università di ologna valeria@dm.unibo.it 1 Outline
More informationIndefinite Preconditioners for PDE-constrained optimization problems. V. Simoncini
Indefinite Preconditioners for PDE-constrained optimization problems V. Simoncini Dipartimento di Matematica, Università di Bologna, Italy valeria.simoncini@unibo.it Partly joint work with Debora Sesana,
More informationIterative solvers for saddle point algebraic linear systems: tools of the trade. V. Simoncini
Iterative solvers for saddle point algebraic linear systems: tools of the trade V. Simoncini Dipartimento di Matematica, Università di Bologna and CIRSA, Ravenna, Italy valeria@dm.unibo.it 1 The problem
More informationEfficient Solvers for the Navier Stokes Equations in Rotation Form
Efficient Solvers for the Navier Stokes Equations in Rotation Form Computer Research Institute Seminar Purdue University March 4, 2005 Michele Benzi Emory University Atlanta, GA Thanks to: NSF (MPS/Computational
More informationOn the accuracy of saddle point solvers
On the accuracy of saddle point solvers Miro Rozložník joint results with Valeria Simoncini and Pavel Jiránek Institute of Computer Science, Czech Academy of Sciences, Prague, Czech Republic Seminar at
More informationNumerical behavior of inexact linear solvers
Numerical behavior of inexact linear solvers Miro Rozložník joint results with Zhong-zhi Bai and Pavel Jiránek Institute of Computer Science, Czech Academy of Sciences, Prague, Czech Republic The fourth
More informationThe antitriangular factorisation of saddle point matrices
The antitriangular factorisation of saddle point matrices J. Pestana and A. J. Wathen August 29, 2013 Abstract Mastronardi and Van Dooren [this journal, 34 (2013) pp. 173 196] recently introduced the block
More informationFast Iterative Solution of Saddle Point Problems
Michele Benzi Department of Mathematics and Computer Science Emory University Atlanta, GA Acknowledgments NSF (Computational Mathematics) Maxim Olshanskii (Mech-Math, Moscow State U.) Zhen Wang (PhD student,
More informationThe Nullspace free eigenvalue problem and the inexact Shift and invert Lanczos method. V. Simoncini. Dipartimento di Matematica, Università di Bologna
The Nullspace free eigenvalue problem and the inexact Shift and invert Lanczos method V. Simoncini Dipartimento di Matematica, Università di Bologna and CIRSA, Ravenna, Italy valeria@dm.unibo.it 1 The
More informationIterative solution of saddle point problems
Iterative solution of saddle point problems Miroslav Rozložník, Pavel Jiránek Institute of Computer Science, Czech Academy of Sciences, Prague and Faculty of Mechatronics and Interdisciplinary Engineering
More informationKey words. inf-sup constant, iterative solvers, preconditioning, saddle point problems
NATURAL PRECONDITIONING AND ITERATIVE METHODS FOR SADDLE POINT SYSTEMS JENNIFER PESTANA AND ANDREW J. WATHEN Abstract. The solution of quadratic or locally quadratic extremum problems subject to linear(ized)
More informationJournal of Computational and Applied Mathematics. Optimization of the parameterized Uzawa preconditioners for saddle point matrices
Journal of Computational Applied Mathematics 6 (009) 136 154 Contents lists available at ScienceDirect Journal of Computational Applied Mathematics journal homepage: wwwelseviercom/locate/cam Optimization
More informationc 2004 Society for Industrial and Applied Mathematics
SIAM J. MATRIX ANAL. APPL. Vol. 6, No., pp. 377 389 c 004 Society for Industrial and Applied Mathematics SPECTRAL PROPERTIES OF THE HERMITIAN AND SKEW-HERMITIAN SPLITTING PRECONDITIONER FOR SADDLE POINT
More informationSome Preconditioning Techniques for Saddle Point Problems
Some Preconditioning Techniques for Saddle Point Problems Michele Benzi 1 and Andrew J. Wathen 2 1 Department of Mathematics and Computer Science, Emory University, Atlanta, Georgia 30322, USA. benzi@mathcs.emory.edu
More informationNatural preconditioners for saddle point systems
Natural preconditioners for saddle point systems Jennifer Pestana and Andrew J. Wathen August 29, 2013 Abstract The solution of quadratic or locally quadratic extremum problems subject to linear(ized)
More informationCombination Preconditioning of saddle-point systems for positive definiteness
Combination Preconditioning of saddle-point systems for positive definiteness Andy Wathen Oxford University, UK joint work with Jen Pestana Eindhoven, 2012 p.1/30 compute iterates with residuals Krylov
More informationA Review of Preconditioning Techniques for Steady Incompressible Flow
Zeist 2009 p. 1/43 A Review of Preconditioning Techniques for Steady Incompressible Flow David Silvester School of Mathematics University of Manchester Zeist 2009 p. 2/43 PDEs Review : 1984 2005 Update
More informationDepartment of Computer Science, University of Illinois at Urbana-Champaign
Department of Computer Science, University of Illinois at Urbana-Champaign Probing for Schur Complements and Preconditioning Generalized Saddle-Point Problems Eric de Sturler, sturler@cs.uiuc.edu, http://www-faculty.cs.uiuc.edu/~sturler
More informationSEMI-CONVERGENCE ANALYSIS OF THE INEXACT UZAWA METHOD FOR SINGULAR SADDLE POINT PROBLEMS
REVISTA DE LA UNIÓN MATEMÁTICA ARGENTINA Vol. 53, No. 1, 2012, 61 70 SEMI-CONVERGENCE ANALYSIS OF THE INEXACT UZAWA METHOD FOR SINGULAR SADDLE POINT PROBLEMS JIAN-LEI LI AND TING-ZHU HUANG Abstract. Recently,
More informationON AUGMENTED LAGRANGIAN METHODS FOR SADDLE-POINT LINEAR SYSTEMS WITH SINGULAR OR SEMIDEFINITE (1,1) BLOCKS * 1. Introduction
Journal of Computational Mathematics Vol.xx, No.x, 200x, 1 9. http://www.global-sci.org/jcm doi:10.4208/jcm.1401-cr7 ON AUGMENED LAGRANGIAN MEHODS FOR SADDLE-POIN LINEAR SYSEMS WIH SINGULAR OR SEMIDEFINIE
More informationSTOPPING CRITERIA FOR MIXED FINITE ELEMENT PROBLEMS
STOPPING CRITERIA FOR MIXED FINITE ELEMENT PROBLEMS M. ARIOLI 1,3 AND D. LOGHIN 2 Abstract. We study stopping criteria that are suitable in the solution by Krylov space based methods of linear and non
More informationSchur Complement Matrix And Its (Elementwise) Approximation: A Spectral Analysis Based On GLT Sequences
Schur Complement Matrix And Its (Elementwise) Approximation: A Spectral Analysis Based On GLT Sequences Ali Dorostkar, Maya Neytcheva, and Stefano Serra-Capizzano 2 Department of Information Technology,
More informationLinear and Non-Linear Preconditioning
and Non- martin.gander@unige.ch University of Geneva July 2015 Joint work with Victorita Dolean, Walid Kheriji, Felix Kwok and Roland Masson (1845): First Idea of After preconditioning, it takes only three
More informationBFGS-like updates of Constraint Preconditioners for sequences of KKT linear systems
BFGS-like updates of Constraint Preconditioners for sequences of KKT linear systems Valentina De Simone Dept. of Mathematics and Physics Univ. Campania Luigi Vanvitelli valentina.desimone@unina2.it Joint
More informationIP-PCG An interior point algorithm for nonlinear constrained optimization
IP-PCG An interior point algorithm for nonlinear constrained optimization Silvia Bonettini (bntslv@unife.it), Valeria Ruggiero (rgv@unife.it) Dipartimento di Matematica, Università di Ferrara December
More informationA Robust Preconditioned Iterative Method for the Navier-Stokes Equations with High Reynolds Numbers
Applied and Computational Mathematics 2017; 6(4): 202-207 http://www.sciencepublishinggroup.com/j/acm doi: 10.11648/j.acm.20170604.18 ISSN: 2328-5605 (Print); ISSN: 2328-5613 (Online) A Robust Preconditioned
More informationFast solvers for steady incompressible flow
ICFD 25 p.1/21 Fast solvers for steady incompressible flow Andy Wathen Oxford University wathen@comlab.ox.ac.uk http://web.comlab.ox.ac.uk/~wathen/ Joint work with: Howard Elman (University of Maryland,
More informationPreconditioners for the incompressible Navier Stokes equations
Preconditioners for the incompressible Navier Stokes equations C. Vuik M. ur Rehman A. Segal Delft Institute of Applied Mathematics, TU Delft, The Netherlands SIAM Conference on Computational Science and
More informationOn iterative methods and implicit-factorization preconditioners for regularized saddle-point systems
echnical Report RAL-R-2005-011 On iterative methods and implicit-factorization preconditioners for regularized saddle-point systems H S Dollar N I M Gould W H A Schilders A J Wathen June 22, 2005 Council
More informationBlock triangular preconditioner for static Maxwell equations*
Volume 3, N. 3, pp. 589 61, 11 Copyright 11 SBMAC ISSN 11-85 www.scielo.br/cam Block triangular preconditioner for static Maxwell equations* SHI-LIANG WU 1, TING-ZHU HUANG and LIANG LI 1 School of Mathematics
More informationOn the Superlinear Convergence of MINRES. Valeria Simoncini and Daniel B. Szyld. Report January 2012
On the Superlinear Convergence of MINRES Valeria Simoncini and Daniel B. Szyld Report 12-01-11 January 2012 This report is available in the World Wide Web at http://www.math.temple.edu/~szyld 0 Chapter
More informationChebyshev semi-iteration in Preconditioning
Report no. 08/14 Chebyshev semi-iteration in Preconditioning Andrew J. Wathen Oxford University Computing Laboratory Tyrone Rees Oxford University Computing Laboratory Dedicated to Victor Pereyra on his
More informationConvergence Properties of Preconditioned Hermitian and Skew-Hermitian Splitting Methods for Non-Hermitian Positive Semidefinite Matrices
Convergence Properties of Preconditioned Hermitian and Skew-Hermitian Splitting Methods for Non-Hermitian Positive Semidefinite Matrices Zhong-Zhi Bai 1 Department of Mathematics, Fudan University Shanghai
More informationOn the interplay between discretization and preconditioning of Krylov subspace methods
On the interplay between discretization and preconditioning of Krylov subspace methods Josef Málek and Zdeněk Strakoš Nečas Center for Mathematical Modeling Charles University in Prague and Czech Academy
More informationINCOMPLETE FACTORIZATION CONSTRAINT PRECONDITIONERS FOR SADDLE-POINT MATRICES
INCOMPLEE FACORIZAION CONSRAIN PRECONDIIONERS FOR SADDLE-POIN MARICES H. S. DOLLAR AND A. J. WAHEN Abstract. We consider the application of the conjugate gradient method to the solution of large symmetric,
More informationANALYSIS OF THE MINIMAL RESIDUAL METHOD APPLIED TO ILL-POSED OPTIMALITY SYSTEMS
ANALYSIS OF THE MINIMAL RESIDUAL METHOD APPLIED TO ILL-POSED OPTIMALITY SYSTEMS BJØRN FREDRIK NIELSEN 1 AND KENT-ANDRE MARDAL Abstract. We analyze the performance of the Minimal Residual Method applied
More informationMathematics and Computer Science
Technical Report TR-2007-002 Block preconditioning for saddle point systems with indefinite (1,1) block by Michele Benzi, Jia Liu Mathematics and Computer Science EMORY UNIVERSITY International Journal
More information1. Introduction. Consider the large and sparse saddle point linear system
SIAM J MATRIX ANAL APPL Vol 7, No 3, pp 779 79 c 006 Society for Industrial and Applied Mathematics AN ALGEBRAIC ANALYSIS OF A BLOCK DIAGONAL PRECONDITIONER FOR SADDLE POINT SYSTEMS GENE H GOLUB, CHEN
More informationPreconditioners for reduced saddle point systems arising in elliptic PDE-constrained optimization problems
Zeng et al. Journal of Inequalities and Applications 205 205:355 DOI 0.86/s3660-05-0879-x RESEARCH Open Access Preconditioners for reduced saddle point systems arising in elliptic PDE-constrained optimization
More informationLinear algebra issues in Interior Point methods for bound-constrained least-squares problems
Linear algebra issues in Interior Point methods for bound-constrained least-squares problems Stefania Bellavia Dipartimento di Energetica S. Stecco Università degli Studi di Firenze Joint work with Jacek
More informationThe semi-convergence of GSI method for singular saddle point problems
Bull. Math. Soc. Sci. Math. Roumanie Tome 57(05 No., 04, 93 00 The semi-convergence of GSI method for singular saddle point problems by Shu-Xin Miao Abstract Recently, Miao Wang considered the GSI method
More informationExploiting hyper-sparsity when computing preconditioners for conjugate gradients in interior point methods
Exploiting hyper-sparsity when computing preconditioners for conjugate gradients in interior point methods Julian Hall, Ghussoun Al-Jeiroudi and Jacek Gondzio School of Mathematics University of Edinburgh
More informationApproximation of functions of large matrices. Part I. Computational aspects. V. Simoncini
Approximation of functions of large matrices. Part I. Computational aspects V. Simoncini Dipartimento di Matematica, Università di Bologna and CIRSA, Ravenna, Italy valeria@dm.unibo.it 1 The problem Given
More informationON THE GENERALIZED DETERIORATED POSITIVE SEMI-DEFINITE AND SKEW-HERMITIAN SPLITTING PRECONDITIONER *
Journal of Computational Mathematics Vol.xx, No.x, 2x, 6. http://www.global-sci.org/jcm doi:?? ON THE GENERALIZED DETERIORATED POSITIVE SEMI-DEFINITE AND SKEW-HERMITIAN SPLITTING PRECONDITIONER * Davod
More informationBlock-triangular preconditioners for PDE-constrained optimization
NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS Numer. Linear Algebra Appl. () Published online in Wiley InterScience (www.interscience.wiley.com). DOI:./nla.693 Block-triangular preconditioners for PDE-constrained
More information1. Introduction. We consider the solution of systems of linear equations with the following block 2 2 structure:
SIAM J. MATRIX ANAL. APPL. Vol. 26, No. 1, pp. 20 41 c 2004 Society for Industrial and Applied Mathematics A PRECONDITIONER FOR GENERALIZED SADDLE POINT PROBLEMS MICHELE BENZI AND GENE H. GOLUB Abstract.
More informationON THE ROLE OF COMMUTATOR ARGUMENTS IN THE DEVELOPMENT OF PARAMETER-ROBUST PRECONDITIONERS FOR STOKES CONTROL PROBLEMS
ON THE ROLE OF COUTATOR ARGUENTS IN THE DEVELOPENT OF PARAETER-ROBUST PRECONDITIONERS FOR STOKES CONTROL PROBLES JOHN W. PEARSON Abstract. The development of preconditioners for PDE-constrained optimization
More informationRegularized HSS iteration methods for saddle-point linear systems
BIT Numer Math DOI 10.1007/s10543-016-0636-7 Regularized HSS iteration methods for saddle-point linear systems Zhong-Zhi Bai 1 Michele Benzi 2 Received: 29 January 2016 / Accepted: 20 October 2016 Springer
More informationIN this paper, we investigate spectral properties of block
On the Eigenvalues Distribution of Preconditioned Block wo-by-two Matrix Mu-Zheng Zhu and a-e Qi Abstract he spectral properties of a class of block matrix are studied, which arise in the numercial solutions
More informationMatrix-Free Interior Point Method
Matrix-Free Interior Point Method Jacek Gondzio School of Mathematics and Maxwell Institute for Mathematical Sciences The University of Edinburgh Mayfield Road, Edinburgh EH9 3JZ United Kingdom. Technical
More informationDELFT UNIVERSITY OF TECHNOLOGY
DELFT UNIVERSITY OF TECHNOLOGY REPORT 13-10 Comparison of some preconditioners for the incompressible Navier-Stokes equations X. He and C. Vuik ISSN 1389-6520 Reports of the Delft Institute of Applied
More informationPRECONDITIONING PDE-CONSTRAINED OPTIMIZATION WITH L 1 -SPARSITY AND CONTROL CONSTRAINTS
PRECONDITIONING PDE-CONSTRAINED OPTIMIZATION WITH L 1 -SPARSITY AND CONTROL CONSTRAINTS MARGHERITA PORCELLI, VALERIA SIMONCINI, MARTIN STOLL Abstract. PDE-constrained optimization aims at finding optimal
More informationPreconditioning of Saddle Point Systems by Substructuring and a Penalty Approach
Preconditioning of Saddle Point Systems by Substructuring and a Penalty Approach Clark R. Dohrmann 1 Sandia National Laboratories, crdohrm@sandia.gov. Sandia is a multiprogram laboratory operated by Sandia
More informationPart 4: Active-set methods for linearly constrained optimization. Nick Gould (RAL)
Part 4: Active-set methods for linearly constrained optimization Nick Gould RAL fx subject to Ax b Part C course on continuoue optimization LINEARLY CONSTRAINED MINIMIZATION fx subject to Ax { } b where
More informationMathematics and Computer Science
Technical Report TR-2010-026 On Preconditioned MHSS Iteration Methods for Complex Symmetric Linear Systems by Zhong-Zhi Bai, Michele Benzi, Fang Chen Mathematics and Computer Science EMORY UNIVERSITY On
More informationEfficient Augmented Lagrangian-type Preconditioning for the Oseen Problem using Grad-Div Stabilization
Efficient Augmented Lagrangian-type Preconditioning for the Oseen Problem using Grad-Div Stabilization Timo Heister, Texas A&M University 2013-02-28 SIAM CSE 2 Setting Stationary, incompressible flow problems
More informationNew multigrid smoothers for the Oseen problem
NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS Numer. Linear Algebra Appl. (2010) Published online in Wiley InterScience (www.interscience.wiley.com)..707 New multigrid smoothers for the Oseen problem Steven
More informationETNA Kent State University
Electronic Transactions on Numerical Analysis. Volume 36, pp. 39-53, 009-010. Copyright 009,. ISSN 1068-9613. ETNA P-REGULAR SPLITTING ITERATIVE METHODS FOR NON-HERMITIAN POSITIVE DEFINITE LINEAR SYSTEMS
More informationarxiv: v1 [math.na] 26 Dec 2013
General constraint preconditioning iteration method for singular saddle-point problems Ai-Li Yang a,, Guo-Feng Zhang a, Yu-Jiang Wu a,b a School of Mathematics and Statistics, Lanzhou University, Lanzhou
More informationRecent advances in approximation using Krylov subspaces. V. Simoncini. Dipartimento di Matematica, Università di Bologna.
Recent advances in approximation using Krylov subspaces V. Simoncini Dipartimento di Matematica, Università di Bologna and CIRSA, Ravenna, Italy valeria@dm.unibo.it 1 The framework It is given an operator
More informationComputational methods for large-scale matrix equations and application to PDEs. V. Simoncini
Computational methods for large-scale matrix equations and application to PDEs V. Simoncini Dipartimento di Matematica, Università di Bologna valeria.simoncini@unibo.it 1 Some matrix equations Sylvester
More informationPDE-constrained Optimization and Beyond (PDE-constrained Optimal Control)
PDE-constrained Optimization and Beyond (PDE-constrained Optimal Control) Youngsoo Choi Introduction PDE-condstrained optimization has broad and important applications. It is in some sense an obvious consequence
More informationSolving Ax = b, an overview. Program
Numerical Linear Algebra Improving iterative solvers: preconditioning, deflation, numerical software and parallelisation Gerard Sleijpen and Martin van Gijzen November 29, 27 Solving Ax = b, an overview
More informationJournal of Computational and Applied Mathematics. Multigrid method for solving convection-diffusion problems with dominant convection
Journal of Computational and Applied Mathematics 226 (2009) 77 83 Contents lists available at ScienceDirect Journal of Computational and Applied Mathematics journal homepage: www.elsevier.com/locate/cam
More informationNumerical optimization
Numerical optimization Lecture 4 Alexander & Michael Bronstein tosca.cs.technion.ac.il/book Numerical geometry of non-rigid shapes Stanford University, Winter 2009 2 Longest Slowest Shortest Minimal Maximal
More informationPostprint.
http://www.diva-portal.org Postprint This is the accepted version of a paper published in Journal of Computational and Applied Mathematics. This paper has been peer-reviewed but does not include the final
More informationAdaptive rational Krylov subspaces for large-scale dynamical systems. V. Simoncini
Adaptive rational Krylov subspaces for large-scale dynamical systems V. Simoncini Dipartimento di Matematica, Università di Bologna valeria@dm.unibo.it joint work with Vladimir Druskin, Schlumberger Doll
More informationANALYSIS OF AUGMENTED LAGRANGIAN-BASED PRECONDITIONERS FOR THE STEADY INCOMPRESSIBLE NAVIER-STOKES EQUATIONS
ANALYSIS OF AUGMENTED LAGRANGIAN-BASED PRECONDITIONERS FOR THE STEADY INCOMPRESSIBLE NAVIER-STOKES EQUATIONS MICHELE BENZI AND ZHEN WANG Abstract. We analyze a class of modified augmented Lagrangian-based
More informationNumerical optimization. Numerical optimization. Longest Shortest where Maximal Minimal. Fastest. Largest. Optimization problems
1 Numerical optimization Alexander & Michael Bronstein, 2006-2009 Michael Bronstein, 2010 tosca.cs.technion.ac.il/book Numerical optimization 048921 Advanced topics in vision Processing and Analysis of
More informationON A SPLITTING PRECONDITIONER FOR SADDLE POINT PROBLEMS
J. Appl. Math. & Informatics Vol. 36(208, No. 5-6, pp. 459-474 https://doi.org/0.437/jami.208.459 ON A SPLITTING PRECONDITIONER FOR SADDLE POINT PROBLEMS DAVOD KHOJASTEH SALKUYEH, MARYAM ABDOLMALEKI, SAEED
More informationA PRECONDITIONER FOR LINEAR SYSTEMS ARISING FROM INTERIOR POINT OPTIMIZATION METHODS
A PRECONDITIONER FOR LINEAR SYSTEMS ARISING FROM INTERIOR POINT OPTIMIZATION METHODS TIM REES AND CHEN GREIF Abstract. We explore a preconditioning technique applied to the problem of solving linear systems
More informationPerformance Comparison of Relaxation Methods with Singular and Nonsingular Preconditioners for Singular Saddle Point Problems
Applied Mathematical Sciences, Vol. 10, 2016, no. 30, 1477-1488 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ams.2016.6269 Performance Comparison of Relaxation Methods with Singular and Nonsingular
More informationNumerical Optimization Professor Horst Cerjak, Horst Bischof, Thomas Pock Mat Vis-Gra SS09
Numerical Optimization 1 Working Horse in Computer Vision Variational Methods Shape Analysis Machine Learning Markov Random Fields Geometry Common denominator: optimization problems 2 Overview of Methods
More informationON A GENERAL CLASS OF PRECONDITIONERS FOR NONSYMMETRIC GENERALIZED SADDLE POINT PROBLEMS
U..B. Sci. Bull., Series A, Vol. 78, Iss. 4, 06 ISSN 3-707 ON A GENERAL CLASS OF RECONDIIONERS FOR NONSYMMERIC GENERALIZED SADDLE OIN ROBLE Fatemeh anjeh Ali BEIK his paper deals with applying a class
More informationc 2007 Society for Industrial and Applied Mathematics
SA J. OPT. Vol. 18, No. 2, pp. 666 690 c 2007 Society for ndustrial and Applied athematics TERATVE SOLUTON OF AUGENTED SYSTES ARSNG N NTEROR ETHODS ANDERS FORSGREN, PHLP E. GLL, AND JOSHUA D. GRFFN Abstract.
More informationMultigrid and Iterative Strategies for Optimal Control Problems
Multigrid and Iterative Strategies for Optimal Control Problems John Pearson 1, Stefan Takacs 1 1 Mathematical Institute, 24 29 St. Giles, Oxford, OX1 3LB e-mail: john.pearson@worc.ox.ac.uk, takacs@maths.ox.ac.uk
More informationOn preconditioned MHSS iteration methods for complex symmetric linear systems
DOI 10.1007/s11075-010-9441-6 ORIGINAL PAPER On preconditioned MHSS iteration methods for complex symmetric linear systems Zhong-Zhi Bai Michele Benzi Fang Chen Received: 25 November 2010 / Accepted: 13
More informationOPTIMAL SOLVERS FOR PDE-CONSTRAINED OPTIMIZATION
OPTIMAL SOLVERS FOR PDE-CONSTRAINED OPTIMIZATION TYRONE REES, H. SUE DOLLAR, AND ANDREW J. WATHEN Abstract. Optimization problems with constraints which require the solution of a partial differential equation
More informationComputational methods for large-scale matrix equations and application to PDEs. V. Simoncini
Computational methods for large-scale matrix equations and application to PDEs V. Simoncini Dipartimento di Matematica Alma Mater Studiorum - Università di Bologna valeria.simoncini@unibo.it 1 Some matrix
More informationEfficient Solvers for Stochastic Finite Element Saddle Point Problems
Efficient Solvers for Stochastic Finite Element Saddle Point Problems Catherine E. Powell c.powell@manchester.ac.uk School of Mathematics University of Manchester, UK Efficient Solvers for Stochastic Finite
More informationA MODIFIED HSS ITERATION METHOD FOR SOLVING THE COMPLEX LINEAR MATRIX EQUATION AXB = C *
Journal of Computational Mathematics Vol.34, No.4, 2016, 437 450. http://www.global-sci.org/jcm doi:10.4208/jcm.1601-m2015-0416 A MODIFIED HSS ITERATION METHOD FOR SOLVING THE COMPLEX LINEAR MATRIX EQUATION
More informationComputational methods for large-scale matrix equations: recent advances and applications. V. Simoncini
Computational methods for large-scale matrix equations: recent advances and applications V. Simoncini Dipartimento di Matematica Alma Mater Studiorum - Università di Bologna valeria.simoncini@unibo.it
More informationBlock preconditioners for saddle point systems arising from liquid crystal directors modeling
Noname manuscript No. (will be inserted by the editor) Block preconditioners for saddle point systems arising from liquid crystal directors modeling Fatemeh Panjeh Ali Beik Michele Benzi Received: date
More informationAlgorithms for Solving the Polynomial Eigenvalue Problem
Algorithms for Solving the Polynomial Eigenvalue Problem Nick Higham School of Mathematics The University of Manchester higham@ma.man.ac.uk http://www.ma.man.ac.uk/~higham/ Joint work with D. Steven Mackey
More informationPreconditioned GMRES Revisited
Preconditioned GMRES Revisited Roland Herzog Kirk Soodhalter UBC (visiting) RICAM Linz Preconditioning Conference 2017 Vancouver August 01, 2017 Preconditioned GMRES Revisited Vancouver 1 / 32 Table of
More informationPrince Chidyagwai, Scott Ladenheim, and Daniel B. Szyld. Report July 2015
CONSTRAINT PRECONDITIONING FOR THE COUPLED STOKES-DARCY SYSTEM Prince Chidyagwai, Scott Ladenheim, and Daniel B. Szyld Report 5-07-9 July 05 This is a report of the Department of Mathematics at Temple
More informationPrince Chidyagwai, Scott Ladenheim, and Daniel B. Szyld. Report July 2015, Revised October 2015
CONSTRAINT PRECONDITIONING FOR THE COUPLED STOKES-DARCY SYSTEM Prince Chidyagwai, Scott Ladenheim, and Daniel B. Szyld Report 5-07-9 July 05, Revised October 05 This is a report of the Department of Mathematics
More informationPreconditioning the incompressible Navier-Stokes equations with variable viscosity
Preconditioning the incompressible Navier-Stokes equations with variable viscosity Xin He and Maya Neytcheva Abstract This paper deals with preconditioners for the iterative solution of the discrete Oseen
More informationPOSITIVE DEFINITE AND SEMI-DEFINITE SPLITTING METHODS FOR NON-HERMITIAN POSITIVE DEFINITE LINEAR SYSTEMS * 1. Introduction
Journal of Computational Mathematics Vol.34, No.3, 2016, 300 316. http://www.global-sci.org/jcm doi:10.4208/jcm.1511-m2015-0299 POSITIVE DEFINITE AND SEMI-DEFINITE SPLITTING METHODS FOR NON-HERMITIAN POSITIVE
More informationAn introduction to PDE-constrained optimization
An introduction to PDE-constrained optimization Wolfgang Bangerth Department of Mathematics Texas A&M University 1 Overview Why partial differential equations? Why optimization? Examples of PDE optimization
More informationNumerische Mathematik
Numer. Math. (2002) 90: 665 688 Digital Object Identifier (DOI) 10.1007/s002110100300 Numerische Mathematik Performance and analysis of saddle point preconditioners for the discrete steady-state Navier-Stokes
More informationThe Solution of Augmented Systems. Iain S. Du 1. We examine the solution of sets of linear equations for which the coecient matrix has H A
RAL 93-084 The Solution of Augmented Systems Iain S. Du 1 ABSTRACT We examine the solution of sets of linear equations for which the coecient matrix has the form H A A T 0 where the matrix H is symmetric.
More informationShort title: Total FETI. Corresponding author: Zdenek Dostal, VŠB-Technical University of Ostrava, 17 listopadu 15, CZ Ostrava, Czech Republic
Short title: Total FETI Corresponding author: Zdenek Dostal, VŠB-Technical University of Ostrava, 17 listopadu 15, CZ-70833 Ostrava, Czech Republic mail: zdenek.dostal@vsb.cz fax +420 596 919 597 phone
More informationTrust-Region SQP Methods with Inexact Linear System Solves for Large-Scale Optimization
Trust-Region SQP Methods with Inexact Linear System Solves for Large-Scale Optimization Denis Ridzal Department of Computational and Applied Mathematics Rice University, Houston, Texas dridzal@caam.rice.edu
More informationAMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 23: GMRES and Other Krylov Subspace Methods; Preconditioning
AMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 23: GMRES and Other Krylov Subspace Methods; Preconditioning Xiangmin Jiao SUNY Stony Brook Xiangmin Jiao Numerical Analysis I 1 / 18 Outline
More informationFactorization of Indefinite Systems Associated with RLC Circuits. Patricio Rosen Wil Schilders, Joost Rommes
Factorization of Indefinite Systems Associated with RLC Circuits Patricio Rosen Wil Schilders, Joost Rommes Outline Circuit Equations Solution Methods (Schilders Factorization Incidence Matrix Decomposition
More informationThe null-space method and its relationship with matrix factorizations for sparse saddle point systems
Technical Report RAL-TR-2014-016 The null-space method and its relationship with matrix factorizations for sparse saddle point systems T Rees, J Scott November 2014 2014 Science and Technology Facilities
More informationNumerical Methods in Matrix Computations
Ake Bjorck Numerical Methods in Matrix Computations Springer Contents 1 Direct Methods for Linear Systems 1 1.1 Elements of Matrix Theory 1 1.1.1 Matrix Algebra 2 1.1.2 Vector Spaces 6 1.1.3 Submatrices
More informationInterior-Point Methods as Inexact Newton Methods. Silvia Bonettini Università di Modena e Reggio Emilia Italy
InteriorPoint Methods as Inexact Newton Methods Silvia Bonettini Università di Modena e Reggio Emilia Italy Valeria Ruggiero Università di Ferrara Emanuele Galligani Università di Modena e Reggio Emilia
More information