Linear algebra for exponential integrators

Similar documents
Approximating the matrix exponential of an advection-diffusion operator using the incomplete orthogonalization method

Computing the Action of the Matrix Exponential

Test you method and verify the results with an appropriate function, e.g. f(x) = cos 1 + sin

Exponential integrators for semilinear parabolic problems

Exponential multistep methods of Adams-type

Introduction to Arnoldi method

Exponential Runge-Kutta methods for parabolic problems

Krylov methods for the computation of matrix functions

Index. higher order methods, 52 nonlinear, 36 with variable coefficients, 34 Burgers equation, 234 BVP, see boundary value problems

Chapter Two: Numerical Methods for Elliptic PDEs. 1 Finite Difference Methods for Elliptic PDEs

Meshfree Exponential Integrators

c 2016 Society for Industrial and Applied Mathematics

4.8 Arnoldi Iteration, Krylov Subspaces and GMRES

Comparison of various methods for computing the action of the matrix exponential

Numerical Analysis of Differential Equations Numerical Solution of Parabolic Equations

7 Hyperbolic Differential Equations

Krylov Implicit Integration Factor Methods for Semilinear Fourth-Order Equations

PDEs, Matrix Functions and Krylov Subspace Methods

Exponential integration of large systems of ODEs

Krylov Subspace Methods for Nonlinear Model Reduction

Scientific Computing: An Introductory Survey

Optimal Left and Right Additive Schwarz Preconditioning for Minimal Residual Methods with Euclidean and Energy Norms

AMS526: Numerical Analysis I (Numerical Linear Algebra)

Splitting methods with boundary corrections

Matrix functions and their approximation. Krylov subspaces

Krylov-Subspace Based Model Reduction of Nonlinear Circuit Models Using Bilinear and Quadratic-Linear Approximations

SF Matrix computations for large-scale systems. Numerical linear algebra for large-scale systems

PH.D. PRELIMINARY EXAMINATION MATHEMATICS

APPLICATIONS OF FD APPROXIMATIONS FOR SOLVING ORDINARY DIFFERENTIAL EQUATIONS

Large-scale eigenvalue problems

Exponential integrators and functions of the matrix exponential

Favourable time integration methods for. Non-autonomous evolution equations

Exponential integrators

Implicit-explicit exponential integrators

Existence and uniqueness: Picard s theorem

Introduction to multiscale modeling and simulation. Explicit methods for ODEs : forward Euler. y n+1 = y n + tf(y n ) dy dt = f(y), y(0) = y 0

DEFLATED RESTARTING FOR MATRIX FUNCTIONS

Introduction to PDEs and Numerical Methods: Exam 1

Finite Differences for Differential Equations 28 PART II. Finite Difference Methods for Differential Equations

Finite difference methods for the diffusion equation

The Hopf algebraic structure of stochastic expansions and efficient simulation

Numerical Solutions to PDE s

ANALYSIS OF SOME KRYLOV SUBSPACE APPROXIMATIONS TO THE MATRIX EXPONENTIAL OPERATOR

Research Article A Two-Grid Method for Finite Element Solutions of Nonlinear Parabolic Equations

AMS526: Numerical Analysis I (Numerical Linear Algebra)

Conjugate Gradient algorithm. Storage: fixed, independent of number of steps.

Model reduction of large-scale dynamical systems

In honour of Professor William Gear

Takens embedding theorem for infinite-dimensional dynamical systems

Iterative methods for positive definite linear systems with a complex shift

Last time: Diffusion - Numerical scheme (FD) Heat equation is dissipative, so why not try Forward Euler:

Computation of eigenvalues and singular values Recall that your solutions to these questions will not be collected or evaluated.

Lecture 9: Krylov Subspace Methods. 2 Derivation of the Conjugate Gradient Algorithm

Numerical Analysis Preliminary Exam 10 am to 1 pm, August 20, 2018

Preconditioned inverse iteration and shift-invert Arnoldi method

Minimal periods of semilinear evolution equations with Lipschitz nonlinearity

UNCONDITIONAL STABILITY OF A CRANK-NICOLSON ADAMS-BASHFORTH 2 IMPLICIT-EXPLICIT NUMERICAL METHOD

EXPLICIT EXPONENTIAL RUNGE-KUTTA METHODS FOR SEMILINEAR PARABOLIC PROBLEMS

Krylov subspace projection methods

M.A. Botchev. September 5, 2014

Exponential stability of abstract evolution equations with time delay feedback

MATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP)

McGill University Department of Mathematics and Statistics. Ph.D. preliminary examination, PART A. PURE AND APPLIED MATHEMATICS Paper BETA

Nonlinear equations. Norms for R n. Convergence orders for iterative methods

NOTES ON LINEAR ODES

Co-sponsored School/Workshop on Integrable Systems and Scientific Computing June Exponential integrators for stiff systems

Numerical approximation for optimal control problems via MPC and HJB. Giulia Fabrini

UNCONDITIONAL STABILITY OF A CRANK-NICOLSON ADAMS-BASHFORTH 2 NUMERICAL METHOD

An Efficient Algorithm Based on Quadratic Spline Collocation and Finite Difference Methods for Parabolic Partial Differential Equations.

Lab 1: Iterative Methods for Solving Linear Systems

Krylov single-step implicit integration factor WENO methods for advection-diffusion-reaction equations

Lecture 5. Ch. 5, Norms for vectors and matrices. Norms for vectors and matrices Why?

The Newton-ADI Method for Large-Scale Algebraic Riccati Equations. Peter Benner.

ON WEAKLY NONLINEAR BACKWARD PARABOLIC PROBLEM

Krylov integrators for Hamiltonian systems. Eirola, Timo

Index. C 2 ( ), 447 C k [a,b], 37 C0 ( ), 618 ( ), 447 CD 2 CN 2

Nonlinear Control Lecture # 14 Input-Output Stability. Nonlinear Control

EXISTENCE AND UNIQUENESS OF SOLUTIONS FOR FOURTH-ORDER BOUNDARY-VALUE PROBLEMS IN BANACH SPACES

Nonlinear Control Systems

NUMERICAL METHODS. lor CHEMICAL ENGINEERS. Using Excel', VBA, and MATLAB* VICTOR J. LAW. CRC Press. Taylor & Francis Group

AMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 23: GMRES and Other Krylov Subspace Methods; Preconditioning

An Operator Theoretical Approach to Nonlocal Differential Equations

Applied Mathematics 205. Unit V: Eigenvalue Problems. Lecturer: Dr. David Knezevic

Lecture 10: Finite Differences for ODEs & Nonlinear Equations

Implementation of exponential Rosenbrock-type integrators

FIXED POINT METHODS IN NONLINEAR ANALYSIS

PDEs, part 3: Hyperbolic PDEs

1 Discretizing BVP with Finite Element Methods.

Integrating-Factor-Based 2-Additive Runge Kutta methods for Advection-Reaction-Diffusion Equations

From Completing the Squares and Orthogonal Projection to Finite Element Methods

Course Notes: Week 1

The LEM exponential integrator for advection-diffusion-reaction equations

Homework Solutions:

Myopic Models of Population Dynamics on Infinite Networks

Exponential Almost Runge-Kutta Methods for Semilinear Problems

Ordinary Differential Equation Theory

Non-stationary Friedrichs systems

Module 6 : Solving Ordinary Differential Equations - Initial Value Problems (ODE-IVPs) Section 1 : Introduction

SEMIGROUP APPROACH FOR PARTIAL DIFFERENTIAL EQUATIONS OF EVOLUTION

Control, Stabilization and Numerics for Partial Differential Equations

Transcription:

Linear algebra for exponential integrators Antti Koskela KTH Royal Institute of Technology Beräkningsmatematikcirkus, 28 May 2014

The problem Considered: time integration of stiff semilinear initial value problems u (t) = Au(t) + g(t, u(t)), u(t 0 ) = u 0, where u(t) R n, A R n n (n large), g a nonlinear function with a moderate Lipschitz constant. Specifically considered: problems arising from the spatial semidiscretization of partial differential equations. E.g.: A comes from the discretization of the linear part of a PDE, using finite elements or finite differences. Antti Koskela, KTH Linear algebra for exponential integrators 2

Example Consider the Brusselator problem in 2D, u t = ν u + µu u + av (b + 1)u + u2 v, v t = ν v + µv v + bu u2 v, where A and B constants. Write as w t = Aw + g(w), where [ ] ν + µu + (b + 1) a A =, w = b ν + µv [ ] u. v Antti Koskela, KTH Linear algebra for exponential integrators 3

Example Consider the advection-diffusion equation t y(t, x) = ɛ xx y(t, x) + α x y(t, x), y(0, x) = 16(x(1 x)) 2, x [0, 1] subject to homogenous Dirichlet boundary conditions. Perform spatial discretization using the central differences ODE: u (t) = Au(t), u(0) = u 0. Compute the Krylov approximation of: 1) exp(ha)u 0 2) (I + h 2 A)(I h 2 A) 1 u 0 Antti Koskela, KTH Linear algebra for exponential integrators 4

Krylov subspace The Arnoldi iteration gives an orthogonal basis Q k R n k for the Krylov subspace K k (A, b) = span{b, Ab, A 2 b,..., A k 1 b}, and the Hessenberg matrix H k = Q T k AQ k R k k. Antti Koskela, KTH Linear algebra for exponential integrators 5

Approximation of matrix functions Cauchy s integral formula: for any analytic function f defined on D C, it holds f (A) = 1 f (λ)(λi A) 1 dλ, 2πi C where C is a closed curve inside the domain D enclosing σ(a). By using the approximation (λi A) 1 b Q k (λi H k ) 1 Q T k b, and letting C enclose the field of values F(A), the approximation f (A)b Q k f (H k )Q T k b is obtained. Antti Koskela, KTH Linear algebra for exponential integrators 6

Example 10 4 relative 2 norm error 10 6 10 8 10 10 10 12 Arnoldi error for the Crank-Nicholson Arnoldi error for the matrix exponential 0 10 20 30 40 50 60 Number of matrix vector multiplications Figure: Convergence of different Krylov approximations. Here: h = 5 10 5, ha 199. Antti Koskela, KTH Linear algebra for exponential integrators 7

Exponential integrators Exponential integrators are based on the variation-of-constants formula u(t) = e (t t 0)A u 0 + t t 0 e (t τ)a g(τ, u(τ)) dτ. which gives the the exact solution at time t. Example: exponential Euler method u 1 = e ha u 0 + hϕ 1 (ha)g(t 0, u 0 ) where h denotes the step size and ϕ 1 is the entire function ϕ 1 (z) = e z 1. z Antti Koskela, KTH Linear algebra for exponential integrators 8

Fast computation of series of ϕ - functions Computation of one time step can be done using the following lemma (Al-Mohy and Higham 2010). Lemma Let A R d d, W = [w 1, w 2,..., w p ] R d p, h R and à = [ ] A W R (d+p) (d+p), J = 0 J with e 1 = [1, 0,..., 0] T. Then it holds e ha u 0 + [ ] 0 0, v I p 1 0 0 = p h k ϕ k (ha)w k = [ I d 0 ] e hãv 0. k=1 [ u0 e 1 ] R d+p Antti Koskela, KTH Linear algebra for exponential integrators 9

References A. Koskela and A. Ostermann. Exponential Taylor methods: analysis and implementation. Computers and Mathematics with Applications (2013). A. Koskela and A. Ostermann. A moment-matching Arnoldi iteration for linear combinations of ϕ-functions. (submitted for publication). A. Koksela. Approximating the matrix exponential of an advection-diffusion operator using the incomplete orthogonalization method. To appear in ENUMATH proceedings. Antti Koskela, KTH Linear algebra for exponential integrators 10