Stability Ordinates of Adams Predictor-Corrector Methods

Similar documents
Stability Ordinates of Adams Predictor-Corrector Methods

c 2012 Society for Industrial and Applied Mathematics

Numerical Methods - Initial Value Problems for ODEs

Math 128A Spring 2003 Week 12 Solutions

Lecture Notes to Accompany. Scientific Computing An Introductory Survey. by Michael T. Heath. Chapter 9

Scientific Computing: An Introductory Survey

CS 450 Numerical Analysis. Chapter 9: Initial Value Problems for Ordinary Differential Equations

Fourth Order RK-Method

A New Block Method and Their Application to Numerical Solution of Ordinary Differential Equations

multistep methods Last modified: November 28, 2017 Recall that we are interested in the numerical solution of the initial value problem (IVP):

Numerical solution of ODEs

THE θ-methods IN THE NUMERICAL SOLUTION OF DELAY DIFFERENTIAL EQUATIONS. Karel J. in t Hout, Marc N. Spijker Leiden, The Netherlands

4 Stability analysis of finite-difference methods for ODEs

Journal of Computational Physics 161, (2000) doi: /jcph , available online at

Ordinary differential equations - Initial value problems

CS520: numerical ODEs (Ch.2)

Jim Lambers MAT 772 Fall Semester Lecture 21 Notes

ECE257 Numerical Methods and Scientific Computing. Ordinary Differential Equations

A Fast Spectral Algorithm for Nonlinear Wave Equations with Linear Dispersion

Finite Differences for Differential Equations 28 PART II. Finite Difference Methods for Differential Equations

On the stability regions of implicit linear multistep methods

9.6 Predictor-Corrector Methods

8.1 Introduction. Consider the initial value problem (IVP):

Linear Multistep Methods I: Adams and BDF Methods

IMPLICIT INTERVAL MULTISTEP METHODS FOR SOLVING THE INITIAL VALUE PROBLEM

Scientific Computing with Case Studies SIAM Press, Lecture Notes for Unit V Solution of

Initial value problems for ordinary differential equations

Numerical Differential Equations: IVP

Initial value problems for ordinary differential equations

Ordinary Differential Equations

Ordinary Differential Equations

Multistep Methods for IVPs. t 0 < t < T

COSC 3361 Numerical Analysis I Ordinary Differential Equations (II) - Multistep methods

Mathematics for chemical engineers. Numerical solution of ordinary differential equations

Ordinary differential equation II

Numerical Methods for Differential Equations

369 Nigerian Research Journal of Engineering and Environmental Sciences 2(2) 2017 pp

Semi-implicit Krylov Deferred Correction Methods for Ordinary Differential Equations

PowerPoints organized by Dr. Michael R. Gustafson II, Duke University

1 Introduction to MATLAB

A computationally effective predictor-corrector method for simulating fractional order dynamical control system

NUMERICAL SOLUTION OF ODE IVPs. Overview

Adebayo O. Adeniran1, Saheed O. Akindeinde2 and Babatunde S. Ogundare2 * Contents. 1. Introduction

Solving PDEs with PGI CUDA Fortran Part 4: Initial value problems for ordinary differential equations

Review Higher Order methods Multistep methods Summary HIGHER ORDER METHODS. P.V. Johnson. School of Mathematics. Semester

Numerical Methods for Differential Equations

THE METHOD OF LINES FOR PARABOLIC PARTIAL INTEGRO-DIFFERENTIAL EQUATIONS

Lecture 4: Numerical solution of ordinary differential equations

Applied Math for Engineers

Math Numerical Analysis Homework #4 Due End of term. y = 2y t 3y2 t 3, 1 t 2, y(1) = 1. n=(b-a)/h+1; % the number of steps we need to take

A NOTE ON EXPLICIT THREE-DERIVATIVE RUNGE-KUTTA METHODS (ThDRK)

ONE- AND TWO-STAGE IMPLICIT INTERVAL METHODS OF RUNGE-KUTTA TYPE

Geometric Numerical Integration

PowerPoints organized by Dr. Michael R. Gustafson II, Duke University

Module 4: Numerical Methods for ODE. Michael Bader. Winter 2007/2008

Strong Stability Preserving Properties of Runge Kutta Time Discretization Methods for Linear Constant Coefficient Operators

Integration of Ordinary Differential Equations

Lecture 5: Single Step Methods

Chapter 5 Exercises. (a) Determine the best possible Lipschitz constant for this function over 2 u <. u (t) = log(u(t)), u(0) = 2.

Fixed point iteration and root finding

Math 128A Spring 2003 Week 11 Solutions Burden & Faires 5.6: 1b, 3b, 7, 9, 12 Burden & Faires 5.7: 1b, 3b, 5 Burden & Faires 5.

Chapter 8. Numerical Solution of Ordinary Differential Equations. Module No. 2. Predictor-Corrector Methods

Exponentially Fitted Error Correction Methods for Solving Initial Value Problems

-Stable Second Derivative Block Multistep Formula for Stiff Initial Value Problems

CHAPTER 5: Linear Multistep Methods

COMPARISON OF FINITE DIFFERENCE- AND PSEUDOSPECTRAL METHODS FOR CONVECTIVE FLOW OVER A SPHERE

A Zero-Stable Block Method for the Solution of Third Order Ordinary Differential Equations.

UNCONDITIONAL STABILITY OF A CRANK-NICOLSON ADAMS-BASHFORTH 2 NUMERICAL METHOD

ON EXPLICIT INTERVAL METHODS OF ADAMS-BASHFORTH TYPE

Research Article Diagonally Implicit Block Backward Differentiation Formulas for Solving Ordinary Differential Equations

PowerPoints organized by Dr. Michael R. Gustafson II, Duke University

Numerical Analysis Preliminary Exam 10 am to 1 pm, August 20, 2018

Initial-Value Problems for ODEs. Introduction to Linear Multistep Methods

UNCONDITIONAL STABILITY OF A CRANK-NICOLSON ADAMS-BASHFORTH 2 IMPLICIT-EXPLICIT NUMERICAL METHOD

1 Ordinary Differential Equations

Part IB Numerical Analysis

Astrodynamics (AERO0024)

Review. Numerical Methods Lecture 22. Prof. Jinbo Bi CSE, UConn

Ordinary Differential Equations

c 1999 Society for Industrial and Applied Mathematics

Improved Starting Methods for Two-Step Runge Kutta Methods of Stage-Order p 3

Do not turn over until you are told to do so by the Invigilator.

Research Article P-Stable Higher Derivative Methods with Minimal Phase-Lag for Solving Second Order Differential Equations

Bindel, Fall 2011 Intro to Scientific Computing (CS 3220) Week 12: Monday, Apr 18. HW 7 is posted, and will be due in class on 4/25.

INTRODUCTION TO COMPUTER METHODS FOR O.D.E.

SOME PROPERTIES OF SYMPLECTIC RUNGE-KUTTA METHODS

MTH 452/552 Homework 3

Reducing round-off errors in symmetric multistep methods

5.6 Multistep Methods

x n+1 = x n f(x n) f (x n ), n 0.

A CLASS OF CONTINUOUS HYBRID LINEAR MULTISTEP METHODS FOR STIFF IVPs IN ODEs


Solving Ordinary Differential Equations

FDM for parabolic equations

Richarson Extrapolation for Runge-Kutta Methods

Ordinary Differential Equations. Monday, October 10, 11

A Brief Introduction to Numerical Methods for Differential Equations

Math 411 Preliminaries

Lecture Notes Multibody Dynamics B, wb1413

Southern Methodist University.

Transcription:

BIT manuscript No. will be inserted by the editor) Stability Ordinates of Adams Predictor-Corrector Methods Michelle L. Ghrist Bengt Fornberg Jonah A. Reeger Received: date / Accepted: date Abstract How far the stability domain of a numerical method for approximating solutions to differential equations extends along the imaginary axis indicates how useful the method is for approximating solutions to wave equations; this maximum extent is termed the imaginary stability boundary, also known as the stability ordinate. It has previously been shown that exactly half of Adams-Bashforth AB), Adams-Moulton AM), and staggered Adams- Bashforth methods have nonzero stability ordinates. In this paper, we consider two categories of Adams predictor-corrector methods and prove that they follow a similar pattern. In particular, if p is the order of the method, ABp-AMp methods have nonzero stability ordinate only for p =,, 5, 6, 9,,..., and ABp )-AMp methods have nonzero stability ordinates only for p=3,4, 7,8,,,... Keywords Adams methods Predictor-corrector Imaginary stability boundary Linear multistep methods Finite difference methods Stability region Stability ordinate Mathematics Subject Classification ) 65L6 65L 65L 65M6 65M Introduction When wave equations are posed as first-order systems and discretized in space to yield a system of ordinary differential equations ODEs), a purely imaginary spectrum will correspond to the fact that only propagation takes place. Many classical numerical methods for Support for M. Ghrist and J. Reeger provided by the United States Air Force. Support for B. Fornberg provided by NSF DMS-94647. Michelle Ghrist Department of Mathematical Sciences, United States Air Force Academy, USAF Academy, CO 884, USA E-mail: michelle.ghrist@usafa.edu Bengt Fornberg Department of Applied Mathematics, Campus Box 56, University of Colorado, Boulder, CO 839, USA E-mail: fornberg@colorado.edu Jonah Reeger Air Force Institute of Technology, 95 Hobson Way, WPAFB, OH 45433, USA E-mail: jonah.reeger@afit.edu

M. Ghrist, B. Fornberg, and J. Reeger ODEs have stability regions that include an interval of the form[ is I,iS I ] on the imaginary axis. We call the largest such value of S I the imaginary stability boundary ISB) of the ODE integrator, which is also known as the stability ordinate. In the context of solving semidiscrete wave equations, one desires to use a method with a large ISB, which allows larger stable time steps; methods with zero ISB s i.e., no imaginary axis coverage in the stability domain) will be unconditionally unstable. In this paper, we explore the question of which Adams methods have nonzero ISB s. Adams-Bashforth AB), Adams-Moulton AM), and Adams predictor-corrector methods are widely used multistep methods for approximating solutions to first-order differential equations. In general, these methods maintain reasonably good accuracy and stability properties and have lower computational costs than equivalent-order Runge Kutta methods; AB and AM methods require only one new function evaluation per time step, while predictorcorrector methods require two function evaluations [],[6],[7],[9]. A standard m-step Adams method for approximating solutions to dy dt = ft,y) has the form t j+ y j+ = y j + qt)dt, ) t j where t j = t + jh, h is the stepsize, and y = yt ). Here, qt) is the polynomial interpolating the pointst k,y k ) for j m+ k j AB methods) or j m+ k j+ AM methods). We will henceforth use j= to simplify the notation. AB methods have order p=m while AM methods have order p=m+. For staggered AB methods, qt) in ) interpolates at t k+/,y k+/ ) for j m+ k j; like AB methods, these methods have order p = m. For a given order of accuracy, staggered multistep methods have about ten times less local truncation error and stability domains that extend approximately -8 times as far on the imaginary axis when compared to their nonstaggered counterparts [4]. This improved accuracy and stability with no additional computational or storage cost makes such methods ideal when they can be applied; their main use is in approximating solutions to linear wave equations, which can be formulated with a grid which is staggered in space and/or time. For broader studies of staggered methods to include more general multistep and Runge Kutta methods), see [4], [5]. In [, Table G.3-], it was observed without proof) that AB methods of order p ABp) have nonzero ISB s only for orders p=3,4, 7,8,,,... and AMp methods have nonzero ISB s only for orders p=,, 5,6, 9,,... These results can be deduced from [] and were independently shown in [3] and [4]. While [] is not applicable to staggered methods, [3] and [4] proved that staggered AB methods of order p have nonzero ISB s only for p=,3,4, 7,8,,,..., ; none of the aforementioned articles addressed Adams predictorcorrector methods. Henceforth, we will only consider nonstaggered methods. This study revisits our previous results from [4] with a new formulation and then extends our results to Adams predictor-corrector methods. In particular, we examine the most commonly used Adams predictor-corrector methods ABp-AMp and ABp )-AMp, both of which have order p. We are unaware of any other studies addressing the ISB s of such methods for general order p. In [, Table G.3-], it was claimed that for such methods, most had nonzero ISB s while some had zero ISB s. We now proceed with proving that such methods follow very similar patterns to those of AB and AM methods, with ABp-AMp methods following the same pattern as AMp methods and ABp )-AMp methods following the same pattern as ABp methods. We then offer an application illustrating the significance of these results.

Stabilty Ordinates of Adams Predictor-Corrector Methods 3 Preliminary Results When solving Dahlquist s linear test problem dy dt = λy, ) the edge of a stability domain is described by the root ξ = λh of ρr) ξ σr)= when r travels around the unit circle r=e iθ. Here, ρr) and σr) are the generating polynomials of the method see, e.g., [9, p. 7]). To consider whether or not a stability domain has imaginary axis coverage, we wish to describe the behavior of the stability domain boundary near ξ =. For an exact method, we have ξθ)=lnr see, e.g., [9, Theorem.], using ξ = ρr).) Thus the stability boundary of an exact method satisfies σr) ξ = lnr=ln e iθ) = iθ 3) near ξ =. A numerical scheme of order p will instead lead to ξθ)=iθ + c p iθ) p+ + d p iθ) p+ + O iθ) p+3) 4) for some constants c p and d p. The sign of the first real term in the expansion 4) will dictate whether the stability domain boundary near the origin swings to the right or to the left of the imaginary axis. For example, AB has the expansion ξθ) = iθ + 5 iθ)3 4 iθ)4 +...; because the sign of the first real term in this expansion is negative, the ISB of AB is zero. AB3 has the expansion ξθ)=iθ+ 3 8 iθ)4 +...; because the sign of the first real term in this expansion is positive, the ISB of AB is positive. See Figure for an illustration comparing the stability domains of AB which has a zero ISB) and AB3 which has an ISB of 5.74.).8 a).8 b).6.6.4.4.. Imξ ) Imξ )...4.4.6.6.8.... Reξ ).8.... Reξ ) Fig. Shown are portions of the boundaries of the stability regions for a) AB and b) AB3. The solid line marks the presently relevant section of the stability domain boundary near the origin; the stability regions consist of the regions to the left of the boundary. Both graphs show that ξ iθ near ξ =. When the first real term in 4) is negative, the ISB is. b) When the first real term in 4) is positive, the ISB is nonzero. The intercepts of AB and AB3 on the negative real axis are and 6, respectively.

4 M. Ghrist, B. Fornberg, and J. Reeger. Backward difference forms of AB and AM methods In [8, pp. 9-95], Henrici gave a backward difference representation of ) for AB and AM methods. When applied to ), an m-step AB method can be represented by where m y = y + hλ γ k k y, 5) k= γ k = ) k Similarly, an m-step AM method can be represented by where y = y + hλ γ k = )k Henrici [8, p. 95] also established that k j= m k= ) s ds. 6) k γ k k y, 7) ) s+ ds. 8) k γ j = γ k, 9) from which γ k = γ k γ k. ) Lemma. For all integers k, γ k <. For all integers k, γ k >. For all integers k 3, γ k > k. Proof Evaluating 8) directly gives γ = and γ =. For the general case when k, we rewrite 8) to find γ k = k! The integrand is negative for <s<, so γk < for k. We next note that an alternate way to express 6) is γ k = k! s )ss+)s+)...s+k )ds. ) ss+)s+)...s+k ) ds. ) Direct evaluation of ) gives γ =, γ =, γ = 5, and γ 3 = 8 3 > 3. We now prove the last part of the lemma via induction. We assume that γ j > j for some j 3 and seek to establish that γ j+ > j+. From ), γ j+ = ss+)s+)...s+ j ) j! ) ) ) s+ j j j ds> γ j > j+ j+ j+ j = j+. Thus γ k > k by induction for all integers k 3, and γ k > for all integers k. Table gives the first six values of γ k and γ k.

Stabilty Ordinates of Adams Predictor-Corrector Methods 5 m 3 4 5 γ m 5 3 8 5 7 95 88 γ m 4 9 7 3 6 Table First six values of γ k and γk from ) and ). These results match Tables 5. and 5.4 of [8].. Exact solution Using ξ = λh, the exact solution to ) is yt)=e λt = e ξt/h where, without loss of generality, we have chosen t = and yt )=. For an exact method, ξ = iθ near ξ = from 3), so y n = ynh)=e inθ. 3) An alternate way to view 3) is that we are seeking the exact solution to the relevant difference equation when following the root r that has r= e iθ, which gives y n = r n = e iθ) n = e inθ. We now give a lemma that will help in finding the expansion 4) for general order Adams methods. Lemma. For integers k, when y n = e inθ k y =iθ) k [ k iθ)+o iθ) )], 4) and k y =iθ) k [ + k iθ)+o iθ) )]. 5) For integers M, when y n = e inθ, M k= γ k k y = + iθ)+o iθ) ) 6) and M k= γ k k y = + iθ)+o iθ) ). 7) Proof For y n = e inθ, y = e iθ) and k y = e iθ) k so that [ k y = + iθ)+! iθ) + O iθ) 3))] k [ = iθ) k k iθ) iθ)+o )], establishing 4). For y n = e inθ, k y = e iθ k y. Multiplying 4) by e iθ = +iθ+... gives 5).

6 M. Ghrist, B. Fornberg, and J. Reeger Using 4), we find M k= γ k k y = M k= = γ [+O γ k iθ) k [ k iθ)+o iθ) )] iθ) )] + γ iθ)[+oiθ)]+o iθ) ) = + iθ + O iθ) ), where we have used γ = and γ = in the last step. This establishes 6). A similar expansion using 5), γ =, and γ = gives 7). In the next section, we apply these results to obtain the expansion 4) for general ABp and AMp methods. In Section 4, we apply these results to obtain the expansion 4) for general ABp-AMp methods and ABp )-AMp methods. 3 Revisiting stability ordinates for AB and AM methods We now apply the backward difference forms of the Adams methods to consider the ISB s of general AB and AM methods, thereby giving an alternate proof to [4]. Theorem 3. AB methods have nonzero ISB s only for orders p = 3, 4, 7, 8,... Proof We first note that it is well known that the ISB for AB Euler s method) is zero see, for example []). One can also check the expansion; AB has an expansion of ξ = e iθ = iθ + iθ) +..., which has a negative first real term, confirming that the ISB for AB is zero. We now proceed with the general case for p. For AB methods, we will show that c p > and d p < for all orders p, where c p and d p are defined by 4). The pattern for which methods have nonzero ISB s then follows from the powers of the imaginary unit in 4). For example, for p = 3, the first real term in the expansion 4) is c 3 iθ) 4 = c 3 θ 4 >. Thus the boundary of the stability domain of AB3 swings to the right of the imaginary axis near the origin, and we have a nonzero ISB for this method, as seen in Figure b. For p = 6, the first real term in the expansion 4) is d 6 iθ) 8 = d 6 θ) 8 < ; thus the stability domain boundary of AB6 swings to the left of the imaginary axis near the origin, and the ISB of this method is zero. We seek to find the values of c p and d p in the case of a general ABp method. We apply 3) to 5), using ξ = λh to find e iθ m = +ξ γ k k y. 8) As m, the AB method 5) reproduces the exact solution. Thus, using 3), we find Combining 9) and 8) gives e iθ = +iθ k= k= m ξ iθ) γ k k y = iθ γ k k y. k= k m γ k k y. 9)

Stabilty Ordinates of Adams Predictor-Corrector Methods 7 We now substitute for ξ using 4), where the order p=m for AB. Using 4) and 6), we find [ c m iθ) m+ + d m iθ) m+ + O iθ) m+3)][ + iθ) iθ)+o )] = γ m iθ) m+[ m iθ) iθ)+o )] + γ m+ iθ) m+ [+Oiθ)]+O iθ) m+3). Collecting like powers of iθ, we find that c m = γ m and so that c m+ d m = γ m m ) + γ m+ d m = γ m+ m γ m ) m+ c m = γ m+ γ m. ) From Lemma., we have c m = γ m > for integers m. Using this result and ) in ) gives ) m+ d m = γ m+ γ m = m+)! = m+)! ss+)s+) s+m ) [ s+m) m+) ] ds ss+)s+) s+m ) [ m + s ] ds. Because m + s> for m and s, the integrand is positive so that d m < for m. Noting that p = m for AB methods, examining the sign of the first real term in 4) establishes our result that AB methods have nonzero ISB s only for orders p = 3,4, 7,8,,,... Theorem 3. AM methods have nonzero ISB s only for orders p =,, 5, 6, 9,,... Proof We first note that p= Backward Euler) and p= AM) are well-known A-stable methods and thus have nonzero ISB s; one can also check their expansions. AM has an expansion of ξ = e iθ = iθ iθ) +..., which has a positive first real term, indicating that AM has a nonzero ISB. The expansion for AM contains only purely imaginary terms; this is to be expected since the stability domain boundary for AM consists of the entire imaginary axis. We now prove the general result for p 3. We seek to find the values of c p and d p in 4) for a general AMp method. We apply 3) to 7), using ξ = λh to find e iθ = +ξ m k= γ k k y. ) As m, the AM method 7) reproduces the exact solution. Thus, using 3), we find Combining ) and ) gives ξ iθ) e iθ = +iθ m k= k= γ k k y = iθ γ k k y. ) k m+ γ k k y.

8 M. Ghrist, B. Fornberg, and J. Reeger We now substitute for ξ using 4), where the order p=m+ for AM. Using 5) and 7), we find [ c m iθ) m+ + d m iθ) m+3 + O iθ) m+4)][ + iθ) iθ)+o )] [ = γm+iθ) m+ + m iθ)+o iθ) )] + γ m+iθ) m+3 [+Oiθ)]+O iθ) m+4). Collecting like powers of iθ, we find that c m = γm+ and ) m c m+ d m = γm+ γm+. 3) From Lemma., we have c m = γm+ < for m. Using this result and ) in 3) and simplifying gives m d m = γm+ ) γm+ 4) = s )ss+)s+) s+m ) s m ) ds. m+)! Because s ) and s m ) are both negative for < s < and m, the integrand is positive for m. Therefore d m > and c m < for AM methods, exactly opposite the result for AB methods. After examining the sign of the first real term in 4) and noting that p=m+ for AM methods, we conclude that Adams-Moulton methods have nonzero ISB s only for orders p=,, 5,6, 9,,... 4 Stability ordinates of Adams predictor-corrector methods We now examine two different categories of Adams predictor-corrector methods: ABp- AMp methods and ABp )-AMp methods. 4. Two examples We first consider two examples, AB-AM and AB-AM. The predictor AB is given by and the predictor AB is given by In both cases, the corrector AM is given by y P = y + h f t,y ), 5) y P = y + h 3 f t,y ) f t,y )). 6) y = y + h f t,y P ) + f t,y ) ). 7) We first consider AB-AM. Using 5), substituting ft,y) = λy = ξ h y, and letting y k = r k to solve the resulting difference equation, we find that 7) becomes r=+ ξ+ξ)+ ξ. 8)

Stabilty Ordinates of Adams Predictor-Corrector Methods 9 To find the boundary of the stability domain, we follow the root ξ in 8) near ξ = where r =. The stability domain of this method is shown in Figure a). We can also let r=e iθ and do a Taylor expansion for ξθ) in 8) to find that ξ = iθ + 6 iθ)3 8 iθ)4 +... 9) Because the first real term in this expansion is negative, AB-AM has a zero ISB. We next consider AB-AM. Using 6) and 7), we find that the analogous equation to 8) is r = r+ ξ r+ ξ 3r ) )+ ξ r, which leads to the expansion ξ = iθ iθ)3 + 4 iθ)4 +... 3) Since the first real term in this expansion is positive, AB-AM has a nonzero ISB approximately.9). The stability domain of this method is shown in Figure b). a) b).5.5.5.5 Imξ ) Imξ ).5.5.5.5.5.5 Reξ ).5.5 Reξ ) Fig. Shown are the boundaries of the stability regions for a) AB-AM and b) AB-AM. The stability regions consist of the inside of these curves. For b), the ISB is approximately.9. The intercept on the negative real axis is for both methods. 4. General order predictor-corrector methods In general, from 5), our AB predictor will take the form y P = y + ξ M k= γ k k y 3) where M = m for ABp )-AMp methods and M = m for ABp-AMp methods; both methods have order p = m+. The general form of the AM corrector method is given by

M. Ghrist, B. Fornberg, and J. Reeger 7), where we replace all instances of y on the right-hand side by y P after the backward difference operations are done. This leads to y = y + ξ = y + ξ m j= m j= γ k k y + ξγ + γ + γ m) y P y ) γ k k y + ξ γ m y P y ), where we have used 9) in the last step. We use 3) to substitute for y P in 3) and then use the exact solution 3) to find e iθ = +ξ m j= γ k k y + ξ γ m e iθ + ξ M k= 3) γ k k y ). 33) We now use the exact AM and AB expressions ) and 9) to substitute for the two instances of e iθ in 33) respectively. Simplifying gives = ξ iθ) m ) k=γ k k y iθ k m+ M ) k k=γ k y + ξ γ m [ξ iθ) γ k k y iθ k M+ γ k k y ], where M = m for ABp )-AMp methods and M = m for ABp-AMp methods. Applying Lemma. gives = ξ iθ) + iθ + O iθ) )) iθ γk [iθ) k + k )] iθ)+ k m+ +ξ γ m [ξ iθ)+oiθ)) iθ γ k iθ) k k iθ) k M+ iθ)+o ))]. This formula permits us to compute the expansion of the boundary of the stability region ξθ) near the origin for the two Adams predictor-corrector methods of present interest. We first consider general ABp-AMp methods, which have order p. Theorem 4. Predictor-corrector ABp-AMp methods have nonzero ISB s only for orders p=,, 5,6, 9,,... Proof Our general proof will require p 3. For p=, we can find that the series expansion for the combination of forward Euler predictor and backward Euler correction is ξ = iθ iθ) +. Because this has a positive first real term, AB-AM also has a nonzero ISB. For p=, we have already established that AB-AM has a nonzero ISB via 3); also see Figure b). We let M = m in 34) and substitute 4), using p=m+ to find = c m iθ) m+ + d m iθ) + ) m+3 + iθ ) + γ miθ + ) iθ γk iθ)k k ) k m+ iθ)+ 35) iθ) γ m γ k iθ) k k iθ)+ )+, k m+ 34)

Stabilty Ordinates of Adams Predictor-Corrector Methods where we have kept only the terms that are needed to find the dominant terms in this expression. Examining the coefficients of theiθ) m+ andiθ) m+3 terms in 35) gives: and c m = γ m+ 36) ) d m = γm+ γm+ m + γ m γ m+ c m + γ m. 37) From Lemma.), we know that c m < for m. Simplifying 37) using 36) and ) gives d m = γ m+ m γ m++ γ m. From 4), we know that γm+ m γ m+ > for m, so we have d m > for m. Thus c m < and d m > for m where p = m+. After examining the sign of the first real term in 4) for this case, we conclude that ABp-AMp methods have nonzero ISB s only for orders p =,, 5, 6, 9,,..., a result identical to AMp methods. Figure 3 shows the stability domains of ABp )-AMp and ABp-AMp methods near the origin..5.5.5 a) Stability domains AB AM AB AM3 AB3 AM4 AB4 AM5.5 b) Detail from subplot a) AB AM3 AB3 AM4 AB4 AM5 Imξ) Imξ).5 AB AM.5.5.5 Reξ).... Reξ) Fig. 3 a) Shown are the relevant portions of the boundaries of the stability regions for ABp )-AMp methods; the stability domain consists of the interior of each curve. b) The detail splot shows that AB-AM3 and AB3-AM4 are the only methods shown with nonzero ISB. While the stability domain for AB4-AM5 does include part of the first quadrant, the boundary initially swings into the second quadrant, reflecting a zero ISB. We now examine general ABp )-AMp methods, which also have order p=m+.

M. Ghrist, B. Fornberg, and J. Reeger Theorem 4. Predictor-corrector ABp )-AMp methods have nonzero ISB s only for orders p=3,4, 7,8,... Proof Our general proof will require p 3. For p =, we have already established that AB-AM has a zero ISB via 9); also see Figure a). We now proceed with the general case for p 3. We let M= m in 34) and substitute 4), using p=m+ to find = c m iθ) m+ + d m iθ) + ) m+3 + iθ ) + γ miθ + ) iθ γk iθ)k k ) k m+ iθ)+ 38) iθ) γ m γ k iθ) k k k m iθ)+ )+, where we have kept only the terms that are needed to find the dominant terms in this expression. Examining the coefficients of theiθ) m+ andiθ) m+3 terms in 38) gives c m = γ m++ γ m 39) and m d m = γm+ )γ m++ γ m γ m+ m ) ) γ m c m + γ m. 4) We claim that c m < and d m > for m. From 39), 4), and Table, we compute c = 88 39 and d = 536 65. From Lemma., we have γ m > m for m 3. Applying this, ), and ) to 39) and simplifying gives c m > γ m++ m γ m = mm+)! ms+)ss+)s+)...s+m )ds> for m 3 because the integrand is positive. We now consider the expression for d m in 4). We substitute for c m from 39), apply 9) and results from Lemma., and simplify to find d m = γm+ m ) m γ m++ γ m γm 3 < γm+ m ) m γm γ m++ m = ss+)...s+m ) [ +m m ) + ms s m )] ds mm+)! for m 3, where we have used ) and ) in the last step. Bacause +m m ) and s m ) are both negative for < s < and m 3, the integrand is negative and thus d m < for m 3 for ABp-AMp methods. Thus c m > and d m < for m 3 where p=m+. After examining the sign of the first real term in 4), we conclude that ABp )- AMp methods have nonzero ISB s only for orders p = 3,4, 7,8,..., a result identical to ABp methods. Figure 4 show the stability domains of ABp )-AMp and ABp-AMp methods near the origin. Our results are summarized along with other relevant results from [4] in Table. In Section 5, we present a test that both confirms our results and shows the practical significance of our results when solving wave equations.

Stabilty Ordinates of Adams Predictor-Corrector Methods 3 a) Stability domains.4 b) Detail from subplot a) AB AM.5. AB3 AM3.5 AB AM.8 AB4 AM4 Imξ).5 AB AM AB4 AM4 Imξ).6 AB3 AM3.4 AB AM.5..5.5 Reξ).... Reξ) Fig. 4 a) Shown are relevant portions of the boundaries of the stability regions for ABp-AMp methods; the stability domain consists of the interior of each curve. b) AB-AM and AB-AM are the only methods shown which have nonzero ISB. While the stability domain for AB3-AM3 does include part of the first quadrant, the boundary initially swings into the second quadrant, reflecting a zero ISB; the enlarged figure b) does not have enough resolution to see this but further enlargements do. Method Orders Formula where k Z + ) AB 3,4, 7,8,... {4k,4k} AM,, 5,6,... {4k 3,4k } Staggered AB,3,4, 7,8,... {} {4k,4k} ABp-AMp,, 5,6,... {4k,4k } ABp )-AMp 3,4, 7,8,... {4k,4k} Table Summary of results of orders for which various methods have nonzero stability ordinates 5 Illustration via application to the D wave equation In this section, we perform analysis that both confirms our results and shows their practical significance when solving wave equations. Dahlquist s equivalence theorem [9, pp. 4-5] tells that a multistep method is convergent if and only if the method is of order p and the generating polynomial ρr) of the method obeys the root condition, that is if all roots of ρr) satisfy r and all roots with r = are simple. For a fixed number of ODEs, this assures that numerical solutions will converge to analytic solutions as the time step t approaches ; this is true for all of the relevant methods that we have considered: ABp, AMp, ABp-AMp, and ABp )-AMp. Consider next the one-dimensional wave equation u t + u x =, 4)

4 M. Ghrist, B. Fornberg, and J. Reeger which has a purely imaginary spectrum. If we advance 4) on the periodic interval π x π from t = to t = π, the analytic solution ux,t) = ux t,) completes five full periods. As is typical when time-stepping a wave equation, we let the mesh aspect ratio x t stay constant as we refine in both x and t. Let N be the number of equispaced node points in the x-direction. The key difference between solving 4) and solving an ODE or a system of ODEs) is that, when we refine in the t-direction with the ratio x t held fixed, the number of ODEs N will simultaneously increase, making the root condition no longer applicable for establishing convergence. Thus, we will consider an alternative analysis which is designed to illustrate the convergence properties of the methods of present interest. An arbitrary initial condition ux,) can be decomposed into Fourier modes e iωx, with x π ω x π. When N is increased, more and more Fourier modes can be represented in the x-direction. Analytically, each mode should remain of unchanged amplitude as time increases; instability presents itself when there is no upper bound on how large a mode can become even after a finite time. Let Rω,N, x t ) be the ratio of the amplitude of a given mode of frequency ω at time t = π to its amplitude at t =. Figure 5 shows max ω Rω,N, x t ), i.e., the amplitude change factor for the fastest growing mode out of all present Fourier modes for the first six ABp )-AMp methods, which was implemented in MATLAB. Ideally, the surfaces should be perfectly flat at value as this is a log-log graph), reflecting no growth. We see this to be the case for AB-AM3, AB3-AM4, and AB6-AM7 whenever the ratio x t is below certain constants, as expected. However, no non-zero value for the ratio x t can salvage AB-AM, AB4-AM5, or AB5- AM6 from disastrous spurious growth in the solution under refinement. The surfaces are truncated at the level maxr= 6 ; this level was chosen because even modes that are theoretically absent but are actually present at a level of O 6 ) due to machine precision) will then have grown to size O). Further simulations show similar behavior for the first six ABp-AMp methods: convergence for AB-AM, AB-AM, AB5-AM5, and AB6-AM6 whenever the ratio x t is below certain constants, and disastrous growth for AB3-AM3 and AB4-AM4 for all values of the ratio t x, thus confirming our observations in Figure 4. 6 Conclusions We have considered the question of when Adams methods of general order p have nonzero stability ordinates ISB s). By applying the backward difference formulation of the AB and AM methods [8], we have proven that ABp-AMp methods have nonzero stability ordinates only for p =,, 5,6, 9,,..., which matches AMp methods. We have also shown that ABp )-AMp methods have nonzero stability ordinates only for p = 3, 4, 7, 8,,,..., which matches ABp methods. Discovering intuitive heuristic motivations for these patterns remains an open challenge. While a method having nonzero ISM versus zero ISB does not affect convergence for a system of a fixed number of ODEs, we have illustrated that this makes the difference between stability and disastrous instability when applied to wave-type PDEs. These results are immediately relevant to the non-stiff problems that arise for many important wave equations such as Maxwell s equations, acoustic e.g., ultrasound) modeling, and elastic e.g., seismic exploration) modeling. For nonlinear PDEs, linearized stability is normally required, and the present results are therefore again applicable.

Stabilty Ordinates of Adams Predictor-Corrector Methods 5 AB AM AB AM3 log max R) 6 4 log N..4 t/ x log max R) 6 4 log N..4.6 t/ x AB3 AM4 AB4 AM5 log max R) 6 4 log N..4 t/ x log max R) 6 4 log N..4.6 t/ x AB5 AM6 AB6 AM7 log max R) 6 4 log N..4 t/ x log max R) 6 4 log N..4.6 t/ x Fig. 5 Shown are the largest amplitude growth factors of any Fourier mode in the test problem 4) when advancing from t = to t = π using the first six ABp )-AMp methods, as a function of N the number of nodes in the x-direction across [ π,π]) and the mesh aspect ratio x t. The surfaces are truncated at the level maxr= 6. Acknowledgements The authors are extremely grateful to Ernst Hairer for suggesting major simplifications in a previous form of this manuscript, in particular with regard to using the backward difference forms of AB and AM methods. We are also grateful for helpful comments from the referees that allowed us to improve our manuscript. References. Atkinson, K.: An Introduction to Numerical Analysis. Wiley, New York 989). Fornberg, B.: A Practical Guide to Pseudospectral Methods. Cambridge University Press, Cambridge 996) 3. Ghrist, M: High-order Finite Difference Methods for Wave Equations. Ph.D. thesis, Department of Applied Mathematics, University of Colorado-Boulder, Boulder, CO ) 4. Ghrist, M., Fornberg, B., Driscoll, T.A.: Staggered time integrators for wave equations, SIAM J. Num. Anal., 38, 78 74 ) 5. Ghrist, M. and Fornberg, B.: Two results concerning the stability of staggered multistep methods, SIAM J. Num. Anal., 5, 849 86 ) 6. Hairer, E., Nørsett, S.P., Wanner, G.: Solving Ordinary Differential Equations I, Springer-Verlag, Berlin 99)

6 M. Ghrist, B. Fornberg, and J. Reeger 7. Hairer, E., Wanner, G.: Solving Ordinary Differential Equations II, nd edn., Springer-Verlag, Berlin 996) 8. Henrici, P.: Discrete Variable Methods in Ordinary Differential Equations. John Wiley & Sons, New York 96) 9. Iserles, A.: Numerical Analysis of Differential Equations. Cambridge University Press, Cambridge 996). Jeltsch, R.: A necessary condition for A-Stability of multistep multiderivative methods, Math. Comp., 3, 739 746 976)