Stability Ordinates of Adams Predictor-Corrector Methods

Size: px
Start display at page:

Download "Stability Ordinates of Adams Predictor-Corrector Methods"

Transcription

1 BIT manuscript No. will be inserted by the editor) Stability Ordinates of Adams Predictor-Corrector Methods Michelle L. Ghrist Bengt Fornberg Jonah A. Reeger Received: date / Accepted: date Abstract How far the stability domain of a numerical method for approximating solutions to differential equations extends along the imaginary axis indicates how useful the method is for approximating solutions to wave equations; this maximum extent is termed the imaginary stability boundary, also known as the stability ordinate. It has previously been shown that exactly half of Adams-Bashforth AB), Adams-Moulton AM), and staggered Adams- Bashforth methods have nonzero stability ordinates. In this paper, we consider two categories of Adams predictor-corrector methods and prove that they follow a similar pattern. In particular, if p is the order of the method, ABp-AMp methods have nonzero stability ordinate only for p =,, 5, 6, 9,,..., and ABp )-AMp methods have nonzero stability ordinates only for p=3,4, 7,8,,,... Keywords Adams methods Predictor-corrector Imaginary stability boundary Linear multistep methods Finite difference methods Stability region Stability ordinate Mathematics Subject Classification ) 65L6 65L 65L 65M6 65M Introduction When wave equations are posed as first-order systems and discretized in space to yield a system of ordinary differential equations ODEs), a purely imaginary spectrum will correspond to the fact that only propagation takes place. Many classical numerical methods for Support for M. Ghrist and J. Reeger provided by the United States Air Force. Support for B. Fornberg provided by NSF DMS Michelle Ghrist Department of Mathematical Sciences, United States Air Force Academy, USAF Academy, CO 884, USA michelle.ghrist@usafa.edu Bengt Fornberg Department of Applied Mathematics, Campus Box 56, University of Colorado, Boulder, CO 839, USA fornberg@colorado.edu Jonah Reeger Air Force Institute of Technology, 95 Hobson Way, WPAFB, OH 45433, USA jonah.reeger@afit.edu

2 M. Ghrist, B. Fornberg, and J. Reeger ODEs have stability regions that include an interval of the form[ is I,iS I ] on the imaginary axis. We call the largest such value of S I the imaginary stability boundary ISB) of the ODE integrator, which is also known as the stability ordinate. In the context of solving semidiscrete wave equations, one desires to use a method with a large ISB, which allows larger stable time steps; methods with zero ISB s i.e., no imaginary axis coverage in the stability domain) will be unconditionally unstable. In this paper, we explore the question of which Adams methods have nonzero ISB s. Adams-Bashforth AB), Adams-Moulton AM), and Adams predictor-corrector methods are widely used multistep methods for approximating solutions to first-order differential equations. In general, these methods maintain reasonably good accuracy and stability properties and have lower computational costs than equivalent-order Runge Kutta methods; AB and AM methods require only one new function evaluation per time step, while predictorcorrector methods require two function evaluations [],[6],[7],[9]. A standard m-step Adams method for approximating solutions to dy dt = ft,y) has the form t j+ y j+ = y j + qt)dt, ) t j where t j = t + jh, h is the stepsize, and y = yt ). Here, qt) is the polynomial interpolating the pointst k,y k ) for j m+ k j AB methods) or j m+ k j+ AM methods). We will henceforth use j= to simplify the notation. AB methods have order p=m while AM methods have order p=m+. For staggered AB methods, qt) in ) interpolates at t k+/,y k+/ ) for j m+ k j; like AB methods, these methods have order p = m. For a given order of accuracy, staggered multistep methods have about ten times less local truncation error and stability domains that extend approximately -8 times as far on the imaginary axis when compared to their nonstaggered counterparts [4]. This improved accuracy and stability with no additional computational or storage cost makes such methods ideal when they can be applied; their main use is in approximating solutions to linear wave equations, which can be formulated with a grid which is staggered in space and/or time. For broader studies of staggered methods to include more general multistep and Runge Kutta methods), see [4], [5]. In [, Table G.3-], it was observed without proof) that AB methods of order p ABp) have nonzero ISB s only for orders p=3,4, 7,8,,,... and AMp methods have nonzero ISB s only for orders p=,, 5,6, 9,,... These results can be deduced from [] and were independently shown in [3] and [4]. While [] is not applicable to staggered methods, [3] and [4] proved that staggered AB methods of order p have nonzero ISB s only for p=,3,4, 7,8,,,..., ; none of the aforementioned articles addressed Adams predictorcorrector methods. Henceforth, we will only consider nonstaggered methods. This study revisits our previous results from [4] with a new formulation and then extends our results to Adams predictor-corrector methods. In particular, we examine the most commonly used Adams predictor-corrector methods ABp-AMp and ABp )-AMp, both of which have order p. We are unaware of any other studies addressing the ISB s of such methods for general order p. In [, Table G.3-], it was claimed that for such methods, most had nonzero ISB s while some had zero ISB s. We now proceed with proving that such methods follow very similar patterns to those of AB and AM methods, with ABp-AMp methods following the same pattern as AMp methods and ABp )-AMp methods following the same pattern as ABp methods. We then offer an application illustrating the significance of these results.

3 Stabilty Ordinates of Adams Predictor-Corrector Methods 3 Preliminary Results When solving Dahlquist s linear test problem dy dt = λy, ) the edge of a stability domain is described by the root ξ = λh of ρr) ξ σr)= when r travels around the unit circle r=e iθ. Here, ρr) and σr) are the generating polynomials of the method see, e.g., [9, p. 7]). To consider whether or not a stability domain has imaginary axis coverage, we wish to describe the behavior of the stability domain boundary near ξ =. For an exact method, we have ξθ)=lnr see, e.g., [9, Theorem.], using ξ = ρr).) Thus the stability boundary of an exact method satisfies σr) ξ = lnr=ln e iθ) = iθ 3) near ξ =. A numerical scheme of order p will instead lead to ξθ)=iθ + c p iθ) p+ + d p iθ) p+ + O iθ) p+3) 4) for some constants c p and d p. The sign of the first real term in the expansion 4) will dictate whether the stability domain boundary near the origin swings to the right or to the left of the imaginary axis. For example, AB has the expansion ξθ) = iθ + 5 iθ)3 4 iθ)4 +...; because the sign of the first real term in this expansion is negative, the ISB of AB is zero. AB3 has the expansion ξθ)=iθ+ 3 8 iθ)4 +...; because the sign of the first real term in this expansion is positive, the ISB of AB is positive. See Figure for an illustration comparing the stability domains of AB which has a zero ISB) and AB3 which has an ISB of 5.74.).8 a).8 b) Imξ ) Imξ ) Reξ ) Reξ ) Fig. Shown are portions of the boundaries of the stability regions for a) AB and b) AB3. The solid line marks the presently relevant section of the stability domain boundary near the origin; the stability regions consist of the regions to the left of the boundary. Both graphs show that ξ iθ near ξ =. When the first real term in 4) is negative, the ISB is. b) When the first real term in 4) is positive, the ISB is nonzero. The intercepts of AB and AB3 on the negative real axis are and 6, respectively.

4 4 M. Ghrist, B. Fornberg, and J. Reeger. Backward difference forms of AB and AM methods In [8, pp. 9-95], Henrici gave a backward difference representation of ) for AB and AM methods. When applied to ), an m-step AB method can be represented by where m y = y + hλ γ k k y, 5) k= γ k = ) k Similarly, an m-step AM method can be represented by where y = y + hλ γ k = )k Henrici [8, p. 95] also established that k j= m k= ) s ds. 6) k γ k k y, 7) ) s+ ds. 8) k γ j = γ k, 9) from which γ k = γ k γ k. ) Lemma. For all integers k, γ k <. For all integers k, γ k >. For all integers k 3, γ k > k. Proof Evaluating 8) directly gives γ = and γ =. For the general case when k, we rewrite 8) to find γ k = k! The integrand is negative for <s<, so γk < for k. We next note that an alternate way to express 6) is γ k = k! s )ss+)s+)...s+k )ds. ) ss+)s+)...s+k ) ds. ) Direct evaluation of ) gives γ =, γ =, γ = 5, and γ 3 = 8 3 > 3. We now prove the last part of the lemma via induction. We assume that γ j > j for some j 3 and seek to establish that γ j+ > j+. From ), γ j+ = ss+)s+)...s+ j ) j! ) ) ) s+ j j j ds> γ j > j+ j+ j+ j = j+. Thus γ k > k by induction for all integers k 3, and γ k > for all integers k. Table gives the first six values of γ k and γ k.

5 Stabilty Ordinates of Adams Predictor-Corrector Methods 5 m γ m γ m Table First six values of γ k and γk from ) and ). These results match Tables 5. and 5.4 of [8].. Exact solution Using ξ = λh, the exact solution to ) is yt)=e λt = e ξt/h where, without loss of generality, we have chosen t = and yt )=. For an exact method, ξ = iθ near ξ = from 3), so y n = ynh)=e inθ. 3) An alternate way to view 3) is that we are seeking the exact solution to the relevant difference equation when following the root r that has r= e iθ, which gives y n = r n = e iθ) n = e inθ. We now give a lemma that will help in finding the expansion 4) for general order Adams methods. Lemma. For integers k, when y n = e inθ k y =iθ) k [ k iθ)+o iθ) )], 4) and k y =iθ) k [ + k iθ)+o iθ) )]. 5) For integers M, when y n = e inθ, M k= γ k k y = + iθ)+o iθ) ) 6) and M k= γ k k y = + iθ)+o iθ) ). 7) Proof For y n = e inθ, y = e iθ) and k y = e iθ) k so that [ k y = + iθ)+! iθ) + O iθ) 3))] k [ = iθ) k k iθ) iθ)+o )], establishing 4). For y n = e inθ, k y = e iθ k y. Multiplying 4) by e iθ = +iθ+... gives 5).

6 6 M. Ghrist, B. Fornberg, and J. Reeger Using 4), we find M k= γ k k y = M k= = γ [+O γ k iθ) k [ k iθ)+o iθ) )] iθ) )] + γ iθ)[+oiθ)]+o iθ) ) = + iθ + O iθ) ), where we have used γ = and γ = in the last step. This establishes 6). A similar expansion using 5), γ =, and γ = gives 7). In the next section, we apply these results to obtain the expansion 4) for general ABp and AMp methods. In Section 4, we apply these results to obtain the expansion 4) for general ABp-AMp methods and ABp )-AMp methods. 3 Revisiting stability ordinates for AB and AM methods We now apply the backward difference forms of the Adams methods to consider the ISB s of general AB and AM methods, thereby giving an alternate proof to [4]. Theorem 3. AB methods have nonzero ISB s only for orders p = 3, 4, 7, 8,... Proof We first note that it is well known that the ISB for AB Euler s method) is zero see, for example []). One can also check the expansion; AB has an expansion of ξ = e iθ = iθ + iθ) +..., which has a negative first real term, confirming that the ISB for AB is zero. We now proceed with the general case for p. For AB methods, we will show that c p > and d p < for all orders p, where c p and d p are defined by 4). The pattern for which methods have nonzero ISB s then follows from the powers of the imaginary unit in 4). For example, for p = 3, the first real term in the expansion 4) is c 3 iθ) 4 = c 3 θ 4 >. Thus the boundary of the stability domain of AB3 swings to the right of the imaginary axis near the origin, and we have a nonzero ISB for this method, as seen in Figure b. For p = 6, the first real term in the expansion 4) is d 6 iθ) 8 = d 6 θ) 8 < ; thus the stability domain boundary of AB6 swings to the left of the imaginary axis near the origin, and the ISB of this method is zero. We seek to find the values of c p and d p in the case of a general ABp method. We apply 3) to 5), using ξ = λh to find e iθ m = +ξ γ k k y. 8) As m, the AB method 5) reproduces the exact solution. Thus, using 3), we find Combining 9) and 8) gives e iθ = +iθ k= k= m ξ iθ) γ k k y = iθ γ k k y. k= k m γ k k y. 9)

7 Stabilty Ordinates of Adams Predictor-Corrector Methods 7 We now substitute for ξ using 4), where the order p=m for AB. Using 4) and 6), we find [ c m iθ) m+ + d m iθ) m+ + O iθ) m+3)][ + iθ) iθ)+o )] = γ m iθ) m+[ m iθ) iθ)+o )] + γ m+ iθ) m+ [+Oiθ)]+O iθ) m+3). Collecting like powers of iθ, we find that c m = γ m and so that c m+ d m = γ m m ) + γ m+ d m = γ m+ m γ m ) m+ c m = γ m+ γ m. ) From Lemma., we have c m = γ m > for integers m. Using this result and ) in ) gives ) m+ d m = γ m+ γ m = m+)! = m+)! ss+)s+) s+m ) [ s+m) m+) ] ds ss+)s+) s+m ) [ m + s ] ds. Because m + s> for m and s, the integrand is positive so that d m < for m. Noting that p = m for AB methods, examining the sign of the first real term in 4) establishes our result that AB methods have nonzero ISB s only for orders p = 3,4, 7,8,,,... Theorem 3. AM methods have nonzero ISB s only for orders p =,, 5, 6, 9,,... Proof We first note that p= Backward Euler) and p= AM) are well-known A-stable methods and thus have nonzero ISB s; one can also check their expansions. AM has an expansion of ξ = e iθ = iθ iθ) +..., which has a positive first real term, indicating that AM has a nonzero ISB. The expansion for AM contains only purely imaginary terms; this is to be expected since the stability domain boundary for AM consists of the entire imaginary axis. We now prove the general result for p 3. We seek to find the values of c p and d p in 4) for a general AMp method. We apply 3) to 7), using ξ = λh to find e iθ = +ξ m k= γ k k y. ) As m, the AM method 7) reproduces the exact solution. Thus, using 3), we find Combining ) and ) gives ξ iθ) e iθ = +iθ m k= k= γ k k y = iθ γ k k y. ) k m+ γ k k y.

8 8 M. Ghrist, B. Fornberg, and J. Reeger We now substitute for ξ using 4), where the order p=m+ for AM. Using 5) and 7), we find [ c m iθ) m+ + d m iθ) m+3 + O iθ) m+4)][ + iθ) iθ)+o )] [ = γm+iθ) m+ + m iθ)+o iθ) )] + γ m+iθ) m+3 [+Oiθ)]+O iθ) m+4). Collecting like powers of iθ, we find that c m = γm+ and ) m c m+ d m = γm+ γm+. 3) From Lemma., we have c m = γm+ < for m. Using this result and ) in 3) and simplifying gives m d m = γm+ ) γm+ 4) = s )ss+)s+) s+m ) s m ) ds. m+)! Because s ) and s m ) are both negative for < s < and m, the integrand is positive for m. Therefore d m > and c m < for AM methods, exactly opposite the result for AB methods. After examining the sign of the first real term in 4) and noting that p=m+ for AM methods, we conclude that Adams-Moulton methods have nonzero ISB s only for orders p=,, 5,6, 9,,... 4 Stability ordinates of Adams predictor-corrector methods We now examine two different categories of Adams predictor-corrector methods: ABp- AMp methods and ABp )-AMp methods. 4. Two examples We first consider two examples, AB-AM and AB-AM. The predictor AB is given by and the predictor AB is given by In both cases, the corrector AM is given by y P = y + h f t,y ), 5) y P = y + h 3 f t,y ) f t,y )). 6) y = y + h f t,y P ) + f t,y ) ). 7) We first consider AB-AM. Using 5), substituting ft,y) = λy = ξ h y, and letting y k = r k to solve the resulting difference equation, we find that 7) becomes r=+ ξ+ξ)+ ξ. 8)

9 Stabilty Ordinates of Adams Predictor-Corrector Methods 9 To find the boundary of the stability domain, we follow the root ξ in 8) near ξ = where r =. The stability domain of this method is shown in Figure a). We can also let r=e iθ and do a Taylor expansion for ξθ) in 8) to find that ξ = iθ + 6 iθ)3 8 iθ) ) Because the first real term in this expansion is negative, AB-AM has a zero ISB. We next consider AB-AM. Using 6) and 7), we find that the analogous equation to 8) is r = r+ ξ r+ ξ 3r ) )+ ξ r, which leads to the expansion ξ = iθ iθ)3 + 4 iθ) ) Since the first real term in this expansion is positive, AB-AM has a nonzero ISB approximately.9). The stability domain of this method is shown in Figure b). a) b) Imξ ) Imξ ) Reξ ).5.5 Reξ ) Fig. Shown are the boundaries of the stability regions for a) AB-AM and b) AB-AM. The stability regions consist of the inside of these curves. For b), the ISB is approximately.9. The intercept on the negative real axis is for both methods. 4. General order predictor-corrector methods In general, from 5), our AB predictor will take the form y P = y + ξ M k= γ k k y 3) where M = m for ABp )-AMp methods and M = m for ABp-AMp methods; both methods have order p = m+. The general form of the AM corrector method is given by

10 M. Ghrist, B. Fornberg, and J. Reeger 7), where we replace all instances of y on the right-hand side by y P after the backward difference operations are done. This leads to y = y + ξ = y + ξ m j= m j= γ k k y + ξγ + γ + γ m) y P y ) γ k k y + ξ γ m y P y ), where we have used 9) in the last step. We use 3) to substitute for y P in 3) and then use the exact solution 3) to find e iθ = +ξ m j= γ k k y + ξ γ m e iθ + ξ M k= 3) γ k k y ). 33) We now use the exact AM and AB expressions ) and 9) to substitute for the two instances of e iθ in 33) respectively. Simplifying gives = ξ iθ) m ) k=γ k k y iθ k m+ M ) k k=γ k y + ξ γ m [ξ iθ) γ k k y iθ k M+ γ k k y ], where M = m for ABp )-AMp methods and M = m for ABp-AMp methods. Applying Lemma. gives = ξ iθ) + iθ + O iθ) )) iθ γk [iθ) k + k )] iθ)+ k m+ +ξ γ m [ξ iθ)+oiθ)) iθ γ k iθ) k k iθ) k M+ iθ)+o ))]. This formula permits us to compute the expansion of the boundary of the stability region ξθ) near the origin for the two Adams predictor-corrector methods of present interest. We first consider general ABp-AMp methods, which have order p. Theorem 4. Predictor-corrector ABp-AMp methods have nonzero ISB s only for orders p=,, 5,6, 9,,... Proof Our general proof will require p 3. For p=, we can find that the series expansion for the combination of forward Euler predictor and backward Euler correction is ξ = iθ iθ) +. Because this has a positive first real term, AB-AM also has a nonzero ISB. For p=, we have already established that AB-AM has a nonzero ISB via 3); also see Figure b). We let M = m in 34) and substitute 4), using p=m+ to find = c m iθ) m+ + d m iθ) + ) m+3 + iθ ) + γ miθ + ) iθ γk iθ)k k ) k m+ iθ)+ 35) iθ) γ m γ k iθ) k k iθ)+ )+, k m+ 34)

11 Stabilty Ordinates of Adams Predictor-Corrector Methods where we have kept only the terms that are needed to find the dominant terms in this expression. Examining the coefficients of theiθ) m+ andiθ) m+3 terms in 35) gives: and c m = γ m+ 36) ) d m = γm+ γm+ m + γ m γ m+ c m + γ m. 37) From Lemma.), we know that c m < for m. Simplifying 37) using 36) and ) gives d m = γ m+ m γ m++ γ m. From 4), we know that γm+ m γ m+ > for m, so we have d m > for m. Thus c m < and d m > for m where p = m+. After examining the sign of the first real term in 4) for this case, we conclude that ABp-AMp methods have nonzero ISB s only for orders p =,, 5, 6, 9,,..., a result identical to AMp methods. Figure 3 shows the stability domains of ABp )-AMp and ABp-AMp methods near the origin a) Stability domains AB AM AB AM3 AB3 AM4 AB4 AM5.5 b) Detail from subplot a) AB AM3 AB3 AM4 AB4 AM5 Imξ) Imξ).5 AB AM Reξ).... Reξ) Fig. 3 a) Shown are the relevant portions of the boundaries of the stability regions for ABp )-AMp methods; the stability domain consists of the interior of each curve. b) The detail splot shows that AB-AM3 and AB3-AM4 are the only methods shown with nonzero ISB. While the stability domain for AB4-AM5 does include part of the first quadrant, the boundary initially swings into the second quadrant, reflecting a zero ISB. We now examine general ABp )-AMp methods, which also have order p=m+.

12 M. Ghrist, B. Fornberg, and J. Reeger Theorem 4. Predictor-corrector ABp )-AMp methods have nonzero ISB s only for orders p=3,4, 7,8,... Proof Our general proof will require p 3. For p =, we have already established that AB-AM has a zero ISB via 9); also see Figure a). We now proceed with the general case for p 3. We let M= m in 34) and substitute 4), using p=m+ to find = c m iθ) m+ + d m iθ) + ) m+3 + iθ ) + γ miθ + ) iθ γk iθ)k k ) k m+ iθ)+ 38) iθ) γ m γ k iθ) k k k m iθ)+ )+, where we have kept only the terms that are needed to find the dominant terms in this expression. Examining the coefficients of theiθ) m+ andiθ) m+3 terms in 38) gives c m = γ m++ γ m 39) and m d m = γm+ )γ m++ γ m γ m+ m ) ) γ m c m + γ m. 4) We claim that c m < and d m > for m. From 39), 4), and Table, we compute c = and d = From Lemma., we have γ m > m for m 3. Applying this, ), and ) to 39) and simplifying gives c m > γ m++ m γ m = mm+)! ms+)ss+)s+)...s+m )ds> for m 3 because the integrand is positive. We now consider the expression for d m in 4). We substitute for c m from 39), apply 9) and results from Lemma., and simplify to find d m = γm+ m ) m γ m++ γ m γm 3 < γm+ m ) m γm γ m++ m = ss+)...s+m ) [ +m m ) + ms s m )] ds mm+)! for m 3, where we have used ) and ) in the last step. Bacause +m m ) and s m ) are both negative for < s < and m 3, the integrand is negative and thus d m < for m 3 for ABp-AMp methods. Thus c m > and d m < for m 3 where p=m+. After examining the sign of the first real term in 4), we conclude that ABp )- AMp methods have nonzero ISB s only for orders p = 3,4, 7,8,..., a result identical to ABp methods. Figure 4 show the stability domains of ABp )-AMp and ABp-AMp methods near the origin. Our results are summarized along with other relevant results from [4] in Table. In Section 5, we present a test that both confirms our results and shows the practical significance of our results when solving wave equations.

13 Stabilty Ordinates of Adams Predictor-Corrector Methods 3 a) Stability domains.4 b) Detail from subplot a) AB AM.5. AB3 AM3.5 AB AM.8 AB4 AM4 Imξ).5 AB AM AB4 AM4 Imξ).6 AB3 AM3.4 AB AM Reξ).... Reξ) Fig. 4 a) Shown are relevant portions of the boundaries of the stability regions for ABp-AMp methods; the stability domain consists of the interior of each curve. b) AB-AM and AB-AM are the only methods shown which have nonzero ISB. While the stability domain for AB3-AM3 does include part of the first quadrant, the boundary initially swings into the second quadrant, reflecting a zero ISB; the enlarged figure b) does not have enough resolution to see this but further enlargements do. Method Orders Formula where k Z + ) AB 3,4, 7,8,... {4k,4k} AM,, 5,6,... {4k 3,4k } Staggered AB,3,4, 7,8,... {} {4k,4k} ABp-AMp,, 5,6,... {4k,4k } ABp )-AMp 3,4, 7,8,... {4k,4k} Table Summary of results of orders for which various methods have nonzero stability ordinates 5 Illustration via application to the D wave equation In this section, we perform analysis that both confirms our results and shows their practical significance when solving wave equations. Dahlquist s equivalence theorem [9, pp. 4-5] tells that a multistep method is convergent if and only if the method is of order p and the generating polynomial ρr) of the method obeys the root condition, that is if all roots of ρr) satisfy r and all roots with r = are simple. For a fixed number of ODEs, this assures that numerical solutions will converge to analytic solutions as the time step t approaches ; this is true for all of the relevant methods that we have considered: ABp, AMp, ABp-AMp, and ABp )-AMp. Consider next the one-dimensional wave equation u t + u x =, 4)

14 4 M. Ghrist, B. Fornberg, and J. Reeger which has a purely imaginary spectrum. If we advance 4) on the periodic interval π x π from t = to t = π, the analytic solution ux,t) = ux t,) completes five full periods. As is typical when time-stepping a wave equation, we let the mesh aspect ratio x t stay constant as we refine in both x and t. Let N be the number of equispaced node points in the x-direction. The key difference between solving 4) and solving an ODE or a system of ODEs) is that, when we refine in the t-direction with the ratio x t held fixed, the number of ODEs N will simultaneously increase, making the root condition no longer applicable for establishing convergence. Thus, we will consider an alternative analysis which is designed to illustrate the convergence properties of the methods of present interest. An arbitrary initial condition ux,) can be decomposed into Fourier modes e iωx, with x π ω x π. When N is increased, more and more Fourier modes can be represented in the x-direction. Analytically, each mode should remain of unchanged amplitude as time increases; instability presents itself when there is no upper bound on how large a mode can become even after a finite time. Let Rω,N, x t ) be the ratio of the amplitude of a given mode of frequency ω at time t = π to its amplitude at t =. Figure 5 shows max ω Rω,N, x t ), i.e., the amplitude change factor for the fastest growing mode out of all present Fourier modes for the first six ABp )-AMp methods, which was implemented in MATLAB. Ideally, the surfaces should be perfectly flat at value as this is a log-log graph), reflecting no growth. We see this to be the case for AB-AM3, AB3-AM4, and AB6-AM7 whenever the ratio x t is below certain constants, as expected. However, no non-zero value for the ratio x t can salvage AB-AM, AB4-AM5, or AB5- AM6 from disastrous spurious growth in the solution under refinement. The surfaces are truncated at the level maxr= 6 ; this level was chosen because even modes that are theoretically absent but are actually present at a level of O 6 ) due to machine precision) will then have grown to size O). Further simulations show similar behavior for the first six ABp-AMp methods: convergence for AB-AM, AB-AM, AB5-AM5, and AB6-AM6 whenever the ratio x t is below certain constants, and disastrous growth for AB3-AM3 and AB4-AM4 for all values of the ratio t x, thus confirming our observations in Figure 4. 6 Conclusions We have considered the question of when Adams methods of general order p have nonzero stability ordinates ISB s). By applying the backward difference formulation of the AB and AM methods [8], we have proven that ABp-AMp methods have nonzero stability ordinates only for p =,, 5,6, 9,,..., which matches AMp methods. We have also shown that ABp )-AMp methods have nonzero stability ordinates only for p = 3, 4, 7, 8,,,..., which matches ABp methods. Discovering intuitive heuristic motivations for these patterns remains an open challenge. While a method having nonzero ISM versus zero ISB does not affect convergence for a system of a fixed number of ODEs, we have illustrated that this makes the difference between stability and disastrous instability when applied to wave-type PDEs. These results are immediately relevant to the non-stiff problems that arise for many important wave equations such as Maxwell s equations, acoustic e.g., ultrasound) modeling, and elastic e.g., seismic exploration) modeling. For nonlinear PDEs, linearized stability is normally required, and the present results are therefore again applicable.

15 Stabilty Ordinates of Adams Predictor-Corrector Methods 5 AB AM AB AM3 log max R) 6 4 log N..4 t/ x log max R) 6 4 log N..4.6 t/ x AB3 AM4 AB4 AM5 log max R) 6 4 log N..4 t/ x log max R) 6 4 log N..4.6 t/ x AB5 AM6 AB6 AM7 log max R) 6 4 log N..4 t/ x log max R) 6 4 log N..4.6 t/ x Fig. 5 Shown are the largest amplitude growth factors of any Fourier mode in the test problem 4) when advancing from t = to t = π using the first six ABp )-AMp methods, as a function of N the number of nodes in the x-direction across [ π,π]) and the mesh aspect ratio x t. The surfaces are truncated at the level maxr= 6. Acknowledgements The authors are extremely grateful to Ernst Hairer for suggesting major simplifications in a previous form of this manuscript, in particular with regard to using the backward difference forms of AB and AM methods. We are also grateful for helpful comments from the referees that allowed us to improve our manuscript. References. Atkinson, K.: An Introduction to Numerical Analysis. Wiley, New York 989). Fornberg, B.: A Practical Guide to Pseudospectral Methods. Cambridge University Press, Cambridge 996) 3. Ghrist, M: High-order Finite Difference Methods for Wave Equations. Ph.D. thesis, Department of Applied Mathematics, University of Colorado-Boulder, Boulder, CO ) 4. Ghrist, M., Fornberg, B., Driscoll, T.A.: Staggered time integrators for wave equations, SIAM J. Num. Anal., 38, ) 5. Ghrist, M. and Fornberg, B.: Two results concerning the stability of staggered multistep methods, SIAM J. Num. Anal., 5, ) 6. Hairer, E., Nørsett, S.P., Wanner, G.: Solving Ordinary Differential Equations I, Springer-Verlag, Berlin 99)

16 6 M. Ghrist, B. Fornberg, and J. Reeger 7. Hairer, E., Wanner, G.: Solving Ordinary Differential Equations II, nd edn., Springer-Verlag, Berlin 996) 8. Henrici, P.: Discrete Variable Methods in Ordinary Differential Equations. John Wiley & Sons, New York 96) 9. Iserles, A.: Numerical Analysis of Differential Equations. Cambridge University Press, Cambridge 996). Jeltsch, R.: A necessary condition for A-Stability of multistep multiderivative methods, Math. Comp., 3, )

Stability Ordinates of Adams Predictor-Corrector Methods

Stability Ordinates of Adams Predictor-Corrector Methods BIT anuscript No. will be inserted by the editor Stability Ordinates of Adas Predictor-Corrector Methods Michelle L. Ghrist Jonah A. Reeger Bengt Fornberg Received: date / Accepted: date Abstract How far

More information

c 2012 Society for Industrial and Applied Mathematics

c 2012 Society for Industrial and Applied Mathematics SIAM J. NUMER. ANAL. Vol. 50, No. 4, pp. 849 860 c 0 Society for Industrial and Applied Mathematics TWO RESULTS CONCERNING THE STABILITY OF STAGGERED MULTISTEP METHODS MICHELLE GHRIST AND BENGT FORNBERG

More information

Numerical Methods - Initial Value Problems for ODEs

Numerical Methods - Initial Value Problems for ODEs Numerical Methods - Initial Value Problems for ODEs Y. K. Goh Universiti Tunku Abdul Rahman 2013 Y. K. Goh (UTAR) Numerical Methods - Initial Value Problems for ODEs 2013 1 / 43 Outline 1 Initial Value

More information

Math 128A Spring 2003 Week 12 Solutions

Math 128A Spring 2003 Week 12 Solutions Math 128A Spring 2003 Week 12 Solutions Burden & Faires 5.9: 1b, 2b, 3, 5, 6, 7 Burden & Faires 5.10: 4, 5, 8 Burden & Faires 5.11: 1c, 2, 5, 6, 8 Burden & Faires 5.9. Higher-Order Equations and Systems

More information

Lecture Notes to Accompany. Scientific Computing An Introductory Survey. by Michael T. Heath. Chapter 9

Lecture Notes to Accompany. Scientific Computing An Introductory Survey. by Michael T. Heath. Chapter 9 Lecture Notes to Accompany Scientific Computing An Introductory Survey Second Edition by Michael T. Heath Chapter 9 Initial Value Problems for Ordinary Differential Equations Copyright c 2001. Reproduction

More information

Scientific Computing: An Introductory Survey

Scientific Computing: An Introductory Survey Scientific Computing: An Introductory Survey Chapter 9 Initial Value Problems for Ordinary Differential Equations Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign

More information

CS 450 Numerical Analysis. Chapter 9: Initial Value Problems for Ordinary Differential Equations

CS 450 Numerical Analysis. Chapter 9: Initial Value Problems for Ordinary Differential Equations Lecture slides based on the textbook Scientific Computing: An Introductory Survey by Michael T. Heath, copyright c 2018 by the Society for Industrial and Applied Mathematics. http://www.siam.org/books/cl80

More information

Fourth Order RK-Method

Fourth Order RK-Method Fourth Order RK-Method The most commonly used method is Runge-Kutta fourth order method. The fourth order RK-method is y i+1 = y i + 1 6 (k 1 + 2k 2 + 2k 3 + k 4 ), Ordinary Differential Equations (ODE)

More information

A New Block Method and Their Application to Numerical Solution of Ordinary Differential Equations

A New Block Method and Their Application to Numerical Solution of Ordinary Differential Equations A New Block Method and Their Application to Numerical Solution of Ordinary Differential Equations Rei-Wei Song and Ming-Gong Lee* d09440@chu.edu.tw, mglee@chu.edu.tw * Department of Applied Mathematics/

More information

multistep methods Last modified: November 28, 2017 Recall that we are interested in the numerical solution of the initial value problem (IVP):

multistep methods Last modified: November 28, 2017 Recall that we are interested in the numerical solution of the initial value problem (IVP): MATH 351 Fall 217 multistep methods http://www.phys.uconn.edu/ rozman/courses/m351_17f/ Last modified: November 28, 217 Recall that we are interested in the numerical solution of the initial value problem

More information

Numerical solution of ODEs

Numerical solution of ODEs Numerical solution of ODEs Arne Morten Kvarving Department of Mathematical Sciences Norwegian University of Science and Technology November 5 2007 Problem and solution strategy We want to find an approximation

More information

THE θ-methods IN THE NUMERICAL SOLUTION OF DELAY DIFFERENTIAL EQUATIONS. Karel J. in t Hout, Marc N. Spijker Leiden, The Netherlands

THE θ-methods IN THE NUMERICAL SOLUTION OF DELAY DIFFERENTIAL EQUATIONS. Karel J. in t Hout, Marc N. Spijker Leiden, The Netherlands THE θ-methods IN THE NUMERICAL SOLUTION OF DELAY DIFFERENTIAL EQUATIONS Karel J. in t Hout, Marc N. Spijker Leiden, The Netherlands 1. Introduction This paper deals with initial value problems for delay

More information

4 Stability analysis of finite-difference methods for ODEs

4 Stability analysis of finite-difference methods for ODEs MATH 337, by T. Lakoba, University of Vermont 36 4 Stability analysis of finite-difference methods for ODEs 4.1 Consistency, stability, and convergence of a numerical method; Main Theorem In this Lecture

More information

Journal of Computational Physics 161, (2000) doi: /jcph , available online at

Journal of Computational Physics 161, (2000) doi: /jcph , available online at Journal of Computational Physics 161, 723 727 (2000) doi:10.1006/jcph.2000.6524, available online at http://www.idealibrary.com on NOTE Note on Nonsymmetric Finite Differences for Maxwell s Equations Tobin

More information

Ordinary differential equations - Initial value problems

Ordinary differential equations - Initial value problems Education has produced a vast population able to read but unable to distinguish what is worth reading. G.M. TREVELYAN Chapter 6 Ordinary differential equations - Initial value problems In this chapter

More information

CS520: numerical ODEs (Ch.2)

CS520: numerical ODEs (Ch.2) .. CS520: numerical ODEs (Ch.2) Uri Ascher Department of Computer Science University of British Columbia ascher@cs.ubc.ca people.cs.ubc.ca/ ascher/520.html Uri Ascher (UBC) CPSC 520: ODEs (Ch. 2) Fall

More information

Jim Lambers MAT 772 Fall Semester Lecture 21 Notes

Jim Lambers MAT 772 Fall Semester Lecture 21 Notes Jim Lambers MAT 772 Fall Semester 21-11 Lecture 21 Notes These notes correspond to Sections 12.6, 12.7 and 12.8 in the text. Multistep Methods All of the numerical methods that we have developed for solving

More information

ECE257 Numerical Methods and Scientific Computing. Ordinary Differential Equations

ECE257 Numerical Methods and Scientific Computing. Ordinary Differential Equations ECE257 Numerical Methods and Scientific Computing Ordinary Differential Equations Today s s class: Stiffness Multistep Methods Stiff Equations Stiffness occurs in a problem where two or more independent

More information

A Fast Spectral Algorithm for Nonlinear Wave Equations with Linear Dispersion

A Fast Spectral Algorithm for Nonlinear Wave Equations with Linear Dispersion Journal of Computational Physics 155, 456 467 (1999) Article ID jcph.1999.6351, available online at http://www.idealibrary.com on A Fast Spectral Algorithm for Nonlinear Wave Equations with Linear Dispersion

More information

Finite Differences for Differential Equations 28 PART II. Finite Difference Methods for Differential Equations

Finite Differences for Differential Equations 28 PART II. Finite Difference Methods for Differential Equations Finite Differences for Differential Equations 28 PART II Finite Difference Methods for Differential Equations Finite Differences for Differential Equations 29 BOUNDARY VALUE PROBLEMS (I) Solving a TWO

More information

On the stability regions of implicit linear multistep methods

On the stability regions of implicit linear multistep methods On the stability regions of implicit linear multistep methods arxiv:1404.6934v1 [math.na] 8 Apr 014 Lajos Lóczi April 9, 014 Abstract If we apply the accepted definition to determine the stability region

More information

9.6 Predictor-Corrector Methods

9.6 Predictor-Corrector Methods SEC. 9.6 PREDICTOR-CORRECTOR METHODS 505 Adams-Bashforth-Moulton Method 9.6 Predictor-Corrector Methods The methods of Euler, Heun, Taylor, and Runge-Kutta are called single-step methods because they use

More information

8.1 Introduction. Consider the initial value problem (IVP):

8.1 Introduction. Consider the initial value problem (IVP): 8.1 Introduction Consider the initial value problem (IVP): y dy dt = f(t, y), y(t 0)=y 0, t 0 t T. Geometrically: solutions are a one parameter family of curves y = y(t) in(t, y)-plane. Assume solution

More information

Linear Multistep Methods I: Adams and BDF Methods

Linear Multistep Methods I: Adams and BDF Methods Linear Multistep Methods I: Adams and BDF Methods Varun Shankar January 1, 016 1 Introduction In our review of 5610 material, we have discussed polynomial interpolation and its application to generating

More information

IMPLICIT INTERVAL MULTISTEP METHODS FOR SOLVING THE INITIAL VALUE PROBLEM

IMPLICIT INTERVAL MULTISTEP METHODS FOR SOLVING THE INITIAL VALUE PROBLEM COMPUTATIONAL METHODS IN SCIENCE AND TECHNOLOGY 8 (1), 17-30 (2002) IMPLICIT INTERVAL MULTISTEP METHODS FOR SOLVING THE INITIAL VALUE PROBLEM MAŁGORZATA JANKOWSKA 1, ANDRZEJ MARCINIAK 1,2 1 Poznań University

More information

Scientific Computing with Case Studies SIAM Press, Lecture Notes for Unit V Solution of

Scientific Computing with Case Studies SIAM Press, Lecture Notes for Unit V Solution of Scientific Computing with Case Studies SIAM Press, 2009 http://www.cs.umd.edu/users/oleary/sccswebpage Lecture Notes for Unit V Solution of Differential Equations Part 1 Dianne P. O Leary c 2008 1 The

More information

Initial value problems for ordinary differential equations

Initial value problems for ordinary differential equations AMSC/CMSC 660 Scientific Computing I Fall 2008 UNIT 5: Numerical Solution of Ordinary Differential Equations Part 1 Dianne P. O Leary c 2008 The Plan Initial value problems (ivps) for ordinary differential

More information

Numerical Differential Equations: IVP

Numerical Differential Equations: IVP Chapter 11 Numerical Differential Equations: IVP **** 4/16/13 EC (Incomplete) 11.1 Initial Value Problem for Ordinary Differential Equations We consider the problem of numerically solving a differential

More information

Initial value problems for ordinary differential equations

Initial value problems for ordinary differential equations Initial value problems for ordinary differential equations Xiaojing Ye, Math & Stat, Georgia State University Spring 2019 Numerical Analysis II Xiaojing Ye, Math & Stat, Georgia State University 1 IVP

More information

Ordinary Differential Equations

Ordinary Differential Equations Ordinary Differential Equations We call Ordinary Differential Equation (ODE) of nth order in the variable x, a relation of the kind: where L is an operator. If it is a linear operator, we call the equation

More information

Ordinary Differential Equations

Ordinary Differential Equations CHAPTER 8 Ordinary Differential Equations 8.1. Introduction My section 8.1 will cover the material in sections 8.1 and 8.2 in the book. Read the book sections on your own. I don t like the order of things

More information

Multistep Methods for IVPs. t 0 < t < T

Multistep Methods for IVPs. t 0 < t < T Multistep Methods for IVPs We are still considering the IVP dy dt = f(t,y) t 0 < t < T y(t 0 ) = y 0 So far we have looked at Euler s method, which was a first order method and Runge Kutta (RK) methods

More information

COSC 3361 Numerical Analysis I Ordinary Differential Equations (II) - Multistep methods

COSC 3361 Numerical Analysis I Ordinary Differential Equations (II) - Multistep methods COSC 336 Numerical Analysis I Ordinary Differential Equations (II) - Multistep methods Fall 2005 Repetition from the last lecture (I) Initial value problems: dy = f ( t, y) dt y ( a) = y 0 a t b Goal:

More information

Mathematics for chemical engineers. Numerical solution of ordinary differential equations

Mathematics for chemical engineers. Numerical solution of ordinary differential equations Mathematics for chemical engineers Drahoslava Janovská Numerical solution of ordinary differential equations Initial value problem Winter Semester 2015-2016 Outline 1 Introduction 2 One step methods Euler

More information

Ordinary differential equation II

Ordinary differential equation II Ordinary Differential Equations ISC-5315 1 Ordinary differential equation II 1 Some Basic Methods 1.1 Backward Euler method (implicit method) The algorithm looks like this: y n = y n 1 + hf n (1) In contrast

More information

Numerical Methods for Differential Equations

Numerical Methods for Differential Equations Numerical Methods for Differential Equations Chapter 2: Runge Kutta and Multistep Methods Gustaf Söderlind Numerical Analysis, Lund University Contents V4.16 1. Runge Kutta methods 2. Embedded RK methods

More information

369 Nigerian Research Journal of Engineering and Environmental Sciences 2(2) 2017 pp

369 Nigerian Research Journal of Engineering and Environmental Sciences 2(2) 2017 pp 369 Nigerian Research Journal of Engineering and Environmental Sciences 2(2) 27 pp. 369-374 Original Research Article THIRD DERIVATIVE MULTISTEP METHODS WITH OPTIMIZED REGIONS OF ABSOLUTE STABILITY FOR

More information

Semi-implicit Krylov Deferred Correction Methods for Ordinary Differential Equations

Semi-implicit Krylov Deferred Correction Methods for Ordinary Differential Equations Semi-implicit Krylov Deferred Correction Methods for Ordinary Differential Equations Sunyoung Bu University of North Carolina Department of Mathematics CB # 325, Chapel Hill USA agatha@email.unc.edu Jingfang

More information

PowerPoints organized by Dr. Michael R. Gustafson II, Duke University

PowerPoints organized by Dr. Michael R. Gustafson II, Duke University Part 6 Chapter 20 Initial-Value Problems PowerPoints organized by Dr. Michael R. Gustafson II, Duke University All images copyright The McGraw-Hill Companies, Inc. Permission required for reproduction

More information

1 Introduction to MATLAB

1 Introduction to MATLAB L3 - December 015 Solving PDEs numerically (Reports due Thursday Dec 3rd, carolinemuller13@gmail.com) In this project, we will see various methods for solving Partial Differential Equations (PDEs) using

More information

A computationally effective predictor-corrector method for simulating fractional order dynamical control system

A computationally effective predictor-corrector method for simulating fractional order dynamical control system ANZIAM J. 47 (EMA25) pp.168 184, 26 168 A computationally effective predictor-corrector method for simulating fractional order dynamical control system. Yang F. Liu (Received 14 October 25; revised 24

More information

NUMERICAL SOLUTION OF ODE IVPs. Overview

NUMERICAL SOLUTION OF ODE IVPs. Overview NUMERICAL SOLUTION OF ODE IVPs 1 Quick review of direction fields Overview 2 A reminder about and 3 Important test: Is the ODE initial value problem? 4 Fundamental concepts: Euler s Method 5 Fundamental

More information

Adebayo O. Adeniran1, Saheed O. Akindeinde2 and Babatunde S. Ogundare2 * Contents. 1. Introduction

Adebayo O. Adeniran1, Saheed O. Akindeinde2 and Babatunde S. Ogundare2 * Contents. 1. Introduction Malaya Journal of Matematik Vol. No. 73-73 8 https://doi.org/.37/mjm/ An accurate five-step trigonometrically-fitted numerical scheme for approximating solutions of second order ordinary differential equations

More information

Solving PDEs with PGI CUDA Fortran Part 4: Initial value problems for ordinary differential equations

Solving PDEs with PGI CUDA Fortran Part 4: Initial value problems for ordinary differential equations Solving PDEs with PGI CUDA Fortran Part 4: Initial value problems for ordinary differential equations Outline ODEs and initial conditions. Explicit and implicit Euler methods. Runge-Kutta methods. Multistep

More information

Review Higher Order methods Multistep methods Summary HIGHER ORDER METHODS. P.V. Johnson. School of Mathematics. Semester

Review Higher Order methods Multistep methods Summary HIGHER ORDER METHODS. P.V. Johnson. School of Mathematics. Semester HIGHER ORDER METHODS School of Mathematics Semester 1 2008 OUTLINE 1 REVIEW 2 HIGHER ORDER METHODS 3 MULTISTEP METHODS 4 SUMMARY OUTLINE 1 REVIEW 2 HIGHER ORDER METHODS 3 MULTISTEP METHODS 4 SUMMARY OUTLINE

More information

Numerical Methods for Differential Equations

Numerical Methods for Differential Equations Numerical Methods for Differential Equations Chapter 2: Runge Kutta and Linear Multistep methods Gustaf Söderlind and Carmen Arévalo Numerical Analysis, Lund University Textbooks: A First Course in the

More information

THE METHOD OF LINES FOR PARABOLIC PARTIAL INTEGRO-DIFFERENTIAL EQUATIONS

THE METHOD OF LINES FOR PARABOLIC PARTIAL INTEGRO-DIFFERENTIAL EQUATIONS JOURNAL OF INTEGRAL EQUATIONS AND APPLICATIONS Volume 4, Number 1, Winter 1992 THE METHOD OF LINES FOR PARABOLIC PARTIAL INTEGRO-DIFFERENTIAL EQUATIONS J.-P. KAUTHEN ABSTRACT. We present a method of lines

More information

Lecture 4: Numerical solution of ordinary differential equations

Lecture 4: Numerical solution of ordinary differential equations Lecture 4: Numerical solution of ordinary differential equations Department of Mathematics, ETH Zürich General explicit one-step method: Consistency; Stability; Convergence. High-order methods: Taylor

More information

Applied Math for Engineers

Applied Math for Engineers Applied Math for Engineers Ming Zhong Lecture 15 March 28, 2018 Ming Zhong (JHU) AMS Spring 2018 1 / 28 Recap Table of Contents 1 Recap 2 Numerical ODEs: Single Step Methods 3 Multistep Methods 4 Method

More information

Math Numerical Analysis Homework #4 Due End of term. y = 2y t 3y2 t 3, 1 t 2, y(1) = 1. n=(b-a)/h+1; % the number of steps we need to take

Math Numerical Analysis Homework #4 Due End of term. y = 2y t 3y2 t 3, 1 t 2, y(1) = 1. n=(b-a)/h+1; % the number of steps we need to take Math 32 - Numerical Analysis Homework #4 Due End of term Note: In the following y i is approximation of y(t i ) and f i is f(t i,y i ).. Consider the initial value problem, y = 2y t 3y2 t 3, t 2, y() =.

More information

A NOTE ON EXPLICIT THREE-DERIVATIVE RUNGE-KUTTA METHODS (ThDRK)

A NOTE ON EXPLICIT THREE-DERIVATIVE RUNGE-KUTTA METHODS (ThDRK) BULLETIN OF THE INTERNATIONAL MATHEMATICAL VIRTUAL INSTITUTE ISSN 303-4874 (p), ISSN (o) 303-4955 www.imvibl.org / JOURNALS / BULLETIN Vol. 5(015), 65-7 Former BULLETIN OF THE SOCIETY OF MATHEMATICIANS

More information

ONE- AND TWO-STAGE IMPLICIT INTERVAL METHODS OF RUNGE-KUTTA TYPE

ONE- AND TWO-STAGE IMPLICIT INTERVAL METHODS OF RUNGE-KUTTA TYPE COMPUTATIONAL METHODS IN SCIENCE AND TECHNOLOGY 5,53-65 (1999) ONE- AND TWO-STAGE IMPLICIT INTERVAL METHODS OF RUNGE-KUTTA TYPE ANDRZEJ MARCINIAK 1, BARBARA SZYSZKA 2 1 Institute of Computing Science,

More information

Geometric Numerical Integration

Geometric Numerical Integration Geometric Numerical Integration (Ernst Hairer, TU München, winter 2009/10) Development of numerical ordinary differential equations Nonstiff differential equations (since about 1850), see [4, 2, 1] Adams

More information

PowerPoints organized by Dr. Michael R. Gustafson II, Duke University

PowerPoints organized by Dr. Michael R. Gustafson II, Duke University Part 5 Chapter 21 Numerical Differentiation PowerPoints organized by Dr. Michael R. Gustafson II, Duke University 1 All images copyright The McGraw-Hill Companies, Inc. Permission required for reproduction

More information

Module 4: Numerical Methods for ODE. Michael Bader. Winter 2007/2008

Module 4: Numerical Methods for ODE. Michael Bader. Winter 2007/2008 Outlines Module 4: for ODE Part I: Basic Part II: Advanced Lehrstuhl Informatik V Winter 2007/2008 Part I: Basic 1 Direction Fields 2 Euler s Method Outlines Part I: Basic Part II: Advanced 3 Discretized

More information

Strong Stability Preserving Properties of Runge Kutta Time Discretization Methods for Linear Constant Coefficient Operators

Strong Stability Preserving Properties of Runge Kutta Time Discretization Methods for Linear Constant Coefficient Operators Journal of Scientific Computing, Vol. 8, No., February 3 ( 3) Strong Stability Preserving Properties of Runge Kutta Time Discretization Methods for Linear Constant Coefficient Operators Sigal Gottlieb

More information

Integration of Ordinary Differential Equations

Integration of Ordinary Differential Equations Integration of Ordinary Differential Equations Com S 477/577 Nov 7, 00 1 Introduction The solution of differential equations is an important problem that arises in a host of areas. Many differential equations

More information

Lecture 5: Single Step Methods

Lecture 5: Single Step Methods Lecture 5: Single Step Methods J.K. Ryan@tudelft.nl WI3097TU Delft Institute of Applied Mathematics Delft University of Technology 1 October 2012 () Single Step Methods 1 October 2012 1 / 44 Outline 1

More information

Chapter 5 Exercises. (a) Determine the best possible Lipschitz constant for this function over 2 u <. u (t) = log(u(t)), u(0) = 2.

Chapter 5 Exercises. (a) Determine the best possible Lipschitz constant for this function over 2 u <. u (t) = log(u(t)), u(0) = 2. Chapter 5 Exercises From: Finite Difference Methods for Ordinary and Partial Differential Equations by R. J. LeVeque, SIAM, 2007. http://www.amath.washington.edu/ rjl/fdmbook Exercise 5. (Uniqueness for

More information

Fixed point iteration and root finding

Fixed point iteration and root finding Fixed point iteration and root finding The sign function is defined as x > 0 sign(x) = 0 x = 0 x < 0. It can be evaluated via an iteration which is useful for some problems. One such iteration is given

More information

Math 128A Spring 2003 Week 11 Solutions Burden & Faires 5.6: 1b, 3b, 7, 9, 12 Burden & Faires 5.7: 1b, 3b, 5 Burden & Faires 5.

Math 128A Spring 2003 Week 11 Solutions Burden & Faires 5.6: 1b, 3b, 7, 9, 12 Burden & Faires 5.7: 1b, 3b, 5 Burden & Faires 5. Math 128A Spring 2003 Week 11 Solutions Burden & Faires 5.6: 1b, 3b, 7, 9, 12 Burden & Faires 5.7: 1b, 3b, 5 Burden & Faires 5.8: 1b, 3b, 4 Burden & Faires 5.6. Multistep Methods 1. Use all the Adams-Bashforth

More information

Chapter 8. Numerical Solution of Ordinary Differential Equations. Module No. 2. Predictor-Corrector Methods

Chapter 8. Numerical Solution of Ordinary Differential Equations. Module No. 2. Predictor-Corrector Methods Numerical Analysis by Dr. Anita Pal Assistant Professor Department of Matematics National Institute of Tecnology Durgapur Durgapur-7109 email: anita.buie@gmail.com 1 . Capter 8 Numerical Solution of Ordinary

More information

Exponentially Fitted Error Correction Methods for Solving Initial Value Problems

Exponentially Fitted Error Correction Methods for Solving Initial Value Problems KYUNGPOOK Math. J. 52(2012), 167-177 http://dx.doi.org/10.5666/kmj.2012.52.2.167 Exponentially Fitted Error Correction Methods for Solving Initial Value Problems Sangdong Kim and Philsu Kim Department

More information

-Stable Second Derivative Block Multistep Formula for Stiff Initial Value Problems

-Stable Second Derivative Block Multistep Formula for Stiff Initial Value Problems IAENG International Journal of Applied Mathematics, :3, IJAM 3_7 -Stable Second Derivative Bloc Multistep Formula for Stiff Initial Value Problems (Advance online publication: 3 August ) IAENG International

More information

CHAPTER 5: Linear Multistep Methods

CHAPTER 5: Linear Multistep Methods CHAPTER 5: Linear Multistep Methods Multistep: use information from many steps Higher order possible with fewer function evaluations than with RK. Convenient error estimates. Changing stepsize or order

More information

COMPARISON OF FINITE DIFFERENCE- AND PSEUDOSPECTRAL METHODS FOR CONVECTIVE FLOW OVER A SPHERE

COMPARISON OF FINITE DIFFERENCE- AND PSEUDOSPECTRAL METHODS FOR CONVECTIVE FLOW OVER A SPHERE COMPARISON OF FINITE DIFFERENCE- AND PSEUDOSPECTRAL METHODS FOR CONVECTIVE FLOW OVER A SPHERE BENGT FORNBERG and DAVID MERRILL Abstract. For modeling convective flows over a sphere or within a spherical

More information

A Zero-Stable Block Method for the Solution of Third Order Ordinary Differential Equations.

A Zero-Stable Block Method for the Solution of Third Order Ordinary Differential Equations. A Zero-Stable Block Method for the Solution of Third Order Ordinary Differential Equations. K. Rauf, Ph.D. 1 ; S.A. Aniki (Ph.D. in view) 2* ; S. Ibrahim (Ph.D. in view) 2 ; and J.O. Omolehin, Ph.D. 3

More information

UNCONDITIONAL STABILITY OF A CRANK-NICOLSON ADAMS-BASHFORTH 2 NUMERICAL METHOD

UNCONDITIONAL STABILITY OF A CRANK-NICOLSON ADAMS-BASHFORTH 2 NUMERICAL METHOD INTERNATIONAL JOURNAL OF NUMERICAL ANALYSIS AND MODELING, SERIES B Volume 5, Number 3, Pages 7 87 c 04 Institute for Scientific Computing and Information UNCONDITIONAL STABILITY OF A CRANK-NICOLSON ADAMS-BASHFORTH

More information

ON EXPLICIT INTERVAL METHODS OF ADAMS-BASHFORTH TYPE

ON EXPLICIT INTERVAL METHODS OF ADAMS-BASHFORTH TYPE COMPUTATIONAL METHODS IN SCIENCE AND TECHNOLOGY 8 (2), 46-57 (2002) ON EXPLICIT INTERVAL METHODS OF ADAMS-BASHFORTH TYPE MAŁGORZATA JANKOWSKA 1, ANDRZEJ MARCINIAK 1, 2 1 Poznań University of Technology,

More information

Research Article Diagonally Implicit Block Backward Differentiation Formulas for Solving Ordinary Differential Equations

Research Article Diagonally Implicit Block Backward Differentiation Formulas for Solving Ordinary Differential Equations International Mathematics and Mathematical Sciences Volume 212, Article ID 767328, 8 pages doi:1.1155/212/767328 Research Article Diagonally Implicit Block Backward Differentiation Formulas for Solving

More information

PowerPoints organized by Dr. Michael R. Gustafson II, Duke University

PowerPoints organized by Dr. Michael R. Gustafson II, Duke University Part 6 Chapter 20 Initial-Value Problems PowerPoints organized by Dr. Michael R. Gustafson II, Duke University All images copyright The McGraw-Hill Companies, Inc. Permission required for reproduction

More information

Numerical Analysis Preliminary Exam 10 am to 1 pm, August 20, 2018

Numerical Analysis Preliminary Exam 10 am to 1 pm, August 20, 2018 Numerical Analysis Preliminary Exam 1 am to 1 pm, August 2, 218 Instructions. You have three hours to complete this exam. Submit solutions to four (and no more) of the following six problems. Please start

More information

Initial-Value Problems for ODEs. Introduction to Linear Multistep Methods

Initial-Value Problems for ODEs. Introduction to Linear Multistep Methods Initial-Value Problems for ODEs Introduction to Linear Multistep Methods Numerical Analysis (9th Edition) R L Burden & J D Faires Beamer Presentation Slides prepared by John Carroll Dublin City University

More information

UNCONDITIONAL STABILITY OF A CRANK-NICOLSON ADAMS-BASHFORTH 2 IMPLICIT-EXPLICIT NUMERICAL METHOD

UNCONDITIONAL STABILITY OF A CRANK-NICOLSON ADAMS-BASHFORTH 2 IMPLICIT-EXPLICIT NUMERICAL METHOD UNCONDITIONAL STABILITY OF A CRANK-NICOLSON ADAMS-BASHFORTH IMPLICIT-EXPLICIT NUMERICAL METHOD ANDREW JORGENSON Abstract. Systems of nonlinear partial differential equations modeling turbulent fluid flow

More information

1 Ordinary Differential Equations

1 Ordinary Differential Equations Ordinary Differential Equations.0 Mathematical Background.0. Smoothness Definition. A function f defined on [a, b] is continuous at ξ [a, b] if lim x ξ f(x) = f(ξ). Remark Note that this implies existence

More information

Part IB Numerical Analysis

Part IB Numerical Analysis Part IB Numerical Analysis Definitions Based on lectures by G. Moore Notes taken by Dexter Chua Lent 206 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after

More information

Astrodynamics (AERO0024)

Astrodynamics (AERO0024) Astrodynamics (AERO0024) 5. Numerical Methods Gaëtan Kerschen Space Structures & Systems Lab (S3L) Why Different Propagators? Analytic propagation: Better understanding of the perturbing forces. Useful

More information

Review. Numerical Methods Lecture 22. Prof. Jinbo Bi CSE, UConn

Review. Numerical Methods Lecture 22. Prof. Jinbo Bi CSE, UConn Review Taylor Series and Error Analysis Roots of Equations Linear Algebraic Equations Optimization Numerical Differentiation and Integration Ordinary Differential Equations Partial Differential Equations

More information

Ordinary Differential Equations

Ordinary Differential Equations Chapter 13 Ordinary Differential Equations We motivated the problem of interpolation in Chapter 11 by transitioning from analzying to finding functions. That is, in problems like interpolation and regression,

More information

c 1999 Society for Industrial and Applied Mathematics

c 1999 Society for Industrial and Applied Mathematics SIAM J. NUMER. ANAL. Vol. 37, No., pp. 5 3 c 999 Society for Industrial and Applied Mathematics SPATIAL FINITE DIFFERENCE APPROXIMATIONS FOR WAVE-TYPE EQUATIONS BENGT FORNBERG AND MICHELLE GHRIST Abstract.

More information

Improved Starting Methods for Two-Step Runge Kutta Methods of Stage-Order p 3

Improved Starting Methods for Two-Step Runge Kutta Methods of Stage-Order p 3 Improved Starting Methods for Two-Step Runge Kutta Methods of Stage-Order p 3 J.H. Verner August 3, 2004 Abstract. In [5], Jackiewicz and Verner derived formulas for, and tested the implementation of two-step

More information

Do not turn over until you are told to do so by the Invigilator.

Do not turn over until you are told to do so by the Invigilator. UNIVERSITY OF EAST ANGLIA School of Mathematics Main Series UG Examination 216 17 INTRODUCTION TO NUMERICAL ANALYSIS MTHE612B Time allowed: 3 Hours Attempt QUESTIONS 1 and 2, and THREE other questions.

More information

Research Article P-Stable Higher Derivative Methods with Minimal Phase-Lag for Solving Second Order Differential Equations

Research Article P-Stable Higher Derivative Methods with Minimal Phase-Lag for Solving Second Order Differential Equations Hindawi Publishing Corporation Journal of Applied Mathematics Volume 2011, Article ID 407151, 15 pages doi:10.1155/2011/407151 Research Article P-Stable Higher Derivative Methods with Minimal Phase-Lag

More information

Bindel, Fall 2011 Intro to Scientific Computing (CS 3220) Week 12: Monday, Apr 18. HW 7 is posted, and will be due in class on 4/25.

Bindel, Fall 2011 Intro to Scientific Computing (CS 3220) Week 12: Monday, Apr 18. HW 7 is posted, and will be due in class on 4/25. Logistics Week 12: Monday, Apr 18 HW 6 is due at 11:59 tonight. HW 7 is posted, and will be due in class on 4/25. The prelim is graded. An analysis and rubric are on CMS. Problem du jour For implicit methods

More information

INTRODUCTION TO COMPUTER METHODS FOR O.D.E.

INTRODUCTION TO COMPUTER METHODS FOR O.D.E. INTRODUCTION TO COMPUTER METHODS FOR O.D.E. 0. Introduction. The goal of this handout is to introduce some of the ideas behind the basic computer algorithms to approximate solutions to differential equations.

More information

SOME PROPERTIES OF SYMPLECTIC RUNGE-KUTTA METHODS

SOME PROPERTIES OF SYMPLECTIC RUNGE-KUTTA METHODS SOME PROPERTIES OF SYMPLECTIC RUNGE-KUTTA METHODS ERNST HAIRER AND PIERRE LEONE Abstract. We prove that to every rational function R(z) satisfying R( z)r(z) = 1, there exists a symplectic Runge-Kutta method

More information

MTH 452/552 Homework 3

MTH 452/552 Homework 3 MTH 452/552 Homework 3 Do either 1 or 2. 1. (40 points) [Use of ode113 and ode45] This problem can be solved by a modifying the m-files odesample.m and odesampletest.m available from the author s webpage.

More information

Reducing round-off errors in symmetric multistep methods

Reducing round-off errors in symmetric multistep methods Reducing round-off errors in symmetric multistep methods Paola Console a, Ernst Hairer a a Section de Mathématiques, Université de Genève, 2-4 rue du Lièvre, CH-1211 Genève 4, Switzerland. (Paola.Console@unige.ch,

More information

5.6 Multistep Methods

5.6 Multistep Methods 5.6 Multistep Methods 1 Motivation: Consider IVP: yy = ff(tt, yy), aa tt bb, yy(aa) = αα. To compute solution at tt ii+1, approximate solutions at mesh points tt 0, tt 1, tt 2, tt ii are already obtained.

More information

x n+1 = x n f(x n) f (x n ), n 0.

x n+1 = x n f(x n) f (x n ), n 0. 1. Nonlinear Equations Given scalar equation, f(x) = 0, (a) Describe I) Newtons Method, II) Secant Method for approximating the solution. (b) State sufficient conditions for Newton and Secant to converge.

More information

A CLASS OF CONTINUOUS HYBRID LINEAR MULTISTEP METHODS FOR STIFF IVPs IN ODEs

A CLASS OF CONTINUOUS HYBRID LINEAR MULTISTEP METHODS FOR STIFF IVPs IN ODEs ANALELE ŞTIINŢIFICE ALE UNIVERSITĂŢII AL.I. CUZA DIN IAŞI (S.N.) MATEMATICĂ, Tomul LVIII, 0, f. A CLASS OF CONTINUOUS HYBRID LINEAR MULTISTEP METHODS FOR STIFF IVPs IN ODEs BY R.I. OKUONGHAE Abstract.

More information

Notes for Numerical Analysis Math 5466 by S. Adjerid Virginia Polytechnic Institute and State University (A Rough Draft) Contents Numerical Methods for ODEs 5. Introduction............................

More information

Solving Ordinary Differential Equations

Solving Ordinary Differential Equations Solving Ordinary Differential Equations Sanzheng Qiao Department of Computing and Software McMaster University March, 2014 Outline 1 Initial Value Problem Euler s Method Runge-Kutta Methods Multistep Methods

More information

FDM for parabolic equations

FDM for parabolic equations FDM for parabolic equations Consider the heat equation where Well-posed problem Existence & Uniqueness Mass & Energy decreasing FDM for parabolic equations CNFD Crank-Nicolson + 2 nd order finite difference

More information

Richarson Extrapolation for Runge-Kutta Methods

Richarson Extrapolation for Runge-Kutta Methods Richarson Extrapolation for Runge-Kutta Methods Zahari Zlatevᵃ, Ivan Dimovᵇ and Krassimir Georgievᵇ ᵃ Department of Environmental Science, Aarhus University, Frederiksborgvej 399, P. O. 358, 4000 Roskilde,

More information

Ordinary Differential Equations. Monday, October 10, 11

Ordinary Differential Equations. Monday, October 10, 11 Ordinary Differential Equations Monday, October 10, 11 Problems involving ODEs can always be reduced to a set of first order differential equations. For example, By introducing a new variable z, this can

More information

A Brief Introduction to Numerical Methods for Differential Equations

A Brief Introduction to Numerical Methods for Differential Equations A Brief Introduction to Numerical Methods for Differential Equations January 10, 2011 This tutorial introduces some basic numerical computation techniques that are useful for the simulation and analysis

More information

Math 411 Preliminaries

Math 411 Preliminaries Math 411 Preliminaries Provide a list of preliminary vocabulary and concepts Preliminary Basic Netwon's method, Taylor series expansion (for single and multiple variables), Eigenvalue, Eigenvector, Vector

More information

Lecture Notes Multibody Dynamics B, wb1413

Lecture Notes Multibody Dynamics B, wb1413 Lecture Notes Multibody Dynamics B, wb43 A. L. Schwab & Guido M.J. Delhaes Laboratory for Engineering Mechanics Mechanical Engineering Delft University of Technolgy The Netherlands April 9, 29 Contents

More information

Southern Methodist University.

Southern Methodist University. Title: Continuous extensions Name: Lawrence F. Shampine 1, Laurent O. Jay 2 Affil./Addr. 1: Department of Mathematics Southern Methodist University Dallas, TX 75275 USA Phone: +1 (972) 690-8439 E-mail:

More information