Variable Step Size Differential Equation Solvers

Size: px

Start display at page:

Download "Variable Step Size Differential Equation Solvers"

Mervin Merritt
5 years ago
Views:

1 Math55: Differential Equations 1/30 Variable Step Size Differential Equation Solvers Jason Brewer and George Little

2 Introduction The purpose of developing numerical methods is to approximate the solution to the well posed initial value problem 2/30 dy dt = f(t, y), a t b, y(a) = α

3 Single Step Solvers Taylor s Method 3/30 The first step to developing a numerical solver is to represent the solution to the Differential Equation as a Taylor power series y(t) = y(a) + y (a)(t a) + y (a) (t a) 2 + 2! where y(t) represents the exact solution.

4 The Difference Equation After manipulating the power series, we replace the exact solutions with approximated solutions, giving us the equation w i+1 = w i + h[f(t i, w i ) + h 2! f (t i, w i ) + + hn 1 f (n 1) (t i, w i )] n! where w represents the approximated solution and h represents the step size. 4/30

5 The Difference Equation After manipulating the power series, we replace the exact solutions with approximated solutions, giving us the equation w i+1 = w i + h[f(t i, w i ) + h 2! f (t i, w i ) + + hn 1 f (n 1) (t i, w i )] n! where w represents the approximated solution and h represents the step size This equation can now be put into the form w i+1 = w i + h T (n) (y i, w i ) This equation is called the Taylor Method of order n 5/30

6 Applying The Taylor method of order 1,2, and 4 to the initial value problem dy = y + t + 1, 0 t 1, y(0) = 1 dt gives us the the following table (figure 1) in result 6/30

7 Analysis of Euler s Method t Exact value Euler s Method Error /30

8 Analysis of Taylor s Method Second Order t Exact value Taylor s Method Error Order Two /30

9 Analysis of Taylor s Method Fourth Order t Exact value Taylor s Method Error Order Four /30

10 Error Control As can be seen from the table in figure 1, as the order of the method increases, the error produced by Taylor s method decreases. The price for the decrease in error, however, is an increase of the number of calculations. For Taylor s method, this increase means the calculation of higher order derivatives 10/30

11 Rung-Kutta Methods Because the higher order Taylor s Methods require the calculation of higher order derivatives, they are rarely ever used in practice. The problem of eliminating the upper order derivatives while keeping the higher order accuracy and error control is solved by converting the Taylor Methods into Rung-Kutta methods. 11/30

12 The Second order Taylor Method can be rewritten into a second order Rung-Kutta Method w i+1 = w i + h[f(t i + h 2, w i + h 2 f(t i, w i ))] 12/30 This particular RK2 Method is called the Midpoint Method and can be rewritten into the form commonly seen in text books. w 0 = α k 1 = f(t i, w i ) k 2 = f(t i + h 2, w i + h 2 k 1) w i+1 = w i + hk 2

13 The Fourth order Taylor method can be rewritten into a fourth order Rung-Kutta Method w 0 = α k 1 = hf(t i, w i ) 13/30 k 2 = hf(t i + h 2, w i k 1) k 3 = hf(t i + h 2, w i k 2) k 4 = hf(t i, w i + k 3 ) w i+1 = w i (k 1 + 2k 2 + 2k 3 + k 4 ) At this point it is important to note that there are many different Rung-Kutta Methods of n order. A method with a different set of coefficients is a new method.

14 Error Control and Variable Step Size The main concern with numerical solvers is the error made when they approximate a solution. The second concern is the number of computations that must be performed. Both of these can be addressed by creating solvers that use a variable step size in order to keep the error within a specified tolerance. By using the largest step size allowable while keeping the error within a tolerance, the error made is reduced. 14/30

15 Determining the Error Made per Step The way to keep the error under control is to determine the error made at each step. A common way to do this is to use two solvers of orders n and n + 1. If you will remember Taylor s Theorem 15/30 y(t) = y(a) + y (a)(t a) + y (a) 2! + y(n+1) (a) (n + 1)! (t a)n+1 + (t a) y(n) (a) (t a) n n!

16 Determining the Error Made per Step The way to keep the error under control is to determine the error made at each step. A common way to do this is to use two solvers of orders n and n + 1. If you will remember Taylor s Theorem 16/30 y(t) = y(a) + y (a)(t a) + y (a) 2! (t a) y(n) (a) (t a) n n! + y(n+1) (a) (n + 1)! (t a)n+1 + Any approximations made of order n will have an error no larger than the value of the n + 1 term. This leads us to take the difference of our two solvers to find the value the the error term.

17 Since the downside of using two distinct methods is a dramatic increase in computations, another method is typically used. An example of this method is the Rung-Kutta-Fehlberg Algorithm. The Rung-Kutta- Fehlberg Algorithm shown here combines Rung-Kutta methods of order four and order five into one algorithm. Doing this reduces the number of computations made while returning the same result. 17/30

18 Rung-Kutta-Fehlberg Algorithm 1. Set t = a, w = α, h = hmax, FLAG= 1 OUTPUT(t,w) 2. While (F LAG = 1) do Steps Set 18/30 K 1 = hf(t, w) K 2 = hf(t h, w K 1 K 3 = hf(t h, w K K 2 K 4 = hf(t h, w K K K 3 K 5 = hf(t + h, w K 1 8K K K 4 K 6 = hf(t h, w 8 27 K 1 + 2K K K K 5

19 1 4. Set R = 360 K K K K K 6 h 5. Set δ = 0.84( T OL 1 R ) 4 6. If (R T OL) then do Steps 7 and 8 7. Set t = t + h, w = w K K K K 5 8. OUTPUT(t,w,h) 9. If (δ 0.1) then set h = 0.1h else If (δ 4) then set h = 4h else set h = δh 10. If (h > hmax) then set h = hmax 11. If (t b) then set F LAG = 0 else If (t + h > b) then set h = b t 19/30

20 else If (h < hmin) then set F LAG = 0 OUTPUT( Minimum h exceeded ) 20/30

21 Summary From the humble beginnings of Euler s method, numerical solvers started relatively simple and have evolved into the more complex higher order Taylor methods and into the efficient Rung-Kutta methods. And the search for more efficient and accurate methods have lead to the more complicated variable step solvers. 21/30

22 References 1. Arnold, Dave Technical Help and Advice 2. Brown, Greg Program Inspiration 3. Burden, Richard L., J. Douglas Faires Numerical Analysis: Fourth Edition, PWS-KENT Publishing Company, Boston: Dormand, John R., Numerical Methods for Differential Equations: A Computational ApproachCRC Press, Boca raton: Romero, Chris C++ Technical Help and Advice 22/30

PowerPoints organized by Dr. Michael R. Gustafson II, Duke University

Part 6 Chapter 20 Initial-Value Problems PowerPoints organized by Dr. Michael R. Gustafson II, Duke University All images copyright The McGraw-Hill Companies, Inc. Permission required for reproduction