Infinite series, improper integrals, and Taylor series

Similar documents
Taylor series. Chapter Introduction From geometric series to Taylor polynomials

8.5 Taylor Polynomials and Taylor Series

Infinite series, improper integrals, and Taylor series

8.7 MacLaurin Polynomials

1 Question related to polynomials

Convergence of sequences and series

Series Solutions. 8.1 Taylor Polynomials

Section 5.8. Taylor Series

AP Calculus Chapter 9: Infinite Series

Polynomial Approximations and Power Series

MATH 1231 MATHEMATICS 1B CALCULUS. Section 5: - Power Series and Taylor Series.

1.4 Techniques of Integration

Ma 530 Power Series II

This practice exam is intended to help you prepare for the final exam for MTH 142 Calculus II.

Math 1310 Final Exam

Chapter 11 - Sequences and Series

Power series and Taylor series

AP Calculus Testbank (Chapter 9) (Mr. Surowski)

1 + lim. n n+1. f(x) = x + 1, x 1. and we check that f is increasing, instead. Using the quotient rule, we easily find that. 1 (x + 1) 1 x (x + 1) 2 =

n=0 ( 1)n /(n + 1) converges, but not

Section 9.8. First let s get some practice with determining the interval of convergence of power series.

8.7 Taylor s Inequality Math 2300 Section 005 Calculus II. f(x) = ln(1 + x) f(0) = 0

Final exam (practice) UCLA: Math 31B, Spring 2017

Math Review for Exam Answer each of the following questions as either True or False. Circle the correct answer.

SERIES SOLUTION OF DIFFERENTIAL EQUATIONS

Section 10.7 Taylor series

Calculus II Lecture Notes

LECTURE 11 - PARTIAL DIFFERENTIATION

Let s Get Series(ous)

function independent dependent domain range graph of the function The Vertical Line Test

5.9 Representations of Functions as a Power Series

e x = 1 + x + x2 2! + x3 If the function f(x) can be written as a power series on an interval I, then the power series is of the form

Taylor and Maclaurin Series. Approximating functions using Polynomials.

SOLVED PROBLEMS ON TAYLOR AND MACLAURIN SERIES

8.3 Partial Fraction Decomposition

Subsequences and Limsups. Some sequences of numbers converge to limits, and some do not. For instance,

MORE APPLICATIONS OF DERIVATIVES. David Levermore. 17 October 2000

Aim: How do we prepare for AP Problems on limits, continuity and differentiability? f (x)

MATH 118, LECTURES 27 & 28: TAYLOR SERIES

Introduction and Review of Power Series

MATH 31B: MIDTERM 2 REVIEW. sin 2 x = 1 cos(2x) dx = x 2 sin(2x) 4. + C = x 2. dx = x sin(2x) + C = x sin x cos x

Chapter P: Preliminaries

Last/Family Name First/Given Name Seat #

Chapter 6. Techniques of Integration. 6.1 Differential notation

TAYLOR AND MACLAURIN SERIES

1. Pace yourself. Make sure you write something on every problem to get partial credit. 2. If you need more space, use the back of the previous page.

Note: Final Exam is at 10:45 on Tuesday, 5/3/11 (This is the Final Exam time reserved for our labs). From Practice Test I

Taylor and Maclaurin Series. Approximating functions using Polynomials.

Lesson Objectives: we will learn:

3 Algebraic Methods. we can differentiate both sides implicitly to obtain a differential equation involving x and y:

Math 1552: Integral Calculus Final Exam Study Guide, Spring 2018

1. Taylor Polynomials of Degree 1: Linear Approximation. Reread Example 1.

INFINITE SEQUENCES AND SERIES

Homework Problem Answers

Advanced Calculus Math 127B, Winter 2005 Solutions: Final. nx2 1 + n 2 x, g n(x) = n2 x

Math 162: Calculus IIA

Chapter 7: Techniques of Integration

Topics Covered in Calculus BC

Completion Date: Monday February 11, 2008

Review of Power Series

Algebraic. techniques1

PARTIAL FRACTIONS: AN INTEGRATIONIST PERSPECTIVE

MTH101 Calculus And Analytical Geometry Lecture Wise Questions and Answers For Final Term Exam Preparation

Taylor Series. richard/math230 These notes are taken from Calculus Vol I, by Tom M. Apostol,

7.1 Indefinite Integrals Calculus

You can learn more about the services offered by the teaching center by visiting

a x a y = a x+y a x a = y ax y (a x ) r = a rx and log a (xy) = log a (x) + log a (y) log a ( x y ) = log a(x) log a (y) log a (x r ) = r log a (x).

The definite integral gives the area under the curve. Simplest use of FTC1: derivative of integral is original function.

Section 5.6. Integration By Parts. MATH 126 (Section 5.6) Integration By Parts The University of Kansas 1 / 10

Chapter 6. Techniques of Integration. 6.1 Differential notation

Math 181, Exam 2, Study Guide 2 Problem 1 Solution. 1 + dx. 1 + (cos x)2 dx. 1 + cos2 xdx. = π ( 1 + cos π 2

converges to a root, it may not always be the root you have in mind.

MATH141: Calculus II Exam #4 review solutions 7/20/2017 Page 1

Slope Fields: Graphing Solutions Without the Solutions

Integration by Parts

MATH 1910 Limits Numerically and Graphically Introduction to Limits does not exist DNE DOES does not Finding Limits Numerically

CALCULUS JIA-MING (FRANK) LIOU

Math 106: Review for Exam II - SOLUTIONS

Math Final Exam Review

Math Numerical Analysis

SBS Chapter 2: Limits & continuity

UNIVERSITY OF HOUSTON HIGH SCHOOL MATHEMATICS CONTEST Spring 2018 Calculus Test

Chapter P: Preliminaries

MATH 101: PRACTICE MIDTERM 2

Math 122 Fall Handout 15: Review Problems for the Cumulative Final Exam

10.1 Sequences. Example: A sequence is a function f(n) whose domain is a subset of the integers. Notation: *Note: n = 0 vs. n = 1.

MAT100 OVERVIEW OF CONTENTS AND SAMPLE PROBLEMS

n=1 ( 2 3 )n (a n ) converges by direct comparison to

Week 1: need to know. November 14, / 20

x n cos 2x dx. dx = nx n 1 and v = 1 2 sin(2x). Andreas Fring (City University London) AS1051 Lecture Autumn / 36

Sequences and infinite series

Math 1B, lecture 15: Taylor Series

Lecture 7 - Separable Equations

Math 113 (Calculus 2) Exam 4

Section Example Determine the Maclaurin series of f (x) = e x and its the interval of convergence.

Section 8.7. Taylor and MacLaurin Series. (1) Definitions, (2) Common Maclaurin Series, (3) Taylor Polynomials, (4) Applications.

Replacing the a in the definition of the derivative of the function f at a with a variable x, gives the derivative function f (x).

7.5 Partial Fractions and Integration

Sequences and Series

Power Series. Part 2 Differentiation & Integration; Multiplication of Power Series. J. Gonzalez-Zugasti, University of Massachusetts - Lowell

Transcription:

Chapter 2 Infinite series, improper integrals, and Taylor series 2. Introduction to series In studying calculus, we have explored a variety of functions. Among the most basic are polynomials, i.e. functions such as p(x) = x 5 + 2x 2 + 3x + 2. These functions have features that make them particularly easy to handle: it is elementary to compute the derivatives and integrals of polynomials. Further, the value of such a function can be computed by simple multiplications and additions, i.e. by basic operations easily handled by an ordinary calculator. This is not the case for, say, trigonometric functions. For example, to find the decimal value of sin(2.5) we require a scientific calculator. The same difficulty occurs for exponentials and logarithms. For this reason, being able to approximate a function by a polynomial is an attractive proposition. This idea forms the core topic of this chapter. We have discussed linear approximations in differential calculus, Here we extend such elementary approximation methods. Our goal is to increase the accuracy of the linear approximation by including higher order terms (quadratic, cubic, etc), i.e. to find a polynomial that approximates the given function. We first review the idea of series introduced in Chapter. 2.2 The geometric series Recall the geometric series seen earlier this term: S n = + r + r 2 + r 3 +... + r n = n r k v.2005. - January 5, 2009

Math 03 Notes Chapter 2 We have seen a trick that helps to sum the series, namely multiplying both sides by r. This leads to S n = + r + r 2 +... + r n rs n = r + r 2 +... + r n + r n+ Subtracting the second line from the first and cancelling terms leads to ( r)s n = r n+. Solving for the sum S n leads to the observation made previously, namely that The sum of a finite geometric series, S n = + r + r 2 + + r n = n r k, is S n = rn+ r. (2.) We would like to investigate how this sum behaves when more and more terms of the series are included. Our goal is to find a way of attaching a meaning to the expression S n = r k, when the series becomes an infinite series. We will use the following definition: 2.2. The infinite geometric series Definition An infinite series that has a finite sum is said to be convergent. Otherwise it is divergent. Definition Suppose that S is an (infinite) series whose terms are a k. Then the partial sums, S n, of this series are n S n = a k. We say that the sum of the infinite series is S, and write S = a k, v.2005. - January 5, 2009 2

Math 03 Notes Chapter 2 provided that S = lim n n a k. That is, we consider the infinite series as the limit of the partial sums as the number of terms n is increased. In this case we also say that the infinite series converges to S. We will see that only under certain circumstances will infinite series have a finite sum, and we will be interested in exploring two questions:. Under what circumstances does an infinite series have a finite sum. 2. What value does the partial sum approach as more and more terms are included. In the case of a geometric series, the sum of the series, 2. depends on the number of terms in the series, n via r n+. Whenever r >, or r <, this term will get bigger as n increases, whereas, for 0 < r <, this term decreases with n. We can say that lim n rn+ = 0 provided r <. These observations are illustrated by two specific examples below. This leads to the following conclusion: The sum of an infinite geometric series, S = + r + r 2 + + r k + = r k, exists provided r < and is S = r. (2.2) Examples of convergent and divergent geometric series are discussed below. 2.2.2 Example: A geometric series that converges. Consider the geometric series with r = 2, i.e. Then S n = + 2 + ( 2) 2 + ( ) 3 +... + 2 ( ) n = 2 n ( ) k 2 S n = (/2)n+ (/2) v.2005. - January 5, 2009 3

Math 03 Notes Chapter 2 We observe that as n increases, i.e. as we retain more and more terms, we obtain In this case, we write lim S (/2) n+ n = lim n n (/2) n=0 = (/2) = 2. ( ) n = + 2 2 + ( 2 )2 +... = 2 and we say that the (infinite) series converges to 2. 2.2.3 Example: A geometric series that diverges In contrast, we now investigate the case that r = 2: then the series consists of terms S n = + 2 + 2 2 + 2 3 +... + 2 n = n 2 k S n = 2n+ = 2 n+ 2 We observe that as n grows larger, the sum continues to grow indefinitely. In this case, we say that the sum does not converge, or, equivalently, that the sum diverges. It is important to remember that an infinite series, i.e. a sum with infinitely many terms added up, can exhibit either one of these two very different behaviours. It may converge in some cases, as the first example shows, or diverge (fail to converge) in other cases. We will see examples of each of these trends again. It is essential to be able to distinguish the two. Divergent series (or series that diverge under certain conditions) must be handled with particular care, for otherwise, we may find contradictions or seemingly reasonable calculations that have meaningless results. 2.3 Trading a function for an infinite series The expression found above holds true for any number r whose magnitude is less than. Suppose we think of this number as a quantity we wish to vary - let us call it x to remind us that we consider it a variable. Then rewritten in terms of x, the expression we found is x = + x + x2 + x 3 +... when x < We wish to understand this in a new way: on the left we have a function, namely f(x) = x. On the right we have what looks like an infinite polynomial, i.e. a sum of terms that are all powers of x. This type of expansion is called a power series, since it consists of a sum of powers of x. We v.2005. - January 5, 2009 4

Math 03 Notes Chapter 2 will soon see that this power series is a particular example of a Taylor series, an expansion that can be helpful in approximating more complicated functions such as trigonometric or exponential functions. One way to think of this new connection between the function on the left and the series on the right is that it defines a whole set of polynomials, each one formed by keeping one more term in the (infinite) expansion, and each one a better and better approximation of the given function. For example, we could list the successive approximations as T 0 (x) = T (x) = + x T 2 (x) = + x + x 2 T n (x) = + x + x 2 +... + x n The first polynomial is just the value of the function at one point (at the point x = 0, it turns out). The second is the linear approximation, arrived at by using information about the derivative. The subsequent polynomials retain more and more details of the function, as we will shortly see. We so arrive at the Taylor polynomial of degree n, shown at the end of this list. As long as x <, the Taylor polynomials provide a better and better approximation for the function f(x) = /( x) as n gets larger. But we must take care, since if x >, the expansion will fail to converge - as we have already established previously. For example, the value x = leads to + + +..., which does not converge. As another example, if we let x =, the sum looks like this: + ( ) + + ( ) +... If we add the first two terms, we get zero. If we add the third term, we get. Adding the fourth term gives zero. As we continue term by term, the sum keeps flipping back and forth between 0 and. In this case, we also say that the sum does not converge. Thus this Taylor series is valid only so long as x <. The restriction x < is required to ensure that the infinite sum will converge to a finite result. We say that the radius of convergence of this series is. We have seen two ways in which a series can diverge: first, the sum may become unbounded, i.e. infinitely large. Second, the sum could jump from value to value without approaching any fixed value. In both cases, the series is divergent and will have little practical significance. 2.4 Improper integrals We will see that there is a close connection between certain infinite series and improper integrals, i.e. integrals over an infinite domain. Recall the following definition: v.2005. - January 5, 2009 5

Math 03 Notes Chapter 2 Definition An improper integral is an integral performed over an infinite domain, e.g. a f(x) dx. The value of such an integral is understood to be the limit a f(x) dx = lim b b a f(x) dx. i.e. we evaluate an improper integral by first computing a definite integral over a finite domain a x b, and then taking a limit as the endpoint b moves off to larger and larger values. Definition When the limit shown above exists, we say that the improper integral converges. Other wise we say that the improper integral diverges. With this in mind, we compute a number of classic integrals: 2.4. Example: A divergent integral I = x I = lim ln(x) b b b dx = lim b a x dx = lim b (ln(b) ln()) I = lim b ln(b) = The fact that we get an infinite value for this integral follows from the observation that ln(b) increases without bound as b increases. Thus the area under the curve f(x) = /x over the infinite interval x is not finite. We say that the improper integral of /x diverges (or does not converge). 2.4.2 Example: A convergent integral Now consider the related integral I = dx = lim x2 b b x 2 dx. Then b ( ) I = lim ( x ) b = lim b b =. Thus, this integral converges and we see that its value is. v.2005. - January 5, 2009 6

Math 03 Notes Chapter 2 2.4.3 When does the integral of /x p converge? More generally, consider By a similar calculation, we find that I = I = lim b ( I = lim b p x p dx. x p b ( p) ) (b p ) Thus this integral converges provided that the term b p does not blow up as b increases. This can only be true so long as p >. In this case, we have To summarize our result, I = p. x p dx { converges if p > diverges if p 2.4.4 Comparisons The integrals discussed above can be used to make comparisons that help us to identify when other improper integrals converge or diverge. The following important result establishes how these comparisons work: Suppose we are given two functions, f(x) and g(x), both continuous on some infinite interval [a, ). Suppose, moreover, that, at all points on this interval, the first function is smaller than the second, i.e. 0 f(x) g(x). Then the following conclusions can be made:. 2. If 3. If a f(x) dx under g(x).) a smaller one) a larger one.) a g(x) dx converges, then f(x) dx diverges, then g(x) dx. (This means that the area under f(x) is smaller than the area a a f(x) dx converges. (If the larger area is finite, so is the g(x) dx diverges. (If the smaller area is infinite, so is the v.2005. - January 5, 2009 7

Math 03 Notes Chapter 2 Example We can determine that the integral converges by noting that for all x > 0 x + x 3 dx x + x 3 x x 3 = x 2. Thus x + x dx 3 x dx 2 Since the larger integral on the right is known to converge, so does the smaller integral on the left. 2.5 Infinite series In this section we present a few classical series which are important landmarks and which carry special significance. These will be useful in our appreciation of the behaviour of infinite series. Geometric series We have already seen that The geometric series converges when r < and its sum is then S = n=0 If r the geometric series diverges. r n = r. The harmonic series The harmonic series is a sum of terms of the form /k where k =, 2,.... At first appearance, this series might seem to have the desired qualities of a convergent series, simply because the successive terms being added are getting smaller and smaller, but this is a misleading and deceptive observation! The harmonic series k= k = + 2 + 3 + 4 +... diverges v.2005. - January 5, 2009 8

Math 03 Notes Chapter 2.0 <==== the function y=/x The harmonic series 0.0 0.0.0 Figure 2.: The harmonic series is a sum that corresponds to the area under the staircase shown above. It can be shown that the harmonic series does not converge. by comparing it to an integral of the function y = f(x) = x. In Figure 2. we show a graph of this function superimposed on a bar graph. We will compare the areas of the steps in the bar graph with the area under the graph of this function. For the area of the steps, we note that the base width of each step is, and the heights form the sequence {, 2, 3, 4,... } Thus the area of (infinitely many) of these steps is A = + 2 + 3 + 4 + = + 2 + 3 + 4 +... = k. Thus the area of the bar graph is a geometric representation of precisely the series we are investigating, the harmonic series. On the other hand, the area under the graph of the function y = f(x) = /x is given by the improper integral x dx We have seen previously that this integral diverges! v.2005. - January 5, 2009 9 k=

Math 03 Notes Chapter 2 From Figure 2. we see that the areas under the function, A f and under the bar graph, A b, satisfy A f < A b. Thus, since the smaller of the two is infinite, so is the larger. We have established, using this comparison, that the the sum of the harmonic series cannot be finite, so that this series diverges. Other comparisons: The p series More generally, we can compare series of the form to the integral k= k p x p dx in precisely the same way. This leads to the conclusion that The p series, k= k p { converges if p > diverges if p For example, the series k= k 2 = + 4 + 9 + 6 +... converges. Notice, however, that the comparison does not give us a value to which the sum converges. It merely indicates that the series does converge. Alternating series We can modify the harmonic series to produce the alternating harmonic series in which the sign alternates from term to term. ( ) k+ k = 2 + 3 4 +... k= The alternating harmonic series converges due to the alternation of signs. (Consecutive terms nearly cancel out). We will see later how to show that this series converges, remarkably to the value ln(2). However, the convergence is slow : it takes many terms added together to get close to the v.2005. - January 5, 2009 0

Math 03 Notes Chapter 2 final value. The speed of convergence is important for practical reasons: if we want to devise a calculation that will help us to find an approximate decimal expansion of some number (such as ln(2)), we would certainly prefer to use a series that converges quickly, to reduce the number of calculations that have to be made. More generally, for alternating series with terms that are decreasing to zero, we have convergence, as summarized below. Suppose that successive terms a k and a k+ have opposite signs. Then, provided the terms are getting smaller so that a k 0, the alternating series converges. a k 2.5. Example In this example, we will consider the series We can see that this series converges by noticing: k! = + + 2 + 6 + 24 +... k! = 2 3... k 2 2... 2 = 2 k = ( ) k 2 if k 2. In other words, the series eventually becomes smaller than a geometric series which converges. k! = + + 2 + 6 + 24 +... < + + 2 + 4 + 8 +... + + 2 + 4 + 8 +... = + ( + 2 + ( 2 )2 + ( 2 )3 +...) ( ) k = + = + 2 = 3 2 Note that the series converges, and, moreover, converges to a number smaller than 3. v.2005. - January 5, 2009

Math 03 Notes Chapter 2 2.6 Finding Taylor series Now that we understand a little bit about when series converge, we will turn our attention to finding the series representations of some elementary functions. Using one series to find another Once we have identified the expansion of some function in terms of an infinite Taylor polynomial, we can build up many other expansions of related functions. In this section, we repeatedly use our geometric summation formula, together with substitution and/or some other operation to find interesting new conclusions. All examples are based on the fact (discussed earlier) that when u <. u = + u + u2 + u 3 +... = u k 2.6. Example: Simple substitution We make the substitution u = t, then u < means that t <, so the above formula for the sum of a geometric series implies that: ( t) + t = + ( t) + ( t) 2 + ( t) 3 +... = t + t 2 t 3 + t 4 +... This means we have produced the series for the function /( + t). 2.6.2 Example: Term by term integration We will use the results of Example 2.6., but we follow our substitution by integration. On the left, we integrate the function f(t) = /( + t) (to arrive at a ln type integral) and on the right we integrate the power terms of the expansion. We are permitted to integrate the power series term by term provided that the series converges. x 0 + t dt = x 0 ( t + t 2 t 3 + t 4...) dt ln( + x) = x x2 2 + x3 3 x4 4 +... = k= ( ) k+xk v.2005. - January 5, 2009 2 k

Math 03 Notes Chapter 2 This procedure has allowed us to find a series representation for a new function, ln( + x). ln( + x) = x x2 2 + x3 3 x4 4 +... When is this series expected to converge? We obtained this by starting with the geometric series which only converged when u <. We made the substitution u = t, and then integrated for 0 < t < x. To assure convergence, the value of t is not permitted to leave the interval t < so we certainly cannot expect the series for ln( + x) to converge when x >. Indeed, for x =, we have ln( + x) = ln(0) which is undefined. We also get a right hand side of ( + 2 + 3 + 4 +...) which is the divergent harmonic series preceded by a negative sign. Thus, we must avoid x =, since the expansion will not converge there, and neither is the function defined. An expansion for ln(2) Strictly speaking, our analysis does not predict what happens if we substitute x = into the expansion of the function found in Example 2, because this value of x is outside of the permitted range < x < in which the Taylor series can be guaranteed to converge. It takes some deeper mathematics (Abel s theorem) to prove that the result of this substitution actually makes sense, and converges, i.e. that ln(2) = 2 + 3 4 +... We state without proof here that the alternating harmonic series converges to ln(2). 2.6.3 Example Suppose we make the substitution u = t 2 into the geometric series formula, and recall that we need u < for convergence. Then ( t 2 ) = + ( t 2 ) + ( t 2 ) 2 + ( t 2 ) 3 +... + t 2 = t 2 + t 4 t 6 + t 8 +... = ( ) n t 2n This series will converge provided t <. Now integrate both sides, and recall that the antiderivative of the function /( + t 2 ) is arctan(t). Then x 0 + t 2 dt = x 0 arctan(x) = x x3 3 + x5 5 x7 ( t 2 + t 4 t 6 + t 8 +...) dt 7 +... = k= k+ x(2k ) ( ) (2k ) v.2005. - January 5, 2009 3

Math 03 Notes Chapter 2 An expansion for π For a particular application of this expansion, consider plugging in x =. Then arctan() = 3 + 5 7 +... But arctan() = π/4. Thus we have found a way of computing the irrational number π, namely π = 4 ( 3 + 5 7 ) ( ) +... = 4 ( ) k+ (2k ) While it is true that this series converges, the convergence is slow. (This can be seen by adding up the first 00 or 000 terms of this series with a spreadsheet.) This means that it is not practical to use such a series as an approximation for π. (There are other series that converge to π very rapidly.) k=. 2.6.4 Finding the coefficients directly from the function As indicated in the introduction, approximating functions by the sum of power functions (i.e. by a polynomial or a series) is helpful in practical calculations. For one thing, we can evaluate a polynomial (or finite series) more readily than functions such as arctan or ln. In the preceding discussions, we found some series representations of functions fortuitously. Here we set out to identify the connection by starting with the function of interest. Suppose we have a function which we want to write as f(x) = a 0 + a x + a 2 x 2 + a 3 x 3 +... = a k x k. We can use information about the function to directly determine the coefficients. To determine a 0, let x = 0 and note that f(0) = a 0 + a 0 + a 2 0 2 + a 3 0 3 +... = a 0 We conclude that a 0 = f(0). By differentiating both sides we find the following: f (x) = a + 2a 2 x + 3a 3 x 2 +... + ka k x k +... f (x) = 2a 2 + 2 3a 3 x +... + (k )ka k x k 2 +... f (x) = 2 3a 3 +... + (k 2)(k )ka k x k 3 +... f (k) (x) = 2 3 4...ka k +... v.2005. - January 5, 2009 4

Math 03 Notes Chapter 2 Here we have used the notation f (k) (x) to denote the k th derivative of the function. Now evaluate each of the above derivatives at x = 0. Then f (0) = a, a = f (0) f (0) = 2a 2, a 2 = f (0) 2 f (0) = 2 3a 3, a 3 = f (0) 2 3 f (k) (0) = k!a k, a k = f(k) (0) k! This gives us a recipe for calculating all coefficients a k. This means that if we can compute all the derivatives of the function f(x), then we know the coefficients of the Taylor series as well. Because we have evaluated all the coefficients by the substitution x = 0, we say that the resulting power series is the Taylor series of the function about x = 0. 2.6.5 Example: A Taylor series for e x Consider the function f(x) = e x. All the derivatives of this function are equal to e x. In particular, f (k) (x) = e x f (k) (0) =. So that the coefficients of the Taylor series are a k = f(k) (0) k! = k! Therefore the Taylor series for e x about x = 0 is a 0 + a x + a 2 x 2 + a 3 x 3 +... + a k x k +... = + x + x2 2 + x3 6 + x4 24 +... + xk k! +... = This is a very interesting series. We state here without proof that this series converges for all values of x. Further, the function defined by the series is in fact equal to e x that is, x k k! e x = + x + x2 2 + x3 6 +... = x k k! The implication is that the function e x is completely determined (for all x values) by its behaviour (i.e. derivatives of all orders) at x = 0. In other words, the value of the function at x =, 000, 000 is determined by the behaviour of the function around x = 0. This means that e x is a very special function with superior predictable features. If a function f(x) agrees with its Taylor polynomial on a region ( a, a), as was the case here, we say that f is analytic on this region. It is known that e x is analytic for all x. v.2005. - January 5, 2009 5

Math 03 Notes Chapter 2 Remark: How the exponential function grows We can use the results of this example to establish the fact that the exponential function grows faster than any power function x n. That is the same as saying that the ratio of e x to x n (for any power n) increases with x. We can see this fact directly from the results of our Taylor series for e x and the following simple division : e x x n = + x + x2 2! + x3 3! +... xn n! + xn+ (n+)! +... x n = x + n x +... + n n! + x (n + )! +... x > (n + )! We see that the last term becomes arbitrarily large as x, implying that e x lim x x = n This shows that the exponential function e x grows faster than any power function, and hence also faster than any (finite) polynomial. 2.6.6 Example: Other (related) exponential functions We can also easily obtain a Taylor series expansion for functions related to e x, without assembling the derivatives. We start with the result that e u = + u + u2 2 + u3 6 +... = Then the substitution u = x leads to the result The substitution u = x 2 leads to e x = x + x2 2 x3 6 +... = u k k! ( x) k. k! e x2 = + x 2 + (x2 ) 2 2 + (x2 ) 3 6 +... = (x 2 ) k k! In other words, e x2 = + x 2 + x4 2 + x6 6 +... = x 2k k! v.2005. - January 5, 2009 6

Math 03 Notes Chapter 2 2.0 T T3 T2 sin(x) T4-2.0 0.0 7.0 Figure 2.2: An approximation of the function y = sin(x) by successive Taylor polynomials, T, T 2, T 3, T 4. The higher Taylor polynomials do a better job of approximating the function on a larger interval about x = 0. 2.6.7 Example: Taylor series of simple trigonometric functions In this example we determine the Taylor series for the function f(x) = sin x. The derivatives of y = sin(x) are f(x) = sin x f (x) = cosx f (x) = sin x f (x) = cosx f (4) (x) = sin x and then the cycle repeats. This means that f(0) = 0, f (0) =, f (0) = 0, f (0) = and then the pattern repeats. In other words, a 0 = 0, a =, a 2 = 0, a 3 = 3!, a 4 = 0, a 5 = 5!,... Now it is a fact that sin x is analytic for all x so that sin x = x x3 3! + x5 5! x7 7! +... = ( ) n x 2n+ (2n + )! n=0 v.2005. - January 5, 2009 7

Math 03 Notes Chapter 2 Consider the sequence of polynomials T (x) = x T 2 (x) = x x3 3! T 3 (x) = x x3 3! + x5 5! T 4 (x) = x x3 3! + x5 5! x7 7! Then these polynomials provide a better and better approximation to the function sin(x) close to x = 0. The first of these is just a linear (or tangent line) approximation that we had studied long ago. The second improves this with a quadratic approximation, etc. Figure 2.2 illustrates how the first few Taylor polynomials approximate the function sin(x) near x = 0. To determine the Taylor series for cosx, we can simply differentiate the series for sin x. cosx = d dx sin x = d x3 (x dx 3! + x5 5! x7 7! +...) = 3x2 3! + 5x4 5! 7x6 7! +... We find that cos(x) = x2 2 + x4 4! x6 6! +... = n=0 ( ) n x2n (2n)! 2.7 Application of Taylor series In this section we illustrate some of the applications of Taylor series to problems that may be difficult to solve using other conventional methods 2.7. Evaluating definite integrals Some functions do not have an antiderivative that can be expressed in terms of other simple functions. Integrating these functions can be a problem, as we cannot use the convenience of evaluating that antiderivative at endpoints, as the Fundamental Theorem of Calculus specifies. In some cases, we can approximate the value of the definite integral using a Taylor series, as the following example illustrates. v.2005. - January 5, 2009 8

Math 03 Notes Chapter 2 Example Evaluate the definite integral 0 sin(x 2 ) dx A simple substitution (e.g. u = x 2 ) will not work here, and we cannot find an antiderivative. Here is how we might approach the problem using Taylor series: We know that the series expansion for sin(t) is Substituting t = x 2, we have sin t = t t3 3! + t5 5! t7 7! +... sin(x 2 ) = x 2 x6 3! + x0 5! x4 7! +... In spite of the fact that we cannot antidifferentiate the function, we can antidifferentiate the Taylor series, just as we would a polynomial: 0 sin(x 2 ) dx = = 0 (x 2 x6 3! + x0 5! x4 7! +...) dx ( ) x 3 3 x7 7 3! + x 5! x5 5 7! +... = 3 7 3! + 5! 5 7! +... This is an alternating series so we know that it converges. If we add up the first four terms, the pattern becomes clear: the series converges to 0.3026. 0 2.7.2 Solving differential equations Some differential equations cannot be solved in terms of familiar functions (just as some functions do not have antiderivatives which can be expressed in terms of familiar functions). However, Taylor series can come to the rescue again. Here we will present two examples of this idea. Example We are already familiar with the differential equation and initial condition that describes unlimited exponential growth. dy dx = y, y(0) =. v.2005. - January 5, 2009 9

Math 03 Notes Chapter 2 Indeed, from previous work, we know that the solution of this differential equation and initial condition is y(x) = e x, but we will pretend that we do not know this fact in illustrating the usefulness of Taylor series. In some cases, where separation of variables does not work, this option would have great practical value. Let us express the unknown solution to the differential equation as y = a 0 + a x + a 2 x 2 + a 3 x 3 + a 4 x 4 +... Our task is to determine values for the coefficients a i Since this function satisfies the condition y(0) =, we must have y(0) = a 0 =. Differentiating this power series leads to dy dx = a + 2a 2 x + 3a 3 x 2 + 4a 4 x 3 +... But according to the differential equation, dy dx match, i.e. = y, Thus, it must be true that the two Taylor series a 0 + a x + a 2 x 2 + a 3 x 3 + a 4 x 4 +... = a + 2a 2 x + 3a 3 x 2 + 4a 4 x 3 +... This can only happen if the coefficients of like terms are the same, i.e. if the constant terms on either side of the equation are equal, if the terms of the form Cx 2 on either side are equal, and so on for all powers of x. Equating coefficients, we obtain: This means that a 0 = a =, a = a = 2a 2, a 2 = a 2 = 2 a 2 = 3a 3, a 3 = a 2 3 = 2 3 a 3 = 4a 4, a 4 = a 3 4 = 2 3 4 a n- = na n, a n = a n- n = 2 3...n = n! y = + x + x2 2! + x3 3! +... + xn n! +... = ex which, as we have seen, is the expansion for the exponential function that is the real solution we have been expecting. In the example here shown, we would hardly need to use series to arrive at the right conclusion, but in the next example, we would not find it as easy to discover the solution by other techniques discussed previously. Example 2: Airy s equation Airy s equation arises in the study of optics, and (with initial conditions) is as follows: v.2005. - January 5, 2009 20

Math 03 Notes Chapter 2 As before, we will write the solution as a series: y = xy y(0) = y (0) = 0 y = a 0 + a x + a 2 x 2 + a 3 x 3 + a 4 x 4 + a 5 x 5 +... Using the information from the initial conditions, we get y(0) = a 0 = and y (0) = a = 0. Now we can write down the derivatives: The equation then gives y = a + 2a 2 x + 3a 3 x 2 + 4a 4 x 3 + 5a 5 x 4 +... y = 2a 2 + 2 3x + 3 4x 2 + 4 5x 3 +... y = xy 2a 2 + 2 3a 3 x + 3 4a 4 x 2 + 4 5a 5 x 3 +... = x(a 0 + a x + a 2 x 2 + a 3 x 3 +...) 2a 2 + 2 3a 3 x + 3 4a 4 x 2 + 4 5a 5 x 3 +... = a 0 x + a x 2 + a 2 x 3 + a 3 x 4 +... Again, we can equate the coefficients of x, and use a 0 = and a = 0, to obtain This gives us the first few terms of the solution: 2a 2 = 0 a 2 = 0 2 3a 3 = a 0 3 4a 4 = a a 3 = 2 3 a 4 = 0 4 5a 5 = a 2 a 5 = 0 5 6a 6 = a 3 a 6 = 2 3 5 6 y = + x3 2 3 + x 6 2 3 5 6 +... If we continue in this way, we can write down many terms of the series. v.2005. - January 5, 2009 2