A Class of Numerical Integration Rules With First Order Derivatives

Transcription

1 A Class of Numerical Integration Rules With First Order Derivatives Mohamad Adnan AI-Alaoui" Abstract A novel approach to deriving a family of quadrature formulae is presented. The first member of the new family is the corrected trapezoidal rule. The second member, a two-segment rule, is obtained by interpolating the corrected trapezoidal rule and the Simpson one-third rule. The third member, a three-segment rule, is obtained by interpolating the corrected trapezoidal rule and the Simpson three-eights rule. The fourth member, a four-segment rule is obtained by interpolating the two-segment rule with the Boole rule. The process can be carried on to generate a whole class of integration rules by interpolating the proposed rules appropriately with the Newton-Cotes rules to cancel Out an additional term in the Euler-MacLaurin error formula. The resulting rules integrate correctly polynomials of degrees less or equal to n+3 if n is even and n+2 if n is odd, where n is the number of segments of the single application rules. The proposed rules have excellent round-off properties, close to those of the trapezoidal rule. Members of the new family obtain with two additional fianctional evaluations the same order of errors as those obtained by doubling the number of segments in applying the Romberg integration to Newton-Cotes rules. Members of the proposed family are shown to be viable alternatives to Gaussian quadrature. Key words: Numerical integration. Interpolation. Round-off error. Truncation error. Simpson's rule. Trapezoidal rule. Boole's rule. Newton-Cotes rules. Gaussian quadrature. Romberg integration. * Tile author is with tile Department of Electrical and Computer Engineering, American University of Beirut, Beirut, Lebanon. This work was supported in parl by The University Research Board of the American University of Beirut. 25

2 I. Introduction The problem of numerical integration, or quadrature, is that of estimating the number b I(f) = If(t)dt (1) O with [a,b] finite, [5], [9-12], [14-16], [18-19], [22], [24], [26], [28-29]. The fundamental theorem of calculus proves that the definite integral of a function that has an antiderivative exists and has a value equal to the difference of the values of the antiderivative evaluated at the upper and lower limits of the integral. However, since most integrands do not have antiderivatives expressible in terms of known functions, methods of approximating the definite integrals are employed. There are also occasions for which the analytical form of the integral is known but is too expensive to evaluate and it is cheaper to evaluate it using a quadrature technique, polynomial approximation is often used, with f(t) replaced by an approximating polynomial p(t). Among the most popular methods for approximating the evaluation of the definite integrals are the trapezoidal rule and the Simpson rules. To improve the approximation, the interval of integration is subdivided into smaller subintervals, or segments, and multiple-application versions of the above rules, often called the composite rules, are employed. Increasing the number of segments results in decreasing the error until the round-off errors begin to dominate and the error begins to increase. In addition, increasing the number of segments increases the computational effort. Hence, if high efficiency and low errors are required, it is advisable to use the Romberg integration to obviate the shortcomings of the traditional rules. The Romberg integration generalizes the Richardson's extrapolation which consists of weighting the results obtained from using different numbers of segments. This latter approach yields lower errors but does not necessarily achieve a higher efficiency since the number of segments is not necessarily reduced drastically [5], [9-12], [14], [16], [18-19], [22], [24], [26]. Members of the new family achieve both higher efficiency and lower errors than those possible by using the multiple application Newton-Cotes rules. The roundoff properties of the proposed rules are close to those of the trapezoidal rule. In addition polynomials of degrees less than or equal to five are integrated correctly by the two-segment and three-segment rules while polynomials of degrees less than or equal to seven are integrated correctly by the four-segment rule. Thus for four or less segments the members of the new class yield error expressions that are better or equivalent to those obtained for Gaussian integration. The new rules are competetive with the Romberg integration applied to the traditional Newton- Cotes integration formulas, for with two additional functional evaluations they achieve what the Romberg integration would achieve by doubling the number of segments. The examples show that the new rules are competetive with Gaussian quadrature. 26

3 II. The Basic Concept The author's interest in differentiators and integrators resulted in the design of analog and digital differentiators and integrators that simulate numerical differentiation and integration [1-8]. The relationships between numerical and digital integrators was noted earlier by Hamming [16-17]. In this paper, observations of the frequency responses of digital integrators are reflected in the design of the proposed numerical integrators. The basic concept for the development of the proposed numerical integration rules came from observing that the ideal integrator absolute magnitude response versus frequency lies between the responses of the trapezoidal rule and the Simpson rule [16], [6], [8]. The initial research started with interpolating the trapezoidal and Simpson integration rules motivated by the results in [8]. The final outcome of the research, however, is a class of integration rules that result from the cancellation of a term in the Euler-Maclaurin error formula for each rule as compared to the Newton-Cotes rules with the same number of segments. The first member of the class is the corrected trapezoidal rule. The first four members of the class are shown below for n = 1, 2, 3, 4. Where n designates the number of segments and h = a ~). (b - Note that n is also used later to designate the n number of segments in the composite rules. All the following rules, including the derived rules, have truncation errors of the form E" = Chkf(k)(rl) + higher-order-wmls, (2) where C is a constant, k is an integer, and rl is in [a,h]. The rules assume that f(t) is k continuously differentiable in [a,b ] and thus are guaranteed to converge as n--+oo, where n refers to the number of panels in a composite rule, provided that the norm of the derivatives remain finite. 1) n = 1' (b - a) 2 Ii((f) - (b-a------~[f(a)+ f (b)] + [f(l)(a)- f(1)(b)] 2 12 h4(b-a)f(4)(q) 4 +- higher - order" - terms. 72 2) n =2: 7h 16 a+b I2 (f) = -i~[ f(a) + -~- f(--~--) h 6 (b - a)f (6) (r h ) h 8 (h -- a).f (8) (q2) f(b)] + h2 "(') f(l) (b)] l [t (a)- + higher- order - terms. (3) (4) 27

4 3) n=3" 3h 13 (f) = ~-7[13f(a) bu 3h f (a + h) + 27f (b - h) + 13f (b)] + -~- [f (1) (a) - f (1) (b)] 3h 6 (b - a)f (6) (rl) 11,2 ~- higher - order - terms. (5) 4) n = 4: 2h a+b I4(f) = -~-[-~- f (a) +-~-i- f (a + h) +-~- f (2-~-) +-~-i- f (b- h) + :~ f (b)] 4h2 fo) 12hS(b-a)f(8)(q) +higher-order-terms. + if (a) - (b)] ,675 (6) III. The Two-Segment Intel~ration Rule The first error terms of the corrected trapezoidal integration rule and the Simpson integration rules involve the fourth derivative and are of opposite signs. The proposed twosegment integration rule is obtained by combining the corrected trapezoidal rule with the Simpson one-third rule. The error formulas for the resulting rule involve the sixth derivative while those of the constituent rules involve the fourth derivative. In the following, the traditional rules and their properties are presented in a) and b) while the proposed rule is developed in c). a) The Corrected Trapezoidal Rule: The simple trapezoidal rule is based on approximating f(t) of equation (1) by a straight line (a,f(a)) and (b,f(b)). Adding the first error term to the trapezoidal rule results in the following corrected trapezoidal rule [9], [11]. (b -- a) 2 (1 ii Or ) _ a (b )- [f(a) + f(b)] + [f(l) (a) -f ) (b)], (7) 2 12 where f(i)(13 ) denotes the ith derivative of f(t)evaluated at t= 13. The corrected composite trapezoidal rule is obtained by breaking up the integral into a sum of integrals over small subintervals and then applying the above rule to each of these smaller integrals. The resulting corrected composite trapezoidal rule is n-i II Q]c) =h Q]ci)-- (f +f.)+-i-~-[f(l)(a)-f(1)(b)], i=l (8) 28

5 where n is an integer such that, b-a n>l, h= t.=a+/h and.//_. =f(tj ) n J " The error of the composite corrected trapezoidal rule is [8] E l = IC/" ) - I[' (f) = f (4)(rl)h 4 (b - a) " + higher - order - terms 72 (9) for some 1"1 in [a,b]. The error of the composite corrected trapezoidal rule could also be expressed by the following asymptotic error formula [26] n n h4 E l = l(:)- ]I (:)= 7~[.]~} 3)./o f(3) ] + higher- order- temps. (1) The above error formula may also be written as El' = E: '4 + higher- order - terms. (11) b) The Simpson Rule: The Simpson one-third rule, which will be denoted simply as the Simpson rule, interpolating polynomial to approximate f(t) on [a,b] and results in l.,.(f)=hlf(a). (a+b' +4f~ -~---J +f(h) 1 uses a quadratic (12) where, h - (b - a) 2 h /.'s.' (.f) = ~- [f + 4fl + 2../2 + 4f3 + 2 f ~, ,_ 1 + Z, 1" (13) The composite Simpson rule is given by where n and k are integers such that, b-a n:2k, k_>l h-, t i=a+jh and fj=f(tj). n The above equation can be written more compactly as n/2 I; = ~ Z [f2./-2 4.:2./-I +.:2./]" (I 4)./=1 29

6 The error of the composite Simpson rule is given as [6] E~' = l(f)- I~" (/`)=- h 4 (b - a)f (4) (rl) 18 + higher order terms, (15) for some ~ in [a, b]. The error could also be expressed by the following asyrnptotic error formula [9] h 4 E," = 18 [./,-(3) (b) -./-(3) (a)] + higher - order - terms. (16) The above equation could be expressed as E~ = ~..h4 --s + higher order terms. (17) c) The Two-Segment Rule, I~ The two-segment integration rule, I~ is obtained by combining the corrected composite trapezoidal rule with the composite Simpson rule in such a fashion that the error contributions of E~' and of E.~" cancel out. Note that n should be restricted to being even for meaningfial interpolation, since n is always even for the Simpson rule. The two-segment integration rule can be obtained as follows n n I, =cd.,". +(1-oI,. (18) Solving for ot in the equation ~4 h 4 ore.. +(I-or)E, =, (19) yields the value ot =.2, from the resulting solution. The resulting composite two-segment rule is ln=~k =2in=2k +.8i,,=2k k>l. 2 s I ' -- (2) The simple two-segment rule is obtained from the above composite rule with the value of n taken as 2. The error of the cornposite two-segment rule, E~, may be expressed as 3

7 E 2 n=.2e, n +.8El. n (21) Thus for the composite two-segment rule the resulting error is obtained by adding the error contributions of the higher order terms of the composite corrected trapezoidal rule,[18, p.32],[24, p. 117], to the error contributions of the higher order terms of the composite Simpson rule [9]. The resulting asymptotic error formula is.2h6 [f(5) _ f(5).8h6 [f(5) f(5) E (b) (a)] - - (b) - (a)]. (22) ,24 Simplifying the above equation and adding the contribution of the next higher term we obtain _ 6 h 8 [f(7) (b) - f(7~ (a)] h (57 fo) (a)] - (23) En 9~ [f (b)- 756 This implies that the error should be reduced by a factor of 26=64, as h is halved. An alternative form for the error is h6 (b - a)f(6)('rll ) hs(b- a)f(8)(rh) E~ = for some rl~ 's in [a, b]. (24) From this it is seen that E~ = if fit) is a polynomial of degree _<5. It should be noted that the error term of equation (24) is the same as that of the Boole rule except for a constant multiplier. The constant multiplier corresponding to the new rule is smaller than that of the Boole rule by a factor of 2. The two-segment rule is clearly superior to its constituent rules as derived above and as demonstrated by the following examples. The simple form of the resulting two-segment rule is I,(f)=7h[f(a)+16 a+b h2[f(')(a)- 15 -~- f(--~--) + f(b)] + f(')(b)], (25) where h = (b- a) 2 The resulting composite rule is given by n/2, 7h Z 12 = 1~ [f2j-2 16 h 2 +-~-.f2.i-i +f2jl+-~-[f(1)(a)-f(l)(b)], j= 1 (26) where n = 2k, k _> 1, b-a h-, tj = a +.j# and fj = f(tj). tl Note that the simple rule is obtained from the composite new rule by using n = 2. 31

8 It is remarkable that this rule was derived by Cornelius Lanczos in 1956, [19] pp , using a different approach. The derivation presented in this paper is simpler and more direct than that of Lanczos. Lanczos derivation is not widely known and most of the literature mention the Simpson rule with end corrections using second order derivatives [5], [9-12], [14], [16], [18], [22], [24], [26]. One factor that works against the use of high order Newton-Cotes formulas is that the higher order formulas show greater fluctuation of the weights and larger round-off errors. It will be shown that the round-off properties of the members of the proposed class are closer to the roundoff properties of the trapezoidal rule. The two-segment rule round-off properties are better than those of the Simpson rule and close to those of the trapezoidal rule. This is to be expected since the new rule is eighty percent trapezoidal. An estimate of the value of round-off error can be measured by computing the sum of the square of the weights of f(t) in the integration formula [12], [25]. The sum of the squares of the coefficients in the composite trapezoidal rule is h2(n ;), while the sum of the squares of the coefficients in the composite Simpson rule is h2(1~ n ~-]=h2(1.1111n-.2222).thesumofthesquaresofthecoefficientsinthe composite new two-segment integation rule is h2(1.44n ), which is closer to the value corresponding to the composite trapezoidal rule. IV. The Three-Segment Integration Rule The proposed three-segment integration rule is obtained by combining the corrected trapezoidal rule with the Simpson three-eights rule. The error formulas for the resulting new rule involve the sixth derivative whereas those of the constituent rules involve the fourth derivative. In the following the three-eights rule is presented in a) while the new rule is developed in b). a) The Three-Eights Rule The third of the Newton-Cotes rules is obtained by fitting a third order Lagrange polynomial to four points. This rule is often called the Simpson three-eights rule and will be denoted simply as the three-eights rule. The simple form of the rule is 13/8 (f)=3h8-~f (a)+3 f (a+h)+3 f (b-h)+ f (b)]. (27) The composite three-eights rule is n/3 I3/s,, = Z ij,; ~j_2 + 3./;./_1 +./;j], j=l where, n = 3k, k _> 1, that is n is restricted to be a multiple of 3, h= b-a, t.=a+/h andf,=.l'(tj). n.1 "./ (28) 32

9 The error formula for the 3/8 rule is given by,, h 4 (b E3/8 _ - a).1,.(4) (rl) + higher- order- terms, 8O for some ri in [ a, b ]. The error could also be expressed as E~l/8 = ~3/8 L 7"h4 + higher- order- terms. (29) (3) b) The Three-Segment Rule 13 : The three-segment rule is obtained as follows I~ =cd~/8 +(1-a)I~. Solving for oc from the equation (31) a- h 4 (b-a) f(4) (zt)+(l_ a) h 4 (b-a) f(4) (V)= ' 8 72 yields the value ot =.1 from the solution. (32) The resulting asymptotic error formula is.1h 6.9h 6 E~ - [f(~(b) - f(5~(a)] [f(5)(b) - f(5)(a)] (33) 336 3,24 Simplifying the above equation yields E n _ 3h 6 [f(5)(b )_ fcs)(a)] " 3 11,2" - - (34) This implies that the error should be reduced by a factor of 36 if h is reduced to one third of its value. An alternative form of the error is 3h 6 (b - a)f (6) (rl) E~ = (35) 11,2 for some r/in [a,b]. From this it is seen that E~ = if f(t) is a polynomial of degree less than or equal to five. It should be noted that the error term of equation (35) is the same as that of the Boole rule except for a constant multiplier. The new rule is smaller by a factor of almost eight. Forn =3 the following simple form of the new rule is obtaind qh 13 (f) = -"[13f(a) + 27f(a + h) + 27f(b - h) + 13 f(b)] + ~'--Z--" [ f (1) (a) -.) 4"(1) (b)]. (36) 8 " " 4 " 33

10 The composite form of the three-segment rule is i3 _.~j=,n = S ''n/3 ~-~[13h 3f3j_3 +27f3j_2 +27f3j_l +13f~j]+ [f )(a)-f(')(b)], (37) where n is a multiple of three, h= b-a, t.=a+jh, and Jf~='f(tJ)" n J Note that the simple form of the three-segment rule is obtained from the composite new rule by letting n = 3. The round-off properties of the three-segment rule are closer to those of the composite trapezoidal rule, since the new rule is ninety percent trapezoidal. The sum of the squares of the coefficients in the composite three-eights rule is h2(1.313n ) while the sum of.the squares of the coefficients of the composite three-segment rule is h 2(1.3n ). Thus the three-segment rule has even better round-off properties than the two-segment rule. V. The Four-Segment Integration Rule The error terms of the two-segment rule and the Boole rule involve the sixth order derivative and are of opposite signs. The four-segment integration rule is obtained by combining the twosegment rule and the Boole rule. The error formula for the resulting new rule involves the eighth derivative. In the following the Boole rule properties and how it compares with the two-segment and three-segment rules developed above is presented in a), while the four-segment rule is developed in b). a) The Boole Rule The Boole rule is the fourth of the Newton-Cotes rules. It is obtained by fitting a fourth order Lagrange polynomial to five points. The simple form of the rule is 2h =.. 2 f (:-~--) +32f(b -h) + 7f(b)l. lb(.f) _~517 f (a) + 32 f (a +h) + l " a +b (38) The composite form of the Boole rule is,,/4 2h I~(f) = Z ~-[Tf4j_ f4j_ f4j_ ~ + 32f4j_, + 7f4j], j- _ (39) where n = 4k, k _> 1, that is n is restricted to be a multiple of 4, b-a h- - --, tj = a +.jh and.fj = f(tj ). 11 The error formula for the Boole rule, negecting higher order terms is given by 34

11 2h6(b - a) hs(b - a) f(8) E~ - f(6) (1"1) a (rl) (4) for some rl in [ a, b ]. The error could also be expressed by the following asymptotic error formula EB-" 2h [f )(b)- f ) (a)] + [f(7) (b)- f(7) (a)] ' (41) The error terms of the two-segment rule and the Boole rule are of the same order. Comparing the first error term of equation (24) with that of equation (4), it is found that the two error terms differ only by a negative constant multiplier and that the error of the two-segment rule is smaller in magnitude than that of the Boole rule by a factor of 2. For the three-segment rule, comparing (35) with (4), it is found that the error of the new rule is smaller in magnitude than that of the Boole rule by a factor of b)the Four-Segment Rule, 14 The first error terms of the Boole rule, the two-segment and three-segment rules involve the sixth derivative and are of opposite signs. A four-segment integration rule is obtained by combining the Boole rule with the two-segment rule in such a fashion that the first error terms of equations (24) and (4) cancel out. The derivation is similar to that carried out in equations (18)-(24). The resulting new integration rule is given by i~ k 2i.=4k 2~ -- " = + I~ =4k, k > (42) The simple form of the rule is 2h f(a+h)+_~_f(T)+512_~_ 31 i4 (f) = _4_~ [ ~f (a) 144 a+h 4h2 -) + [.] (a)-f(l)(b)], 63 (43) where h- (b- a) 4 35

12 The resulting composite rule is given by n/4 I~' ((f) = 2-z "~'[-~j=l 4h [f (1)(a) (b)], 63 2h _ 144 _ 512 _ f4j-4 + -~-.]4.i-3 + -~-.]4j i.t A j] (44) wheren=4k,k>l,h--- b-a tl, tj : a +.jh and fj =f(tj). The resulting error formula is obtained from substituting equations (2) and (36) in (38), which yields 12h8 (b - a)f~(n) n g 4 = (45) The error expression in (45) is of the same form as that of the six segment Newton-Cotes rule, but smaller by a factor of ahnost 16. The round-off properties of the four-segrnent rule are closer to the trapezoidal rule since it is about ninety five percent a two-segment rule which in turn is ninety percent trapezoidal. The sum of the squares of the coefficients of the Boole rule is h2(1.1793n -."1936), while the sum of the squares of the coefficients of the composite four-segment rule is h2(1.7n ). VI. Comparison With The Romberg Integration and The Gaussian Quadrature In comparison with the Romberg integration, it is found that the proposed rules, with two additional functional evaluations, achieve error expressions of the same order as those achieved by doubling the number of segments, ahnost doubling the number of functional evaluations, using the Romberg integration. The Newton-Cotes Integration rules are exact for polynomials of degree n + 1, if n is even and for polynomials of degree 11 when n is odd, where n is the number of segments of the single application rules. The rules of the new family are exact for polynomials of degree n +3 if n is even and for polynomials of degree n +2 if n is odd. The Gaussian integration rules are exact for polynomials of degrees < 2 n - 1, where n is the number of the nodes. The two-segment rule, i.e. three nodes, is exact for polynomials of degrees < 5 which makes it equivalent to the Gaussian 36

13 rules with 3 nodes. The new four-segment rule, i.e. five nodes, is exact for polynomials of degree _< 7 which makes it equivalent to the Gaussian rules with four nodes. Gaussian quadrature formulas of high order suffer even more than the Newton-Cotes formulas from having high order derivatives in the error terms. Additionally, the sum of the squares of the coefficients of the Gaussian quadrature formulas of high order is greater than that corresponding to the composite new rules. This is because the higher formulas have the tendency to greater fluctuation of the weights as the order increases [11],[25]. Thus, it is advisable to use composite rules using Gaussian quadrature formulas of low order. That is, we can break up the interval into subintervals and use a Gaussian formula in each subinterval. Note that we do not get the advantage of having some of the abscissa common to two subintervals as in the case of the Newton-Cotes formulas. In this case the new rules with their higher accuracy provide viable alternatives to Gaussian quadrature. In the examples the proposed rules are indeed shown to be competetive with the Gaussian quadrature formulas of high order. VII. Examples The computations were carried out using Mathcad 5. on an IBM-PC compatible 486-DX2 running at 66 Mhz. The machine epsilon is 2.77E-17. Mathcad has a maximum of 15 significant digits, and all the computations were carried out using 15 significant digits. Examples 1-3 verify the theoretical expectations of the proposed rules. Tables 1-3 summarize the results. They show the results and the relative errors obtained from applying the Boole rule, the Gauss-Legendre quadrature, the two-segment rule and the four-segment rule. It is to be noted that n represents the number of nodes for the Gauss-Legendre quadrature and the number of segments for the other rules. The results of the application of the three-segment rule is not shown since they are similar to those of the two-segment rule. However, the three-segment rule should be considered when low round-off error is desired, since its round-offerror properties are close to those of the trapezoidal rule. The tables also display the Relative Error,E n,for each of the rules where Relative Error = True Value - Computed Value (46) True value Example 1. This example is used by Smith [27]. In it the integrand is f(x)=cosx, and is integrated over the interval [, 1 ]. Thus the integral to be evaluated is I = [lcos xdx (47) It is significant that with 64 segments the relative error is less than that obtained by using the traditional trapezoidal and Simpson rules with 1 segments or even 1, segments as reported by Smith. For this example the proposed rules are clearly superior to the Gaussian quadrature. 37

14 Example 2. The integral to be evaluated is I = - - dx (48) a-4 l+x 2 The value of the above integral is I = 2arctan(4) ~ Table 2 shows that the new rules converge in a manner similar to that of the Gaussian quadrature with a slight edge for the proposed rules for small n. Example 3. This example is used extensively by Atkinson [9]. In it the integrand is f(x)=excosx and is integrated over the interval [, 7t]. Thus the integral to be evaluated is I = e cos(x)dx. (49) (e" + 1) The true value of I is I----~ Table 3 shows that although the 2 Gaussian integration is better for small n. The proposed rules give better results for large n. VIII. Conclusion This paper presents a novel class of numerical integration rules. The first member of the class is the corrected trapezoidal rule. The second and third members of the class, a two-segment and three-segment rules, are obtained by interpolating the corrected trapezoidal rule and the Simpson rules so that their error O(h 4 ) terms cancel out. The resulting rules have an O(h 6) errors and the errors are proportional to the sixth derivative. The fourth member of the new class is obtained by interpolating the second member of the new class with the Boole rule so that their O(h6)error terms cancel out and the new rule has an error O(h 8) and is proportional to the eighth derivative. The process can be carried on to generate a whole class of new integration rules by interpolating the new rules appropriately with the Newton-Cotes rules to cancel out an additional term in the Euler-MacLaurin error formula. The salient points of the proposed rules are: 1. The proposed rules, like the Newton-Cotes rules, are equal segment rules so they can be applied where Gaussian rules would be inappropriate. 2. The proposed rules were shown to have excellent round-off error properties, close to those of the trapezoidal rule. This make them viable alternatives to Gaussian quadrature, as demonstrated by the examples. This is due in part to the fact that Gaussian quadrature formulas of high order suffer from having high order derivatives in the error ten-ns even more than the Newton-Cotes rules [9], [25]. 38

15 3. The proposed rules obtain with two additional functional evaluations the same order of errors as those obtained by doubling the number of segments in applying the Romberg integration to the Newton-Cotes rules. 4. Applying the Romberg integration to the proposed rules could make them more competetive with the Gaussian quadrature. 5. The proposed rules cannot be applied when the integrand first derivative has singularities at the upper or lower limits. However, an approximation of the derivative may be used. Polya has proved that for continuous functions with singularities in derivatives, the tapezoidal and Simpson rules and others of similar types should converge to the correct integral [23]. Polya's remarks are applicable to the new rules since they are obtained by interpolating the traditional rules. As an alternative Davis shows, by a generalization of the Peano kernel formulation, that the traditional integrals converge, and thus so do the new rules [12]. Lyness and Ninham show that for integrands with algebraic and/or logarithmic singularities, it is often possible to obtain an asymptotic error expansion [2]. 6. The proposed rules exhibit rapid convergence for periodic integrands, this is due to the fact that they are close to the trapeziodal rule in their properties. This was verified for the integral I= ems(x)dx and the results were omitted for brevity. Donaldson and Elliot had ~ demonstrated the superiority of the trapezoidal rule for periodic integrands [ 13]. Acknowledgment It is a pleasure to thank Professors Thomas Kailath and C. L. Nikias for providing the atmosphere conducive to research by inviting me to spend the summers of 1991 and 1993 at Stanford's Information Systems Lab. and the USC Signal and Image Processing Institute, respectively. Thanks are also due to S. Maad, D. Matar and M. Shmaitelly for their help in running the examples. 39

16 REFERENCES [1] M. A. Al-Alaoui, "A Stable Differentiator With a Controllable Signal-to-Noise Ratio", IEEE Transactions on Instrumentation and Measurement, Vol. 37, No. 3, pp , September, [2] M. A. AI-Alaoui, "A State Variable Approach to Designing a Resistive Input, Low Noise, Noninverting Differentiator", IEEE Transactions on Instrumentation and Measurement, Vol. 38, No. 4, pp , August, [3] M. A. AI-Alaoui, "A Novel Approach to Designing A Noninverting Integrator With Built-In Low-Frequency Stability, High-Frequency Compensation and High Q", IEEE Transactions on Instrumentation and Measurement, Vol. 38, No. 6, pp , December, [4] M. A. AI-Alaoui, "A Novel Differential Differentiator", IEEE Transactions on Instrumentation and Measurement, Vol. 4, No. 5, pp , October, [5] M. A. AI-Alaoui, "Novel Approach to Designing Digital Differentiators," Electronics Letters, Vol. 28, No. 15, pp , [6] M.A. AI-Alaoui, "Novel Digital Integrator and Differentiator," Electron. Lett., Vol. 29, No. 4, pp , (See also ERRATA, Electron. Lett., Vol. 29, No. 1, pp. 934, 1993.) [7] M. A. M-Alaoui, " Novel IIR Differentiator From The Simpson Integration Rule", IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications, Vol. 41, No. 2, pp , February [8] M. A. AI-Alaoui, "A Class of Second Order Integrators and Lowpass Differentiators," IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications, vol. 42, no. 4, pp , April [9] K E. Atkinson: An Introduction To Numerical Analysis Ch.5, Second Edition. New York, NY: John Wiley & Sons, [1] S. C. Charpa and R. P. Canale: Numerical Methods for Engineers, Ch.15, Second Edition. New York, NY: McGraw-Hill, [11] S. D. Conte and Carl de Boor: Elementary Numerical Analysis, Ch.7, Third Edition, New York, NY: McGraw-Hill, 198. [12] P. J. Davis and P. Rabinowitz: "Methods of Numerical Integration ", Second Edition. New York, Academic Press Inc., [13] J. Donaldson and D. Elliot, "A unified approach to quadrature rules with asymptotic estimates of their remainders", SIAM J. Numer. Anal. 9, pp ,

17 [14] G. E. Forsythe, M. A. Malcolm and C. V. Moler: Computer Methods for Mathematical Computations, Ch 5. Englewood Cliffs, NJ: Prentice-Hall, Inc.,1977. [15] L. Gillman, "An axiomatic approach to the integral", The Aunerican Mathematical Monthly, Vol. 1, No. 1, pp , January [16] R. W. Hamming: Numerical Methods for Scientists and Engineers. New York, NY: McGraw-Hill, [17] R. W. Hamming: Digital Filters, Second Edition. Englewood Cliffs, NJ: Prentice-Hall, [18] F. B. Hildebrand: Introduction to Numerical Analysis, Second Edition. New Delhi: TATA McGraw-Hill, [19] C. Lanczos: Applied Analysis Ch. VI, New York, Dover Publications Inc., [2] J. Lyness and B. Ninham, " Numerical quadrature and asymptotic expansions", Math. Comput. 21, pp , [21] M. Mori and R. Piessens, ed. : Numerical Quadrature, North-Holland, [22] S. Nakamura: Applied Numerical Methods in C, Ch.4. Englewood Cliffs, NJ: Prentice-Hall, [23] G. Polya, "Uber die Konvergenz von Quadraturverfahren." Math. Z., 37,pp , [24] W. P. Press, B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling : Numerical Recipes. Cambridge University Press, [25] A. Ralston, "Methods for Numerical Quadrature," pp in Mathematical Methods for Digital Computers. Edited by A. Ralston and H. S. Wilf. New York: John Wiley & sons, Inc [26] F. Scheid: Theory and Problems of Numerical Analysis, Ch. 14 : New York, NY: Schaum's Outline Series, McGraw-Hill Inc., [27] J. T. Smith: C++ Applications Guide, Ch.4. New York: McGraw-Hill, [28] S. K. Stein, "Do estimate of an integral really improve as n increases?", Mathematics Magazine, Vol. 68, No. 1, pp , February [29] J. Wimp, "Quadrature with generalized means", American Mathematical Monthly, Vol. 93, No. 6, pp , June-July

18 E N I ~b i ~ C ~ "~" "-~ "~ " '~ E i, I I : I I I I I!'~-iO a', a', a', ", a'~ ir"-i, ~ O,O ~ ~ ~ *l i i "~ c~l m o m ~ -~-~ "~::~" I'-1 t. ~ ~ X ~ W u II E < ~ ~.~ o ~ o o o o 42

19 r~! L oo c~ m ~o c'4:~ it") ~ c-41 '~ '4 '-1 t~ o..., oo N ~D it3 oo ~1 oo ~ o,3 ',D c~ oo oo "~- ~ m m ~ oo ~ m c~3 c -i %,- ~ t '3 ',D o c-i c~ 'c~'~ m ~ = 14,,"~ i it") E > c~ oo,r") it"l it'3 c~ c'4 c'4 m cq o E oo I'~ oo c~ c.i ~ oo 43

20 I c...,c~ L~ T-.q 2 i,rq f,,i ~'-.I t"q ~",11",1 ~ O I"~- O I ~,--~ E t..,,i t~l O,~ -- O ~, ~ ~ f",-i ~,--~ N ~ ~ ~ ~ O t..,,l i -.~ ~,D ~ r',.ll M ~ v J,r~ "~-;r--- ",.o > % m ~ ~ ~ ~ r, 44