2
|
|
- Harry Holmes
- 6 years ago
- Views:
Transcription
1 1 Notes for Numericl Anlysis Mth 5466 by S. Adjerid Virgini Polytechnic Institute nd Stte University (A Rough Drft)
2 2
3 Contents 1 Differentition nd Integrtion Introduction Numericl Differentition Approximting first-order derivtives Approximting second-order derivtives Forwrd nd bckwrd difference formuls Effects of round-off errors Numericl Integrtion Newton-Cotes formuls Composite qudrtures: Error nlysis Romberg method Guss Qudrture Multiple integrls
4 4 CONTENTS
5 Chpter 1 Differentition nd Integrtion 1.1 Introduction In this chpter we will develop nd study wys to pproximte derivtives nd integrls. Approximting derivtives is very importnt in constructing finite differences methods for solving differentil equtions. Finding pproximte vlues of integrls is importnt in its own ske other res such s defining multistep methods for ordinry differentils equtions nd finite elements methods for solving prtil differentil equtions. 1.2 Numericl Differentition Approximting first-order derivtives We seek to pproximte the derivtive of function f using vlues of f t severl points. First-order formuls We first note tht the derivtive is defined s the limit of the rtio f 0 f(x + h) f(x) (x) =lim : (1.1.1) h!0 h Then, for smll h, we will pproximte the derivtive s f 0 (x) ß f(x + h) f(x) h 5 (1.1.2)
6 6 CHAPTER 1. DIFFERENTIATION AND INTEGRATION if h>0 we obtin the forwrd difference formul if h<0 we obtin the bckwrd difference formul The centered difference formul is f 0 (x) ß f(x + h) f(x h) 2h (1.1.3) Applying the Tylor series we obtin f(x + h) =f(x)+hf 0 (x)+ h2 2 f 00 (ο); x<ο<x+ h This leds to f 0 (x) = f(x + h) f(x) h h 2 f 00 (ο) The trunction error is E 1 = f 0 (x) nd my be bounded s f(x + h) f(x) h je 1 j <M 2 h=2 = h 2 f 00 (ο) This formul is exct for ll polynomils of degree 1 or less. Second-order formuls f(x 0 + h) =f(x 0 )+hf 0 (x 0 )+ h2 2 f 00 (x 0 )+ h3 6 f (3) (ο 1 ) (1.1.4) f(x 0 h) =f(x 0 ) hf 0 (x 0 )+ h2 2 f 00 (x 0 ) h3 6 f (3) (ο 2 ) (1.1.5) Subtrcting (1.1.5) from (1.1.4) we obtin
7 1.2. NUMERICAL DIFFERENTIATION 7 f 0 (x 0 )= f(x 0 + h) f(x 0 h) 2h h2 6 f (3) (ο 1 )+f (3) (ο 2 ) : 2 Applying the intermedite vlue theorem we obtin the centered difference formul f 0 (x 0 )= f(x 0 + h) f(x 0 h) 2h The trunction error cn be written s h2 6 f (3) (ο); x 0 h<ο<x 0 + h: (1.1.6) nd bounded by E 2 = f 0 (x 0 ) f(x 0 + h) f(x 0 h) 2h je 2 j»m 3 h 2 =6 = h2 6 f (3) (ο) The centered difference formul is exct for ll polynomils of degree 2 or less. Fourth-order centered difference formul: f(x 0 + h) =f(x 0 )+hf 0 (x 0 )+ h2 2 f 00 (x 0 )+ h3 6 f (3) (x 0 )+ h4 4! f (4) (x 0 )+ h 5 5! f (5) (ο 1 ) (1.1.7) f(x 0 h) =f(x 0 ) hf 0 (x 0 )+ h2 2 f 00 (x 0 ) h3 6 f (3) (x 0 )+ h4 4! f (4) (x 0 ) h 5 5! f (5) (ο 2 ) (1.1.8) f(x 0 +2h) =f(x 0 )+2hf 0 (x 0 )+ 4h2 2 f 00 (x 0 )+ 8h3 6 f (3) (x 0 )+
8 8 CHAPTER 1. DIFFERENTIATION AND INTEGRATION 16h 4 4! f (4) (x 0 )+ (2h)5 f (5) (ο 3 ) (1.1.9) 5! f(x 0 2h) =f(x 0 ) 2hf 0 (x 0 )+ h2 2 f 00 (x 0 )+ 8h3 6 f (3) (x 0 )+ 16h 4 4! f (4) (x 0 ) (2h)5 5 f (5) (ο 4 ) (1.1.10) Subtrcting (1.1.8) from (1.1.7) nd using the intermedite vlue theorem we obtin f(x 0 + h) f(x 0 h) =2hf 0 (x 0 )+ h3 3 f (3) (x 0 )+ 2h5 5! f (5) (c 1 ) (1.1.11) f(x 0 +2h) f(x 0 2h) =4hf 0 (x 0 )+ (2h)3 3 f (3) (x 0 )+ 2(2h)5 f (5) (c 2 ) 5! (1.1.12) Multiplying (1.1.11) by eight nd subtrcting (1.1.12) we obtin 8(f(x 0 + h) f(x 0 h)) (f(x 0 +2h) f(x 0 2h)) = 12hf 0 (x 0 )+ 16h 5 (f (5) (c 1 ) 4f (5) (c 2 )) (1.1.13) 5! If f (5) does not chnge sign nd f (5) does not chnge rpidly, then there exists x 0 2h <c<x 0 +2h such tht 4f (5) (c 2 ) f (5) (c 1 )=3f (5) (c) Solving for f 0 (x 0 )we obtin f 0 (x 0 )= f(x 0 +2h)+8f(x 0 + h) 8f(x 0 h)+f(x 0 2h) 12h + h4 30 f (5) (c) (1.1.14)
9 1.2. NUMERICAL DIFFERENTIATION 9 The trunction error is nd my be bounded s E 4 = h4 30 f (5) (c) je 4 j <h 4 M 5 =30 The centered difference formul (1.1.14) is exct for ll polynomils of degree 4orless. Exmple: x i f(x i ) f 0 (x i ) formul forwrd centered centered bckwrd Approximting second-order derivtives Summing (1.1.7) nd (1.1.8) to obtin f(x 0 + h)+f(x 0 h) =2f(x 0 )+h 2 f 0 (x 0 )+ 2h4 4! f (4) (c) Solving for f 00 (x 0 ) we obtin f 00 (x 0 )= f(x 0 + h) 2f(x 0 )+f(x 0 h) h 2 h2 12 f (4) (c); x 0 h<c<x 0 + h We cn construct fourth-order centered difference formul for f 00 (x 0 ) s f 00 (x 0 )= f(x 0 +2h)+16f(x 0 + h) 30f(x 0 )+16f(x 0 h) f(x 0 2h) 12h 2 +O(h 4 ) (1.1.15)
10 10 CHAPTER 1. DIFFERENTIATION AND INTEGRATION Forwrd nd bckwrd difference formuls We obtin O(h 2 ) formuls by considering the three points x 0 ; x 1 = x 0 + h; x 2 = x 0 +2h nd p 2 (x) tht interpoltes f t the three points p 2 (x) = (x x 1)(x x 2 ) (x 0 x 1 )(x 0 x 2 ) f(x 0)+ (x x 0)(x x 2 ) (x 1 x 0 )(x 1 x 2 ) f(x 1) Tking the derivtive we obtin + (x x 0)(x x 1 ) (x 2 x 0 )(x 2 x 1 ) f(x 2) p 0 2(x) = (2x (x 1 + x 2 )) 2h 2 f(x 0 ) (2x (x 0 + x 2 )) h 2 f(x 1 ) A forwrd difference formul: + (2x (x 0 + x 1 )) 2h 2 f(x 2 ) f 0 (x 0 ) ß p 2 (x 0 )= ( 3f(x 0)+4f(x 1 ) f(x 2 )) 2h (1.1.16) f 0 (x 0 )= ( 3f(x 0)+4f(x 1 ) f(x 2 )) 2h + h2 3 f (3) (c) (1.1.17) A centered difference formul: f 0 (x 2 ) ß p 0 2(x 1 )= f(x 2) f(x 0 ) 2h (1.1.18) f 0 (x 1 )= f(x 2) f(x 0 ) 2h h2 6 f (3) (c) (1.1.19) A bckwrd difference formul: f 0 (x 0 ) ß p 0 2 (x 0)= (f(x 0) 4f(x 1 )+3f(x 2 )) 2h (1.1.20)
11 1.2. NUMERICAL DIFFERENTIATION 11 f 0 (x 2 )= (f(x 0) 4f(x 1 )+3f(x 2 )) 2h + h2 3 f (3) (c) (1.1.21) The centered difference formul (1.1.19) requires two function evlutions nd hs smller trunction error. Similr formuls cn be constructed to pproximte prtil derivtives u x nd u y. Generl formul for numericl differentition Let p n interpolte f t x 0 ;x 1 ; ;x n p n (x) =f(x 0 )+ where the interpoltion error is Differentiting to obtin which in turn yields nd E n (x) = ny k=0 p 0 n(x 0 )=f[x 0 ;x 1 ]+ E 0 n(x 0 )= i Y k=0 (x x k )f[x 0 ; ;x i ] (x x k ) f (n+1) (ο(x)) : (n + 1)! f(x) =p n (x)+e n (x) f 0 (x 0 )=p 0 n(x 0 )+E 0 n(x 0 ) ny k=1 i Y i=2 k=1 (x 0 x k )f[x 0 ; ;x i ] (x 0 x k ) f (n+1) (ο(x 0 )) (n + 1)! If H = mx ; ;n jx 0 x i j,we my bound the error s je 0 n(x 0 )j = O(H n ):
12 12 CHAPTER 1. DIFFERENTIATION AND INTEGRATION Effects of round-off errors We ssume perturbed dt nd investigte its effects of smll on the ccurcy of numericl differentition. Let us consider the first order forwrd difference formul d(x 0 )= ~ f(x 0 + h) ~ f(x 0 ) h = f(x 0 + h)+ffi 1 (f(x 0 )+ffi 0 ) h = f(x 0 + h) f(x 0 ) h + (ffi 1 ffi 0 ) h = f 0 (x 0 )+ h 2 f 00 (c)+ (ffi 1 ffi 0 ) ; x 0 <c<x 0 + h; h>0: h Thus the totl error is d(x 0 ) f 0 (x 0 )= h 2 f 00 (c)+ (ffi 1 ffi 0 ) h Here we hve the two errors one is the trunction error nd the round-off error. For h > ffi the trunction error domintes, otherwise, the round-off error becomes more dominnt. If ffi i» ffi, we my bound the totl error jd(x) f 0 (x)j» hm ffi h = E(h) which my beused to find the optiml vlue for h tht minimizes E(h) Thus h opt =2 q ffi M 2. de dh = M ffi h 2 =0 1.3 Numericl Integrtion Numericl qudrtures re used to pproximte integrls nd to obtin numericl methods for ordinry nd prtil differentil nd integrl equtions.
13 1.3. NUMERICAL INTEGRATION 13 The generl form of numericl qudrture hs the form f(x)dx ß Q(f) = i=0 w i f(x i ); (1.1.22) where such tht» x 0» x 1 ; ;x n = b; f(x)dx = Q(f)+E(f): (1.1.23) 1. x 0 ; ;x n re the qudrture nodes 2. w 0 ; ;w n re the weights 3. E(f) is the trunction error Definition 1. The numericl qudrture is of precision k, if nd only if, E(p) = 0 for ll polynomils p of degree t most k nd there exists p of degree k +1such tht E(p) 6= Newton-Cotes formuls The generl procedure to construct Newton-Cotes qudrture consists of the following steps: 1. Select set of nodes x 0 ;x 1 ; ;x n 2 [; b] 2. Construct p n (x) such tht p n (x i )=f(x i ) p n (x) = i=0 f(x i )L i (x) 3. Let Q(f) = R b p n(x)dx = P n i=0 R b L i(x)dxf(x i ) The weights re w i = R b L i(x)dx
14 14 CHAPTER 1. DIFFERENTIATION AND INTEGRATION The trpezoidl rule: Theorem Let x 0 = nd x 1 = x 0 + h = b with h = b. If f 2 C 2 [; b], then Proof. let nd f(x)dx = h h3 (f()+f(b)) 2 12 f (2) (ο); ο 2 (; b) (1.1.24) p 1 (x) = b x h f()+x h f(b) f(x) =p 1 (x)+ f (2) (c(x)) (x )(x b) 2 Integrting on [; b] to obtin f(x)dx = p 1 (x)dx + f (2) (c(x)) (x )(x b)dx 2 Applying the weighted men-vlue theorem with w(x) =(x )(x b) which does not chnge sign in (; b) we obtin f(x)dx = This leds to (1.1.24). p 1 (x)dx + f 2 (ο(x)) 2 (x )(x b)dx The trpezoidl rule is exct for ll polynomils of degree less or equl to 1. Degree of precision is 1. Simpson's Rule: Theorem Let us consider three points x 0, x 1 = x 0 + h; x 2 = x 0 +2h nd if f 2 C 4, then we cn write f(x)dx = h 3 [f()+4f(( + b)=2) + f(b)] h5 90 f (4) (ο); <ο<b: (1.1.25)
15 1.3. NUMERICAL INTEGRATION 15 Proof. We first construct p 2 (x) tht interpoltes f t x i ; i =0; 1; 2 p 2 (x) = (x x 1)(x x 2 ) x 0 x 1 )(x 0 x 2 ) f(x 0)+ (x x 0)(x x 2 ) x 1 x 0 )(x 1 x 2 ) f(x 1) Integrting p 2 (x) we obtin Z x2 + (x x 0)(x x 1 ) x 2 x 0 )(x 2 x 1 ) f(x 2): x 0 p 2 (x)dx = h 3 (f(x 0)+4f(x 1 )+f(x 2 )): Since we cnnot use the weighted men-vlue theorem like in the cse of the trpezoidl rule, we will dely the proof to the next section. Simpson rule is exct for ll polynomils of degree less or equl 3, i.e., its degree of precision is 3. Exmple: Let us consider the integrl I(f) = R 2 0 x3 + e x dx Trpezoidl rule: h = 2 I(f) ß Q(f) =f(0) + f(2)=9+e 2 ß 16:3890: The true vlue is I(f) =3+e 2 ß 10: Simpson's rule: x 0 =0,x 1 =1,x 2 =2,h =1 I(f) ß Q(f) = 1 3 (f(0)+4f(1) + f(2)) = 12 + e2 +4e 3 ß 10:421: We cn found the errors in bioth methods Trpezoidl error: f (2) (x) =6x + e x > 0 f (3) (x) =6+e x > 0, thus M 2 = mx jf (2) (x)j = jf (2) (2)j =12+e 2 0<x<2
16 16 CHAPTER 1. DIFFERENTIATION AND INTEGRATION je(f)j» 2 12 mx jf (2) j = 2(12 + e2 ) ß 12:92: 0<x<2 3 Simpson's error my be bounded s f (4) (x) =e x, M 4 = mx jf (4) j = e 2, or 0<x<2 je(f)j» h5 M 4 90 = e2 90 ß 0:082: We note tht one dditionl function evlution results in two orders of mgnitude reduction in the error bounds Composite qudrtures: Composite qudrtures re useful to (1) integrte discontinuous functions (2) integrte to prescribed ccurcy The composite trpezoidl rule consists of (i) subdividing the intervl into N subintervls using h = (b )=N nd setting x i = + ih; i =0; 1; 2; ;N (ii) Splitting the integrl s f(x)dx = N X i=0 Z xi+1 x i f(x)dx: (1.1.26) (iii) Applying the trpezoidl rule to obtin Z xi+1 x i f(x)dx = h 2 (f(x i)+f(x i+1 )) h3 12 f (2) (ο i ); ο 2 (x i ;x i+1 ):
17 1.3. NUMERICAL INTEGRATION 17 Now, let us substitute the previous eqution in (1.1.26) to obtin f(x)dx = h N X 2 (f()+f(b)+2 X N f(x i )) h3 12 i=0 f (2) (ο i ): (1.1.27) Since f is smooth we hve m 2» f 2 (x)» M 2 which leds to Nm 2» N X i=0 f (2) (ο i )» NM 2 (1.1.28) Dividing by N we hve m 2» N P i=0 f (2) (ο i ) N» M 2 (1.1.29) Applying the intermedite vlue theorem, we show tht there exists ο 2 [; b] such tht Since N =(b )=h we hve N P i=0 f (2) (ο i ) N = f (2) (ο) (1.1.30) f(x)dx = h N X 2 (f()+f(b)+2 f(x i )) (b )h2 f (2) (ο): (1.1.31) 12 Exmple: using h = 1=4 we write 0 sin(x 2 )dx ß 1 (sin(0) + sin(1) + 2(sin(1=16)+ 8 sin(1=4) + sin(9=16))) ß 0: :
18 18 CHAPTER 1. DIFFERENTIATION AND INTEGRATION Let us bound the trunction error: je(f;h)j» (b )h2 M 2 : 12 Since f (2) (x) =2cos(x 2 )+4x 2 sin(x 2 ), the tringle inequlity yields jf (2) (x)j =2jcos(x 2 )j +4x 2 jsin(x 2 )j»2+4=6: Thus, je(f;h)j» (1=4) =1=32: In order to find the smllest number of subintervls N such tht je(f;h)j» 10 4,we set (b )h 2 M 2» nd solves for h nd then for N to obtin h 2» ; which leds to h» p 210 2, or N» 102 p 2 :. Thus, the smllest number of subdivisions required to chieve the prescribed ccurcy is estimted to N ß 71. Composite Simpson's rule: We prtition the intervl [; b] sx i = + i Λ h; i =0; 1; 2n, with h = b 2n. nd split the integrl s f(x)dx = n Z x2k+2 X k=0 x 2k f(x)dx (1.1.32) On ech intervl Simpson rule yields Z x2k+2 x 2k f(x)dx = h 3 [f(x 2k)+4f(x 2k+1 )+f(x 2k+2 )]
19 1.3. NUMERICAL INTEGRATION h5 f 4 (ο k ); x 2k <ο k <x 2k+2 : (1.1.33) Substituting (1.1.33) into (1.1.32) we obtin X f(x)dx = h n 3 [f()+f(b)+4 f(x 2k+1 )+2 k=0 n X k=1 X f(x 2k )] 1 n 90 h5 k=0 f 4 (ο k ): (1.1.34) By the intermedite vlue theorem there exists ο 2 (; b) such tht n P k=0 f 4 (ο k ) n = f 4 (ο) (1.1.35) combining (1.1.34) nd (1.1.35) with h =(b )=2n we estblish (1.1.32). Generl Closed Newton-Cotes Qudrtures We subdivide [,b] into n 1 subintervls [x i ;x i+1 ]; i =0; 1; n 1 where x i = + i Λ h; i =0; 1; n, with h =(b )=n Theorem If n is even nd f 2 C n+2 [; b], then f(x)dx = i=0 w i f(x i )+ hn+3 f (n+2) (ο) (n + 2)! if n is odd nd f 2 C n+1 [; b], then where w i = f(x)dx = i=0 w i f(x i )+ hn+2 f (n+1) (ο) (n + 1)! Z n 0 Z n 0 t 2 (t 1)(t 2) (t n)dt (1.1.36) t(t 1)(t 2) (t n)dt (1.1.37) L i (x)dx; L i (x) = (x x 0) (x x i )(x x i+1 ) (x x n ) (x i x 0 ) (x i x i )(x i x i+1 ) (x i x n )
20 20 CHAPTER 1. DIFFERENTIATION AND INTEGRATION Proof. For proof see Iscson nd Keller. Open Newton-Cotes Qudrtures One cn lso construct open Newton-Cotes formuls by using the points x 0 = +h; x 1 = +2h; ;x n = b h, where h =(b )=(n+2) nd construct p n (x) tht interpoltes f t the interior points x i = +(i+1)h; i =0; 1; ::; n. Theorem If n is even nd f 2 C n+2 [; b], then f(x)dx = i=0 w i f(x i )+ hn+3 f (n+2) (ο) (n + 2)! Z n+1 t 2 (t 1)(t 2) (t n)dt (1.1.38) where if n is odd nd f 2 C n+1 [; b], then w i = f(x)dx = i=0 w i f(x i )+ hn+2 f (n+1) (ο) (n + 1)! Z n+1 t(t 1)(t 2) (t n)dt (1.1.39) L i (x)dx; L i (x) = (x x 0) (x x i )(x x i+1 ) (x x n ) (x i x 0 ) (x i x i )(x i x i+1 ) (x i x n ) Proof. Iscson nd Keller Error nlysis In this section we introduce the Peno kernel nd show how it is used to estblish integrtion errors. First we let E(f) =Q(f) I(f) =Q(f) f(x)dx (1.1.40) such tht E(f) = 0 for f 2P n, the spce of polynomils of degree n or less.
21 1.3. NUMERICAL INTEGRATION 21 Theorem If E(f) =0; 8f 2P n nd f 2 C n+1 [; b] then where with E(f) = f (n+1) (t)k(t)dt K(t) = 1 n! E x((x t) n +) (x t) n + = K(t) is clled the Peno Kernel. ( (x t) n ; x t 0; x<t Proof. Let us consider the Tylor series of f t x = where f(x) =f()+(x )f 0 ()+ + f (n) () (x ) n + r n (1.1.41) n! r n = 1 n! Z x f (n+1) (t)(x t) n dt = 1 n! To prove this reltion we observe tht for n =0 f (n+1) (t)(x t) n +dt (1.1.41b) f(x) f() = Integrtion by prts we obtin for n =1 Z x f(x) f() = (x t)f 0 (t)j t=x t= + By induction we ssume f(x) f() =(x )f 0 ()+ f(x) =T n (x)+ 1 (n 1)! Z x f 0 (t)dt Z x Z x f 00 (t)(x t)dt f 00 (t)(x t)dt f (n) (t)(x t) n dt
22 22 CHAPTER 1. DIFFERENTIATION AND INTEGRATION Using integrtion by prts we obtin the Tylor formul. Now pply the qudrture with E(T n ) = 0 to obtin Z E(f) =E(T n )+E(r n )=E(T n )+ 1 b n! E( f (n+1) (t)(x t) n +dt) = Q(r n ) r n (x)dx: Next, we will rgue tht since (x t) n + 2 C n [; b], we my interchnge the integrtion nd E. If Q involves derivtives of f, we need to show tht derivtives lso permutes with integrtion. First, we note since (x t) n + 2 C n [; b], from elementry clculus, we hve d k r n dx k = 1 n! In prticulr, for k = n 1we hve f (n+1) (t) dk (x t) n + dx k dt; 0» k» n 1: (1.1.42) d n r n dx n = 1 n! f (n+1) (t) dn (x t) n + dx n dt = f (n+1) (t)(x t) + dt = Z x f (n+1) (t)(x t)dt Next, we estblish (1.1.42) using Leibnitz formul s d n r n dx n = d dx ( Z x f (n+1) (t)(x t)dt) (1.1.42b) = f (n+1) (x)(x x)+ Z x (f (n+1) (t) d (x t))dt dx = 1 n! Z x f (n+1) (t) dn (x t) n dx n (1.1.42c)
23 1.3. NUMERICAL INTEGRATION 23 Thus, integrtion permutes with d k =dx k ;k =0; 1; 2; ;n which yields Q(r n )= 1 n! f (n+1) (t)q x ((x t) n +)dt: (1.1.43) Now, pplying Fubini theorem we invert the order of integrtion to obtin 1 n! ( f (n+1) (t)(x t) n +dt)dx = 1 n! f (n+1) (t) (x t) n +dxdt (1.1.44) Combining (1.1.43) nd (1.1.44) leds to E(f) = 1 n! f (n+1) (t)e((x t) n +)dt: This completes the proof of the Theorem with K(t) = 1 n! E((x t)n +) We note tht Peno kernel is positive for most qudrtures. This llows us to use the men-vlue theorem to obtin our qudrture formuls. Exmple: R Now, we will construct the Peno kernel for Simpson's rule for b I = f(x)dx with h =(b )=2 nd b = +2h, Q(f) = h (f()+4f( + h)+f(b)): 3 One cn esily check tht Simpson rule is exct for ll polynomils of degree three or less. Thus, E(p) = 0 for ll polynomils of degree three or less. If we pply the previous theorem with n =3we obtin Peno kernel K(t) = 1 3! E((x t)3 +);
24 24 CHAPTER 1. DIFFERENTIATION AND INTEGRATION where integrtion is done with respect to x. K(t) = 1 6 [h 3 (( t)3 + +4( + h t) 3 + +( +2h t) 3 +) Z +2h (x t) 3 +dx] Using the definition (x t) 3 + = ( (x t) n ; t» x 0; t>x ; we write K(t) = ( 1 [ h(4( + h 6 3 t)3 +( R R +2h t) 3 +2h ) (x t) 3 dx; <t<+ h t 1 [ h( +2h +2h 6 3 t)3 (x t) 3 dx]; + h<t<+2h t This cn be further simplified s K(t) = ( 1 [ h(4( + h 6 3 t)3 +( +2h t) 3 ) (+2h t)4 ] 4 <t<+ h t)3 (+2h t)4 ] 4 + h<t<+2h We note tht K(t) does not chnge sign on [; b] nd thus we cn pply the men vlue theorem to write the qudrture error s E(f) = Z +2h Z +2h f (4) (t)k(t)dt = f (4) (ο) K(t)dt; <ο<+2h We note tht the integrl must be split into two prts s follows Z +h K(t)dt + Z +2h +h K(t)dt = h5 90 Thus we hve estblished the Simpson formul (1.1.25). The Peno kernel my be used to derive generl Newton-Cotes qudrtures.
25 1.3. NUMERICAL INTEGRATION Romberg method We first consider the expnsion of the error in the trpezoidl rule T (f;h) for f 2 C 2m+2 s f(x)dx = T (f;h)+c 1 h 2 + c 2 h 4 + c m h 2m + O(h 2m+2 ): (1.1.45) c k = B 2k+2 (2k)! (f (2k) (b) f (2k) (); k =1; 2; where B 2k re the clssicl Bernoulli numbers. B 2 = 1=6, B 4 = =30, B 6 =1=42. See Kincid nd Cheney for definition of Bernoulli polynomils nd numbers. We will use the Euler expnsion (1.1.45) in terms of h with Richrdson extrpoltion to construct the Romberg method. For instnce to eliminte the c 1 h 2 term we consider the trpezoidl rule with h=2 f(x)dx = T (f;h=2) + c 1 (h=2) 2 + c 2 (h=2) 4 + c m (h=2) 2m + O(h 2m+2 ): (1.1.46) Multiplying (1.1.46) by four nd subtrcting (1.1.45) we obtin f(x)dx = 4T (f;h=2) T (f;h) 3 + d 1 h 2 + d 2 h 4 + d m h 2m + O(h 2m+2 ): (1.1.47) We note tht the O(h 4 4T (f;h=2) T (f;h) ) pproximtion is S(f;h=2). Similrly, 3 we my use Richrdson extrpoltion second time to eliminte the O(h 4 ) term nd obtin n O(h 6 ) qudrture.
26 26 CHAPTER 1. DIFFERENTIATION AND INTEGRATION The Romberg integrtion scheme is then obtined by using the following tble O(h 2 ) O(h 4 ) O(h 6 ) O(h 8 ) O(h 2m+2 R(0,0) R(1,0) R(1,1) R(2,0) R(2,1) R(2,2) R(3,0) R(3,1) R(3,2) R(3,3) ::: ::: ::: ::: R(m-1,0) R(m-1,1) R(m-1,2) R(m-1,3) R(m, 0) R(m,1) R(m,2) R(m,3) R(m,m) Where R(i; 0) = T (f;h i ); i =0; 1; 2; ;M nd the other entries re generted using the recurrence formul R(i; j) = 4j R(i; j 1) R(i 1;j 1) 4 j 1 = R(i; j)+ R(i; j 1) R(i 1;j 1) ; 4 j 1 i =1; 2; ;M; j» i: (1.1.48) Remrks: 1. R(1;i)=S(f;h i ); i 1: Simpson's method 2. R(2;i)=B(f;h i ); i 2: Boole's method 3. better pproximtions re obtined by dding new rows to the bottom of the tble 4. Ech row contins methods of different order with sme h 5. Ech column corresponds to composite method with different h
27 1.3. NUMERICAL INTEGRATION Guss Qudrture Our gol is to construct numericl qudrtures of the form f(x)dx ß w i f(x i ) with the highest degree of precision possible, i.e., x k = w i x k i ; k =0; 1; 2; :::; 2n 1: (1.1.49) Now we will derive such formul on [-1,1]. n =1 dο =2=w 1 οdο =0=w 1 ο 1 solving this system we obtin the one-point Guss qudrture where w 1 =2; ο 1 =0 n =2 dο =2=w 1 + w 2 οdο =0=w 1 ο 1 + w 2 ο 2 ο 2 dο =2=3 =w 1 ο w 2 ο 2 2 ο 3 dο =0=w 1 ο w 2 ο 3 2
28 28 CHAPTER 1. DIFFERENTIATION AND INTEGRATION #points ο w i Deg of prec = p p= p :0=5:0 5.0/9.0 5 p /9.0 3:0=5:0 5.0/ Tble 1.1: Guss points nd weights Solving this system we obtin the two-point Guss-qudrture w 1 = w 2 =1; ο 1 = ο 2 =1= p 3 Guss Integrtion with shifted intervls: We will use the mpping from [; 1] to [; b] defined by nd trnsform the integrl ο! x(ο) = + (b ) (1 + ο) 2 f(x)dx = b 2 f(x(ο))dο We denote ^f(ο) =f(x(ο)) nd pply the Guss qudrture to the new integrl
29 1.3. NUMERICAL INTEGRATION 29 ^f(ο)dο = w i ^f(οi ) combining the two previous equtions to obtin where f(x)dx ß ^w i = b 2 w i; x i = + ^w i f(x i ) (b ) (1 + ο i ): 2 Lter, we will show tht ο i ; i = 1; 2; ;n; re the roots of the Legendre polynomil of degree n defined by the Rodrigues formul p k (ο) = 1 d k 2 k (k)! dο k (ο2 1) k ; k =0; 1; 2; (1.1.50) Legendre polynomils cn lso be defined by the recursive formul p 0 (ο) =1; p 1 (ο) =ο; (1.1.51) p k (ο) = 2k 1 οp k (ο) k 1 k k p k 2(ο); k =2; 3; (1.1.51b) By induction we cn show tht Legendre polynomils given by (1.1.50) nd (1.1.51b) my be written s p k (ο) = (2k)! 2 k (k!) 2 οk + (1.1.51c) Remrks: 1. p k (±1) = (±1) k 2. p k ( ο) =() k p k (ο)
30 30 CHAPTER 1. DIFFERENTIATION AND INTEGRATION Grm-Schmidt Method: A third wy to construct orthogonl polynomils is by using Grm-Schmidt method strting from the cnonicl bsis q i (x) =x i ; i =0; 1; 2; ;p; with the inner product (p; q) = where w(x) 0, for ll» x» b. w(x)p(x)q(x)dx (1.1.52) Grm-Schmidt process on [; 1]: Alterntively, we my construct orthogonl polynomils with respect to the inner product (1.1.52) by setting p 0 (ο) =1 (1.1.53) p k (ο) =ο k k X j=0 (ο k ;p j ) (p j ;p j ) p j(ο); k =1; 2; (1.1.53b) These Legendre polynomils my be generted by the following recursion formul where p n (ο) =(ο n )p n (ο) b n p n 2 (ο); n 2 (1.1.54) p 0 (ο) =1; p 1 (ο) =ο (1.1.54b) Remrks: n = (οp n;p n ) (p n ;p n ) nd b n = (οp n;p n 2 ) (p n 2 ;p n 2 ) : (1.1.54c) 1. p k given by nd (1.1.53) nd (1.1.54) re monic polynomils 2. If w = 1, we obtin Legendre polynomils 3. If w = p1 ο 1, we obtin Chebyshev polynomils 2
31 1.3. NUMERICAL INTEGRATION If w = e ο2 on (; 1), we obtin Hermite polynomils 5. if w = e ο on [0; 1), we obtin Lguerre polynomils 6. These polynomils my bescled by setting either (p n ;p n )=1. Theorem Legendre polynomils (1.1.50) stisfy the following properties ( 0 ; if k 6= j (p k ;p j )= p k (ο)p j (ο)dο = 2 ; if k = j ; (1.1.55) 2k+1 (p k ;q)=0; for ll polynomils of degree <k; (1.1.55b) p n (ο) hs n simple roots ο i 2 (; 1); i =1; ;n, i.e., p n (ο i )=0; i =1; ;n: (1.1.55c) Proof. First we use the fct tht p n (ο)dο =0 nd since p n (x) is not identiclly zero it must chnge sign in (; 1) t ο 0. Now we cn write p n (ο) =q n j (ο)(ο ο 0 ) j, where j is odd. Using the fct p n (ο)(ο ο 0 )dο = q n j (ο)(ο ο 0 ) j+1 dο =0 Thus, q n j (ο); n j > 0must lso chnge sign in (; 1). Now ssume tht ο 1 ;ο 2 ; :::ο l ; re the roots of p n (ο) of odd multiplicity, i.e., where p n (x) chnges sign, nd consider the polynomil r l (ο) = ly (ο ο i ); l» n: Thus, p n (ο)r l (ο) doesnot chnge sign on (; 1) which leds to
32 32 CHAPTER 1. DIFFERENTIATION AND INTEGRATION p n (ο)r l (ο)dο > 0; l» n: Q This is only true when l = p, i.e., p n (ο) =c n (ο ο i ) which completes the proof. Remrk: The roots of Legendre polynomils re symmetric with respect to the center of the intervl. In the next theorem we will show nother property of Legendre polynomils Theorem Let p i ; i = 1; 2; be the Legendre polynomils (1.1.50) nd t 1 ;t 2 ; :::; t n ; be n distinct points in (; 1). then the mtrix A defined s is nonsingulr. i;j = p i (t j ); i =0; 1; 2; ;n 1; j =1; 2; ;n; (1.1.56) Proof. Assume A to be singulr, i.e., there exists c = [c 0 ;c 1 ; ;c n ] 6= 0 such tht ca = 0. This leds to the (n 1) degree polynomil q(ο) = n X i=0 c i p i (ο) with n roots, t i ; i =1; 2; ;n. Thus, q must be identiclly zero which leds to the contrdiction c = 0. Now we re redy to stte the min theorem of this section. Theorem Let ο 1 ; ;ο n ; be the roots of p n (ο) nd w i ; i =1; 2; ;n; be the weights stisfying the system
33 1.3. NUMERICAL INTEGRATION 33 p k (ο i )w i = ( (p 0 ;p 0 ) ; if k =0 0 ; k =1; 2; ;n 1: (1.1.57) Then, p(ο)dο = w i p(ο i ) (1.1.58) for ll polynomils of degree less or equl to 2n 1. Moreover, w i > 0; for i =1; 2; ;n: Conversely, if w i nd ο i re such tht (1.1.58) holds, then ο i re the roots of p n (ο) nd w i ; i =1; 2; n re solution of (1.1.57). Proof. By Theorem 1.3.6, ο i ; i =1; 2; ;n re rel nd distinct nd thus, by Theorem the system (1.1.57) hs unique solution. All polynomils p of degree 2n 1 cn be written s p = p n (ο)q(ο)+r(ο) where q(ο) nd r(ο) re polynomils of degree less or equl to n 1. p(x)dx = p n (ο)q(ο)dο + r(ο)dο = r(ο)dο: (1.1.59) Apply the qudrture to obtin w i p(ο i )= w i r(ο i ): (1.1.60) Writing r(ο) s liner combintion of p k we hve r(ο) = n X k=0 c k p k (ο):
34 34 CHAPTER 1. DIFFERENTIATION AND INTEGRATION which leds to Using (1.1.57) we show tht w i r(ο i )= r(ο)dο = c 0 (p 0 ;p 0 ): (1.1.61) n X k=0 X n c k [ w i p k (ο i )] = c 0 (p 0 ;p 0 ): (1.1.62) Combining ( ) we estblish (1.1.58). In order to show tht w i re positivewe pply (1.1.57) to the (2n 2) degree polynomil nd note tht 0 < r j (x) = r j (ο)dο = ny ;i6=j (ο ο i ) 2 ; w i r j (ο i )=w j n Y ;i6=j (ο i ο j ) 2 This estblishes w j > 0. In order to show tht our result is optiml we ssume (1.1.58) to hold for ll polynomils of degree 2n nd pply it to the polynomil to obtin 0 < which leds to contrdiction. r(ο) = ny r(ο)dο = (ο ο i ) 2 w i r(ο i )=0: Next, we will prove the converse. Let us suppose tht ο i ; i = 1; ;n; re distinct nd w i ;; ;n; re such tht (1.1.58) holds for ll polynomils
35 1.3. NUMERICAL INTEGRATION 35 of degree 2n 1 nd show tht ο i ; i =1; 2; ;n; re the roots of p n (ο) nd w i re solution of (1.1.57). To estblish (1.1.57) we write w i p k (ο i )= Thus, w j > 0. p k (ο)dο =(p k ;p 0 )= Applying (1.1.58) to p n (ο)p k (ο); k<n;we obtin 0=(p k ;p n )= This cn be written s liner system ( (p 0 ;p 0 ) ; k =0 0 ; k =1; 2; ;n 1 w i p n (ο i )p k (ο i ); k =0; 1; 2; ;n 1: Ac = 0 where A is the mtrix i;j = p i (ο j ) nd c j = w j p n (ο j ). We recll tht the mtrix A is nonsingulr which leds to c j = w j p n (ο j ) = 0; j = 1; 2; ;n. Since w j > 0, p n (ο j )=0. This completes the proof of the theorem The error formul for the Guss-Legendre qudrture on [-1,1] is stted in the following theorem. Theorem Under the sme condition s the previous theorem the Guss- Legendre qudrture cn be written s f(ο)dο = Q n (f)+ 22n+1 (n!) 4 (2n + 1)[(2n)!] 3 f (2n) (c); <c<1; (1.1.63) where Q n (f) = w i f(ο i ):
36 36 CHAPTER 1. DIFFERENTIATION AND INTEGRATION Proof. Let H 2n (x) be the Hermite interpolnt of f t the roots of p n on [-1,1]. Since Q n (p) =I(p) is exct for ll polynomils of degree less or equl to 2n 1we hve H 2n (ο)dο = Q n (H 2n )=Q n (f): Thus, I(f) Q n (f) = Using the interpoltion error result (f(ο) H 2n (ο))dο f(ο) H 2n (ο) = f (2n) (c) (ο ο 1 ) 2 (ο ο n ) 2 (2n)! Applying the men vlue theorem leds to I(f) Q n (f) = f (2n) (c) (2n)! (ο ο 1 ) 2 (ο ο n ) 2 dο Using the Rodrigues (1.1.50) formul one cn show tht nd to obtin (1.1.63). p n (ο) = (2n)! 2 n (n!) 2 (ο ο 1) (ο ο n ) (p n ;p n )= 2 2n +1 One cn show similr theorem for the shifted Guss-Legendre qudrture. Theorem Let f 2 C 2n [; b] then the shifted Guss-Legendre qudrture cn be written s f(x)dx = μq n (f)+ (b )2n+1 (n!) 4 (2n + 1)[(2n)!] 3 f (2n) (c); <c<b: (1.1.64)
37 1.3. NUMERICAL INTEGRATION 37 where μq n (f) = (b ) 2 w i f(x i ) x i = +(b ) (1 + ο i) : 2 with ο i re the roots of p n (ο) nd w i re the weights for Guss qudrture. Proof. We use the chnge of vrible x = +(b )(1 + ο) towrite nd use the previous theorem. Remrks: f(x)dx = b 2 f(x(ο))dο ffl Composite Guss qudrtures my be constructed. ffl Efficient dptive qudrtures re described in section 7.5 of Kincid nd Cheney. ffl Sub-optiml convergence rtes re obtined for singulr functions f(x) Multiple integrls We consider the rectngulr region D =[; b] [c; d] nd the double integrl I(f) = Z d c f(x; y)dydx Applying Fubini theorem for multiple integrls we write the iterted integrl I(f) = ( Z d c f(x; y)dy)dx Applying the trpezoidl rule with respect to the y vrible we obtin Z d c f(x; y)dy = d c (f(x; d)+f(x; c)) + Ey 2
38 38 CHAPTER 1. DIFFERENTIATION AND INTEGRATION I(f) = d c 2 ( f(x; d)dx + Using trpezoidl in x vrible we obtin I(f) = f(x; c)dx + Eydx (b )(d c) (f(; c)+f(; d)+f(b; c)+f(b; d)) + E(f) 4 This is exct for 1;x;y;xy. Other Newton-Cotes qudrtures re generlized in the sme mnner. The n-point Guss qudrture is I(f) = f(ο; )dοd = j=1 w i w j f(ο i ;ο j )+E(f;n) (1.1.65) Shifted qudrtures re obtined using the mpping from [; 1] 2! [; b] [c; d] defined by x(ο) = +(b )(1 + ο)=2 (1.1.66) y( ) = c +(d c)(1 + )=2 (1.1.67) If x i = x(ο i ); y i = y(ο i ); i =1; 2; ;n, then the Qudrture is Z d c f(x; y)dxdy = (b )(d c) 4 j=1 w i w j f(x i ;y j )+E(f;n): (1.1.68) Remrks: ffl This qudrture is exct for x l y m ; 0» n; m» 2n 1. ffl Composite qudrtures cn be generted in two nd three dimensions by prtitioning the domin into smll rectngles or tringles nd pply the qudrture on ech subdomin.
Numerical Integration
Chpter 5 Numericl Integrtion Numericl integrtion is the study of how the numericl vlue of n integrl cn be found. Methods of function pproximtion discussed in Chpter??, i.e., function pproximtion vi the
More informationNUMERICAL INTEGRATION. The inverse process to differentiation in calculus is integration. Mathematically, integration is represented by.
NUMERICAL INTEGRATION 1 Introduction The inverse process to differentition in clculus is integrtion. Mthemticlly, integrtion is represented by f(x) dx which stnds for the integrl of the function f(x) with
More informationLecture 6: Singular Integrals, Open Quadrature rules, and Gauss Quadrature
Lecture notes on Vritionl nd Approximte Methods in Applied Mthemtics - A Peirce UBC Lecture 6: Singulr Integrls, Open Qudrture rules, nd Guss Qudrture (Compiled 6 August 7) In this lecture we discuss the
More information1 The Lagrange interpolation formula
Notes on Qudrture 1 The Lgrnge interpoltion formul We briefly recll the Lgrnge interpoltion formul. The strting point is collection of N + 1 rel points (x 0, y 0 ), (x 1, y 1 ),..., (x N, y N ), with x
More informationLecture 14: Quadrature
Lecture 14: Qudrture This lecture is concerned with the evlution of integrls fx)dx 1) over finite intervl [, b] The integrnd fx) is ssumed to be rel-vlues nd smooth The pproximtion of n integrl by numericl
More informationLecture Note 4: Numerical differentiation and integration. Xiaoqun Zhang Shanghai Jiao Tong University
Lecture Note 4: Numericl differentition nd integrtion Xioqun Zng Sngi Jio Tong University Lst updted: November, 0 Numericl Anlysis. Numericl differentition.. Introduction Find n pproximtion of f (x 0 ),
More informationNumerical Analysis. 10th ed. R L Burden, J D Faires, and A M Burden
Numericl Anlysis 10th ed R L Burden, J D Fires, nd A M Burden Bemer Presenttion Slides Prepred by Dr. Annette M. Burden Youngstown Stte University July 9, 2015 Chpter 4.1: Numericl Differentition 1 Three-Point
More informationOrthogonal Polynomials and Least-Squares Approximations to Functions
Chpter Orthogonl Polynomils nd Lest-Squres Approximtions to Functions **4/5/3 ET. Discrete Lest-Squres Approximtions Given set of dt points (x,y ), (x,y ),..., (x m,y m ), norml nd useful prctice in mny
More informationMath& 152 Section Integration by Parts
Mth& 5 Section 7. - Integrtion by Prts Integrtion by prts is rule tht trnsforms the integrl of the product of two functions into other (idelly simpler) integrls. Recll from Clculus I tht given two differentible
More information1 The Riemann Integral
The Riemnn Integrl. An exmple leding to the notion of integrl (res) We know how to find (i.e. define) the re of rectngle (bse height), tringle ( (sum of res of tringles). But how do we find/define n re
More informationDiscrete Least-squares Approximations
Discrete Lest-squres Approximtions Given set of dt points (x, y ), (x, y ),, (x m, y m ), norml nd useful prctice in mny pplictions in sttistics, engineering nd other pplied sciences is to construct curve
More informationLecture 12: Numerical Quadrature
Lecture 12: Numericl Qudrture J.K. Ryn@tudelft.nl WI3097TU Delft Institute of Applied Mthemtics Delft University of Technology 5 December 2012 () Numericl Qudrture 5 December 2012 1 / 46 Outline 1 Review
More informationNumerical quadrature based on interpolating functions: A MATLAB implementation
SEMINAR REPORT Numericl qudrture bsed on interpolting functions: A MATLAB implementtion by Venkt Ayylsomyjul A seminr report submitted in prtil fulfillment for the degree of Mster of Science (M.Sc) in
More informationNumerical Integration. 1 Introduction. 2 Midpoint Rule, Trapezoid Rule, Simpson Rule. AMSC/CMSC 460/466 T. von Petersdorff 1
AMSC/CMSC 46/466 T. von Petersdorff 1 umericl Integrtion 1 Introduction We wnt to pproximte the integrl I := f xdx where we re given, b nd the function f s subroutine. We evlute f t points x 1,...,x n
More informationLecture 4: Piecewise Cubic Interpolation
Lecture notes on Vritionl nd Approximte Methods in Applied Mthemtics - A Peirce UBC Lecture 4: Piecewise Cubic Interpoltion Compiled 5 September In this lecture we consider piecewise cubic interpoltion
More information1. Gauss-Jacobi quadrature and Legendre polynomials. p(t)w(t)dt, p {p(x 0 ),...p(x n )} p(t)w(t)dt = w k p(x k ),
1. Guss-Jcobi qudrture nd Legendre polynomils Simpson s rule for evluting n integrl f(t)dt gives the correct nswer with error of bout O(n 4 ) (with constnt tht depends on f, in prticulr, it depends on
More informationExam 2, Mathematics 4701, Section ETY6 6:05 pm 7:40 pm, March 31, 2016, IH-1105 Instructor: Attila Máté 1
Exm, Mthemtics 471, Section ETY6 6:5 pm 7:4 pm, Mrch 1, 16, IH-115 Instructor: Attil Máté 1 17 copies 1. ) Stte the usul sufficient condition for the fixed-point itertion to converge when solving the eqution
More informationNumerical Analysis: Trapezoidal and Simpson s Rule
nd Simpson s Mthemticl question we re interested in numericlly nswering How to we evlute I = f (x) dx? Clculus tells us tht if F(x) is the ntiderivtive of function f (x) on the intervl [, b], then I =
More informationChapter 3 Polynomials
Dr M DRAIEF As described in the introduction of Chpter 1, pplictions of solving liner equtions rise in number of different settings In prticulr, we will in this chpter focus on the problem of modelling
More informationThe Riemann Integral
Deprtment of Mthemtics King Sud University 2017-2018 Tble of contents 1 Anti-derivtive Function nd Indefinite Integrls 2 3 4 5 Indefinite Integrls & Anti-derivtive Function Definition Let f : I R be function
More informationB.Sc. in Mathematics (Ordinary)
R48/0 DUBLIN INSTITUTE OF TECHNOLOGY KEVIN STREET, DUBLIN 8 B.Sc. in Mthemtics (Ordinry) SUPPLEMENTAL EXAMINATIONS 01 Numericl Methods Dr. D. Mckey Dr. C. Hills Dr. E.A. Cox Full mrks for complete nswers
More informationIII. Lecture on Numerical Integration. File faclib/dattab/lecture-notes/numerical-inter03.tex /by EC, 3/14/2008 at 15:11, version 9
III Lecture on Numericl Integrtion File fclib/dttb/lecture-notes/numerical-inter03.tex /by EC, 3/14/008 t 15:11, version 9 1 Sttement of the Numericl Integrtion Problem In this lecture we consider the
More informationMath 554 Integration
Mth 554 Integrtion Hndout #9 4/12/96 Defn. A collection of n + 1 distinct points of the intervl [, b] P := {x 0 = < x 1 < < x i 1 < x i < < b =: x n } is clled prtition of the intervl. In this cse, we
More informationNUMERICAL INTEGRATION
NUMERICAL INTEGRATION How do we evlute I = f (x) dx By the fundmentl theorem of clculus, if F (x) is n ntiderivtive of f (x), then I = f (x) dx = F (x) b = F (b) F () However, in prctice most integrls
More informationOrthogonal Polynomials
Mth 4401 Gussin Qudrture Pge 1 Orthogonl Polynomils Orthogonl polynomils rise from series solutions to differentil equtions, lthough they cn be rrived t in vriety of different mnners. Orthogonl polynomils
More informationBest Approximation. Chapter The General Case
Chpter 4 Best Approximtion 4.1 The Generl Cse In the previous chpter, we hve seen how n interpolting polynomil cn be used s n pproximtion to given function. We now wnt to find the best pproximtion to given
More informationNumerical integration
2 Numericl integrtion This is pge i Printer: Opque this 2. Introduction Numericl integrtion is problem tht is prt of mny problems in the economics nd econometrics literture. The orgniztion of this chpter
More informationAdvanced Computational Fluid Dynamics AA215A Lecture 3 Polynomial Interpolation: Numerical Differentiation and Integration.
Advnced Computtionl Fluid Dynmics AA215A Lecture 3 Polynomil Interpoltion: Numericl Differentition nd Integrtion Antony Jmeson Winter Qurter, 2016, Stnford, CA Lst revised on Jnury 7, 2016 Contents 3 Polynomil
More information63. Representation of functions as power series Consider a power series. ( 1) n x 2n for all 1 < x < 1
3 9. SEQUENCES AND SERIES 63. Representtion of functions s power series Consider power series x 2 + x 4 x 6 + x 8 + = ( ) n x 2n It is geometric series with q = x 2 nd therefore it converges for ll q =
More informationZ b. f(x)dx. Yet in the above two cases we know what f(x) is. Sometimes, engineers want to calculate an area by computing I, but...
Chpter 7 Numericl Methods 7. Introduction In mny cses the integrl f(x)dx cn be found by finding function F (x) such tht F 0 (x) =f(x), nd using f(x)dx = F (b) F () which is known s the nlyticl (exct) solution.
More informationTheoretical foundations of Gaussian quadrature
Theoreticl foundtions of Gussin qudrture 1 Inner product vector spce Definition 1. A vector spce (or liner spce) is set V = {u, v, w,...} in which the following two opertions re defined: (A) Addition of
More informationBest Approximation in the 2-norm
Jim Lmbers MAT 77 Fll Semester 1-11 Lecture 1 Notes These notes correspond to Sections 9. nd 9.3 in the text. Best Approximtion in the -norm Suppose tht we wish to obtin function f n (x) tht is liner combintion
More informationLecture 14 Numerical integration: advanced topics
Lecture 14 Numericl integrtion: dvnced topics Weinn E 1,2 nd Tiejun Li 2 1 Deprtment of Mthemtics, Princeton University, weinn@princeton.edu 2 School of Mthemticl Sciences, Peking University, tieli@pku.edu.cn
More informationReview of Calculus, cont d
Jim Lmbers MAT 460 Fll Semester 2009-10 Lecture 3 Notes These notes correspond to Section 1.1 in the text. Review of Clculus, cont d Riemnn Sums nd the Definite Integrl There re mny cses in which some
More informationThe Regulated and Riemann Integrals
Chpter 1 The Regulted nd Riemnn Integrls 1.1 Introduction We will consider severl different pproches to defining the definite integrl f(x) dx of function f(x). These definitions will ll ssign the sme vlue
More informationCS514 Fall '00 Numerical Analysis (Sketched) Solution of Homework 3 1. Questions from text in Chapter 3 Problem 1: 0 f 0 1 f 8 1 8(f 1 f 0 ) 1 f 4 2 8
CS514 Fll '00 Numericl Anlysis (Sketched) Solution of Homework 3 1. Questions from text in Chpter 3 Problem 1: 0 f 0 1 f 8 1 8(f 1 f 0 ) 1 f 4 2 8(f 2 f 1 ) 32(f 2 2f 1 f 0 ) 1 32 f 2 3 4(f 3 f 2 ) (f
More informationLecture 20: Numerical Integration III
cs4: introduction to numericl nlysis /8/0 Lecture 0: Numericl Integrtion III Instructor: Professor Amos Ron Scribes: Mrk Cowlishw, Yunpeng Li, Nthnel Fillmore For the lst few lectures we hve discussed
More informationINTRODUCTION TO INTEGRATION
INTRODUCTION TO INTEGRATION 5.1 Ares nd Distnces Assume f(x) 0 on the intervl [, b]. Let A be the re under the grph of f(x). b We will obtin n pproximtion of A in the following three steps. STEP 1: Divide
More informationDefinite integral. Mathematics FRDIS MENDELU. Simona Fišnarová (Mendel University) Definite integral MENDELU 1 / 30
Definite integrl Mthemtics FRDIS MENDELU Simon Fišnrová (Mendel University) Definite integrl MENDELU / Motivtion - re under curve Suppose, for simplicity, tht y = f(x) is nonnegtive nd continuous function
More informationAPPROXIMATE INTEGRATION
APPROXIMATE INTEGRATION. Introduction We hve seen tht there re functions whose nti-derivtives cnnot be expressed in closed form. For these resons ny definite integrl involving these integrnds cnnot be
More informationDefinite integral. Mathematics FRDIS MENDELU
Definite integrl Mthemtics FRDIS MENDELU Simon Fišnrová Brno 1 Motivtion - re under curve Suppose, for simplicity, tht y = f(x) is nonnegtive nd continuous function defined on [, b]. Wht is the re of the
More informationLecture 19: Continuous Least Squares Approximation
Lecture 19: Continuous Lest Squres Approximtion 33 Continuous lest squres pproximtion We begn 31 with the problem of pproximting some f C[, b] with polynomil p P n t the discrete points x, x 1,, x m for
More informationPhysics 116C Solution of inhomogeneous ordinary differential equations using Green s functions
Physics 6C Solution of inhomogeneous ordinry differentil equtions using Green s functions Peter Young November 5, 29 Homogeneous Equtions We hve studied, especilly in long HW problem, second order liner
More informationCMDA 4604: Intermediate Topics in Mathematical Modeling Lecture 19: Interpolation and Quadrature
CMDA 4604: Intermedite Topics in Mthemticl Modeling Lecture 19: Interpoltion nd Qudrture In this lecture we mke brief diversion into the res of interpoltion nd qudrture. Given function f C[, b], we sy
More informationa < a+ x < a+2 x < < a+n x = b, n A i n f(x i ) x. i=1 i=1
Mth 33 Volume Stewrt 5.2 Geometry of integrls. In this section, we will lern how to compute volumes using integrls defined by slice nlysis. First, we recll from Clculus I how to compute res. Given the
More informationTHE HANKEL MATRIX METHOD FOR GAUSSIAN QUADRATURE IN 1 AND 2 DIMENSIONS
THE HANKEL MATRIX METHOD FOR GAUSSIAN QUADRATURE IN 1 AND 2 DIMENSIONS CARLOS SUERO, MAURICIO ALMANZAR CONTENTS 1 Introduction 1 2 Proof of Gussin Qudrture 6 3 Iterted 2-Dimensionl Gussin Qudrture 20 4
More informationAbstract inner product spaces
WEEK 4 Abstrct inner product spces Definition An inner product spce is vector spce V over the rel field R equipped with rule for multiplying vectors, such tht the product of two vectors is sclr, nd the
More informationUNIFORM CONVERGENCE MA 403: REAL ANALYSIS, INSTRUCTOR: B. V. LIMAYE
UNIFORM CONVERGENCE MA 403: REAL ANALYSIS, INSTRUCTOR: B. V. LIMAYE 1. Pointwise Convergence of Sequence Let E be set nd Y be metric spce. Consider functions f n : E Y for n = 1, 2,.... We sy tht the sequence
More informationAN INTEGRAL INEQUALITY FOR CONVEX FUNCTIONS AND APPLICATIONS IN NUMERICAL INTEGRATION
Applied Mthemtics E-Notes, 5(005), 53-60 c ISSN 1607-510 Avilble free t mirror sites of http://www.mth.nthu.edu.tw/ men/ AN INTEGRAL INEQUALITY FOR CONVEX FUNCTIONS AND APPLICATIONS IN NUMERICAL INTEGRATION
More informationCOT4501 Spring Homework VII
COT451 Spring 1 Homework VII The ssignment is due in clss on Thursdy, April 19, 1. There re five regulr problems nd one computer problem (using MATLAB). For written problems, you need to show your work
More informationConstruction of Gauss Quadrature Rules
Jim Lmbers MAT 772 Fll Semester 2010-11 Lecture 15 Notes These notes correspond to Sections 10.2 nd 10.3 in the text. Construction of Guss Qudrture Rules Previously, we lerned tht Newton-Cotes qudrture
More informationTHE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS.
THE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS RADON ROSBOROUGH https://intuitiveexplntionscom/picrd-lindelof-theorem/ This document is proof of the existence-uniqueness theorem
More informationPart IB Numerical Analysis
Prt IB Numericl Anlysis Theorems with proof Bsed on lectures by G. Moore Notes tken by Dexter Chu Lent 2016 These notes re not endorsed by the lecturers, nd I hve modified them (often significntly) fter
More informationCAAM 453 NUMERICAL ANALYSIS I Examination There are four questions, plus a bonus. Do not look at them until you begin the exam.
Exmintion 1 Posted 23 October 2002. Due no lter thn 5pm on Mondy, 28 October 2002. Instructions: 1. Time limit: 3 uninterrupted hours. 2. There re four questions, plus bonus. Do not look t them until you
More informationWe divide the interval [a, b] into subintervals of equal length x = b a n
Arc Length Given curve C defined by function f(x), we wnt to find the length of this curve between nd b. We do this by using process similr to wht we did in defining the Riemnn Sum of definite integrl:
More informationDefinite Integrals. The area under a curve can be approximated by adding up the areas of rectangles = 1 1 +
Definite Integrls --5 The re under curve cn e pproximted y dding up the res of rectngles. Exmple. Approximte the re under y = from x = to x = using equl suintervls nd + x evluting the function t the left-hnd
More informationx = b a n x 2 e x dx. cdx = c(b a), where c is any constant. a b
CHAPTER 5. INTEGRALS 61 where nd x = b n x i = 1 (x i 1 + x i ) = midpoint of [x i 1, x i ]. Problem 168 (Exercise 1, pge 377). Use the Midpoint Rule with the n = 4 to pproximte 5 1 x e x dx. Some quick
More informationLecture 17. Integration: Gauss Quadrature. David Semeraro. University of Illinois at Urbana-Champaign. March 20, 2014
Lecture 17 Integrtion: Guss Qudrture Dvid Semerro University of Illinois t Urbn-Chmpign Mrch 0, 014 Dvid Semerro (NCSA) CS 57 Mrch 0, 014 1 / 9 Tody: Objectives identify the most widely used qudrture method
More informationThe Fundamental Theorem of Calculus. The Total Change Theorem and the Area Under a Curve.
Clculus Li Vs The Fundmentl Theorem of Clculus. The Totl Chnge Theorem nd the Are Under Curve. Recll the following fct from Clculus course. If continuous function f(x) represents the rte of chnge of F
More informationChapter 2. Numerical Integration also called quadrature. 2.2 Trapezoidal Rule. 2.1 A basic principle Extending the Trapezoidal Rule DRAWINGS
S Cpter Numericl Integrtion lso clled qudrture Te gol of numericl integrtion is to pproximte numericlly. f(x)dx Tis is useful for difficult integrls like sin(x) ; sin(x ); x + x 4 Or worse still for multiple-dimensionl
More informationMath 100 Review Sheet
Mth 100 Review Sheet Joseph H. Silvermn December 2010 This outline of Mth 100 is summry of the mteril covered in the course. It is designed to be study id, but it is only n outline nd should be used s
More informationMath 270A: Numerical Linear Algebra
Mth 70A: Numericl Liner Algebr Instructor: Michel Holst Fll Qurter 014 Homework Assignment #3 Due Give to TA t lest few dys before finl if you wnt feedbck. Exercise 3.1. (The Bsic Liner Method for Liner
More informationMath 1B, lecture 4: Error bounds for numerical methods
Mth B, lecture 4: Error bounds for numericl methods Nthn Pflueger 4 September 0 Introduction The five numericl methods descried in the previous lecture ll operte by the sme principle: they pproximte the
More informationTaylor Polynomial Inequalities
Tylor Polynomil Inequlities Ben Glin September 17, 24 Abstrct There re instnces where we my wish to pproximte the vlue of complicted function round given point by constructing simpler function such s polynomil
More information6.5 Numerical Approximations of Definite Integrals
Arknss Tech University MATH 94: Clculus II Dr. Mrcel B. Finn 6.5 Numericl Approximtions of Definite Integrls Sometimes the integrl of function cnnot be expressed with elementry functions, i.e., polynomil,
More informationNumerical integration. Quentin Louveaux (ULiège - Institut Montefiore) Numerical analysis / 10
Numericl integrtion Quentin Louveux (ULiège Institut Montefiore) Numericl nlysis 2018 1 / 10 Numericl integrtion We consider definite integrls Z b f (x)dx better to it use if known! A We do not ssume tht
More informationQUADRATURE is an old-fashioned word that refers to
World Acdemy of Science Engineering nd Technology Interntionl Journl of Mthemticl nd Computtionl Sciences Vol:5 No:7 011 A New Qudrture Rule Derived from Spline Interpoltion with Error Anlysis Hdi Tghvfrd
More informationAdvanced Calculus: MATH 410 Notes on Integrals and Integrability Professor David Levermore 17 October 2004
Advnced Clculus: MATH 410 Notes on Integrls nd Integrbility Professor Dvid Levermore 17 October 2004 1. Definite Integrls In this section we revisit the definite integrl tht you were introduced to when
More informationChapter 7 Notes, Stewart 8e. 7.1 Integration by Parts Trigonometric Integrals Evaluating sin m x cos n (x) dx...
Contents 7.1 Integrtion by Prts................................... 2 7.2 Trigonometric Integrls.................................. 8 7.2.1 Evluting sin m x cos n (x)......................... 8 7.2.2 Evluting
More informationIntegration Techniques
Integrtion Techniques. Integrtion of Trigonometric Functions Exmple. Evlute cos x. Recll tht cos x = cos x. Hence, cos x Exmple. Evlute = ( + cos x) = (x + sin x) + C = x + 4 sin x + C. cos 3 x. Let u
More informationNumerical Methods I Orthogonal Polynomials
Numericl Methods I Orthogonl Polynomils Aleksndr Donev Cournt Institute, NYU 1 donev@cournt.nyu.edu 1 MATH-GA 2011.003 / CSCI-GA 2945.003, Fll 2014 Nov 6th, 2014 A. Donev (Cournt Institute) Lecture IX
More informationCOSC 3361 Numerical Analysis I Numerical Integration and Differentiation (III) - Gauss Quadrature and Adaptive Quadrature
COSC 336 Numericl Anlysis I Numericl Integrtion nd Dierentition III - Guss Qudrture nd Adptive Qudrture Edgr Griel Fll 5 COSC 336 Numericl Anlysis I Edgr Griel Summry o the lst lecture I For pproximting
More informationBig idea in Calculus: approximation
Big ide in Clculus: pproximtion Derivtive: f (x) = df dx f f(x +h) f(x) =, x h rte of chnge is pproximtely the rtio of chnges in the function vlue nd in the vrible in very short time Liner pproximtion:
More informationPartial Derivatives. Limits. For a single variable function f (x), the limit lim
Limits Prtil Derivtives For single vrible function f (x), the limit lim x f (x) exists only if the right-hnd side limit equls to the left-hnd side limit, i.e., lim f (x) = lim f (x). x x + For two vribles
More informationAN INEQUALITY OF OSTROWSKI TYPE AND ITS APPLICATIONS FOR SIMPSON S RULE AND SPECIAL MEANS. I. Fedotov and S. S. Dragomir
RGMIA Reserch Report Collection, Vol., No., 999 http://sci.vu.edu.u/ rgmi AN INEQUALITY OF OSTROWSKI TYPE AND ITS APPLICATIONS FOR SIMPSON S RULE AND SPECIAL MEANS I. Fedotov nd S. S. Drgomir Astrct. An
More informationDOING PHYSICS WITH MATLAB MATHEMATICAL ROUTINES
DOIG PHYSICS WITH MATLAB MATHEMATICAL ROUTIES COMPUTATIO OF OE-DIMESIOAL ITEGRALS In Cooper School of Physics, University of Sydney in.cooper@sydney.edu.u DOWLOAD DIRECTORY FOR MATLAB SCRIPTS mth_integrtion_1d.m
More informationNew Expansion and Infinite Series
Interntionl Mthemticl Forum, Vol. 9, 204, no. 22, 06-073 HIKARI Ltd, www.m-hikri.com http://dx.doi.org/0.2988/imf.204.4502 New Expnsion nd Infinite Series Diyun Zhng College of Computer Nnjing University
More informationSections 5.2: The Definite Integral
Sections 5.2: The Definite Integrl In this section we shll formlize the ides from the lst section to functions in generl. We strt with forml definition.. The Definite Integrl Definition.. Suppose f(x)
More informationProperties of Integrals, Indefinite Integrals. Goals: Definition of the Definite Integral Integral Calculations using Antiderivatives
Block #6: Properties of Integrls, Indefinite Integrls Gols: Definition of the Definite Integrl Integrl Clcultions using Antiderivtives Properties of Integrls The Indefinite Integrl 1 Riemnn Sums - 1 Riemnn
More informationChapter 3 Solving Nonlinear Equations
Chpter 3 Solving Nonliner Equtions 3.1 Introduction The nonliner function of unknown vrible x is in the form of where n could be non-integer. Root is the numericl vlue of x tht stisfies f ( x) 0. Grphiclly,
More informationSome estimates on the Hermite-Hadamard inequality through quasi-convex functions
Annls of University of Criov, Mth. Comp. Sci. Ser. Volume 3, 7, Pges 8 87 ISSN: 13-693 Some estimtes on the Hermite-Hdmrd inequlity through qusi-convex functions Dniel Alexndru Ion Abstrct. In this pper
More informationNumerical Integration
Numericl Integrtion Wouter J. Den Hn London School of Economics c 2011 by Wouter J. Den Hn June 3, 2011 Qudrture techniques I = f (x)dx n n w i f (x i ) = w i f i i=1 i=1 Nodes: x i Weights: w i Qudrture
More informationMath Advanced Calculus II
Mth 452 - Advnced Clculus II Line Integrls nd Green s Theorem The min gol of this chpter is to prove Stoke s theorem, which is the multivrible version of the fundmentl theorem of clculus. We will be focused
More informationA REVIEW OF CALCULUS CONCEPTS FOR JDEP 384H. Thomas Shores Department of Mathematics University of Nebraska Spring 2007
A REVIEW OF CALCULUS CONCEPTS FOR JDEP 384H Thoms Shores Deprtment of Mthemtics University of Nebrsk Spring 2007 Contents Rtes of Chnge nd Derivtives 1 Dierentils 4 Are nd Integrls 5 Multivrite Clculus
More information3.4 Numerical integration
3.4. Numericl integrtion 63 3.4 Numericl integrtion In mny economic pplictions it is necessry to compute the definite integrl of relvlued function f with respect to "weight" function w over n intervl [,
More informationMATH34032: Green s Functions, Integral Equations and the Calculus of Variations 1
MATH34032: Green s Functions, Integrl Equtions nd the Clculus of Vritions 1 Section 1 Function spces nd opertors Here we gives some brief detils nd definitions, prticulrly relting to opertors. For further
More informationNumerical Analysis. Doron Levy. Department of Mathematics Stanford University
Numericl Anlysis Doron Levy Deprtment of Mthemtics Stnford University December 1, 2005 D. Levy Prefce i D. Levy CONTENTS Contents Prefce i 1 Introduction 1 2 Interpoltion 2 2.1 Wht is Interpoltion?............................
More information8 Laplace s Method and Local Limit Theorems
8 Lplce s Method nd Locl Limit Theorems 8. Fourier Anlysis in Higher DImensions Most of the theorems of Fourier nlysis tht we hve proved hve nturl generliztions to higher dimensions, nd these cn be proved
More informationLecture 1. Functional series. Pointwise and uniform convergence.
1 Introduction. Lecture 1. Functionl series. Pointwise nd uniform convergence. In this course we study mongst other things Fourier series. The Fourier series for periodic function f(x) with period 2π is
More informationf(x)dx . Show that there 1, 0 < x 1 does not exist a differentiable function g : [ 1, 1] R such that g (x) = f(x) for all
3 Definite Integrl 3.1 Introduction In school one comes cross the definition of the integrl of rel vlued function defined on closed nd bounded intervl [, b] between the limits nd b, i.e., f(x)dx s the
More informationMatrices, Moments and Quadrature, cont d
Jim Lmbers MAT 285 Summer Session 2015-16 Lecture 2 Notes Mtrices, Moments nd Qudrture, cont d We hve described how Jcobi mtrices cn be used to compute nodes nd weights for Gussin qudrture rules for generl
More informationFourier series. Preliminary material on inner products. Suppose V is vector space over C and (, )
Fourier series. Preliminry mteril on inner products. Suppose V is vector spce over C nd (, ) is Hermitin inner product on V. This mens, by definition, tht (, ) : V V C nd tht the following four conditions
More informationChapter 28. Fourier Series An Eigenvalue Problem.
Chpter 28 Fourier Series Every time I close my eyes The noise inside me mplifies I cn t escpe I relive every moment of the dy Every misstep I hve mde Finds wy it cn invde My every thought And this is why
More informationFunctions of Several Variables
Functions of Severl Vribles Sketching Level Curves Sections Prtil Derivtives on every open set on which f nd the prtils, 2 f y = 2 f y re continuous. Norml Vector x, y, 2 f y, 2 f y n = ± (x 0,y 0) (x
More informationODE: Existence and Uniqueness of a Solution
Mth 22 Fll 213 Jerry Kzdn ODE: Existence nd Uniqueness of Solution The Fundmentl Theorem of Clculus tells us how to solve the ordinry differentil eqution (ODE) du = f(t) dt with initil condition u() =
More informationFinal Exam - Review MATH Spring 2017
Finl Exm - Review MATH 5 - Spring 7 Chpter, 3, nd Sections 5.-5.5, 5.7 Finl Exm: Tuesdy 5/9, :3-7:pm The following is list of importnt concepts from the sections which were not covered by Midterm Exm or.
More informationFundamental Theorem of Calculus
Fundmentl Theorem of Clculus Recll tht if f is nonnegtive nd continuous on [, ], then the re under its grph etween nd is the definite integrl A= f() d Now, for in the intervl [, ], let A() e the re under
More informationP 3 (x) = f(0) + f (0)x + f (0) 2. x 2 + f (0) . In the problem set, you are asked to show, in general, the n th order term is a n = f (n) (0)
1 Tylor polynomils In Section 3.5, we discussed how to pproximte function f(x) round point in terms of its first derivtive f (x) evluted t, tht is using the liner pproximtion f() + f ()(x ). We clled this
More informationMAT 772: Numerical Analysis. James V. Lambers
MAT 772: Numericl Anlysis Jmes V. Lmbers August 23, 2016 2 Contents 1 Solution of Equtions by Itertion 7 1.1 Nonliner Equtions....................... 7 1.1.1 Existence nd Uniqueness................ 7 1.1.2
More information1 Error Analysis of Simple Rules for Numerical Integration
cs41: introduction to numericl nlysis 11/16/10 Lecture 19: Numericl Integrtion II Instructor: Professor Amos Ron Scries: Mrk Cowlishw, Nthnel Fillmore 1 Error Anlysis of Simple Rules for Numericl Integrtion
More information