Orthogonal Polynomials and Least-Squares Approximations to Functions

Size: px
Start display at page:

Download "Orthogonal Polynomials and Least-Squares Approximations to Functions"

Transcription

1 Chpter Orthogonl Polynomils nd Lest-Squres Approximtions to Functions **4/5/3 ET. Discrete Lest-Squres Approximtions Given set of dt points (x,y ), (x,y ),..., (x m,y m ), norml nd useful prctice in mny pplictions in sttistics, engineering nd other pplied sciences is to construct curve tht is considered to be the best fit for the dt, in some sense. Severl types of fits cn be considered. But the one tht is used most in pplictions is the lest-squres fit. Mthemticlly, the problem is the following: Discrete Lest-Squres Approximtion Problem Given set of n discrete dt points (x i,y i ), i =,,...,m. Find the lgebric polynomil P n (x) = + x+ x + + n x n (n < m) such tht the error E(,,..., n ) in the lest-squres sense in minimized; tht is, m E(,,..., n ) = (y i x i x i nx n i ) 465

2 466CHAPTER. ORTHOGONAL POLYNOMIALS AND LEAST-SQUARES APPROXIMATIONS TO FUNCT is minimum. Here E(,,..., n ) is function of (n+) vribles:,,..., n. Since E(,,..., n ) is function of the vribles,,,..., n, for this function to be minimum, we must hve: E j =, j =,,...,n. Now, simple computtions of these prtil derivtives yield: E = E =. E n = m (y i x i n x n i ) m x i (y i x i n x n i ) m x n i (y i x i n x n i ) Setting these equtions to be zero, we hve m m m m + x i + x i + + n x n i = m m m x i + x i + + n x n+ i = m x i y i m y i. m m x n i + x n+ i + + n m x n i = m x n i y i. Set s k = b k = m x k i, k =,,...,n m x k i y i, k =,,...,n Using these nottions, the bove equtions cn be written s:

3 .. DISCRETE LEAST-SQUARES APPROXIMATIONS 467 s +s + +s n n = b (Note tht s +s + +s n+ n = b. s n +s n+ + +s n n = b n m = m x i = s.). This is system of (n+) equtions in (n+) unknowns,,..., n. These equtions re clled Norml Equtions. This system now cn be solved to obtin these (n+) unknowns, provided solution to thesystem exists. We will not show tht this system hs unique solution if x i s re distinct. The system cn be written in the following mtrix form: s s s n b s s s n+.... = b.. s n s n+ s n n b n or where Define S = b s s s n b s S = s s n+..., =., b = b.. s n s n+ s n n x x x n x x x n V = x 3 x 3 x n b n x m x m xn m Then the bove system hs the form: V T V = b. The mtrix V is known s the Vndermonde mtrix, nd we hve seen in Chpter 6 tht this mtrix hs full rnk if x i s re distinct. In this cse, the mtrix S = V T V is symmetric nd positive definite [Exercise] nd is therefore nonsingulr. Thus, if x i s re distinct, the eqution S = b hs unique solution.

4 468CHAPTER. ORTHOGONAL POLYNOMIALS AND LEAST-SQUARES APPROXIMATIONS TO FUNCT Theorem. (Existence nd uniqueness of Discrete Lest-Squres Solutions). Let (x,y ), (x,y ),..., (x n,y n ) bendistinctpoints. Thenthediscrete lest-squre pproximtion problem hs unique solution... Lest-Squres Approximtion of Function We hve described lest-squres pproximtion to fit set of discrete dt. Here we describe continuous lest-squre pproximtions of function f(x) by using polynomils. First, consider pproximtion by polynomil with monomil bsis: {,x,x,...,x n }. Lest-Squre Approximtions of Function Using Monomil Polynomils Given function f(x), continuous on [,b], find polynomil P n (x) of degree t most n: P n (x) = + x+ x + + n x n such tht the integrl of the squre of the error is minimized. Tht is, E = is minimized. [f(x) P n (x)] dx The polynomil P n (x) is clled the Lest-Squres Polynomil. Since E is function of,,..., n, we denote this by E(,,..., n ). For minimiztion, we must hve E i =, i =,,...,n. As before, these conditions will give rise to system of (n +) norml equtions in (n +) unknowns:,,..., n. Solution of these equtions will yield the unknowns:,,..., n.

5 .. DISCRETE LEAST-SQUARES APPROXIMATIONS Setting up the Norml Equtions Since So, Similrly, E = E i = E = E = E =. E n = [f(x) ( + x+ x + + n x n )] dx, [f(x) x x n x n ]dx x[f(x) x x n x n ]dx x n [f(x) x x n x n ]dx dx+ xdx+ x dx+ + n x n dx = x i dx+ x i+ dx+ x i+ dx+ + n x i+n dx = i =,,3,...,n. So, the (n+) norml equtions in this cse re: i = : dx+ xdx+ x dx+ + n x n dx = i = : xdx+ x dx+ 3 x 3 dx+ + n x n+ dx =. f(x)dx i = n: x n dx+ x n+ dx+ x n+ dx+ + n x n dx = Denote x i dx = s i, i =,,,3,...,n, nd b i = Then the bove (n+) equtions cn be written s s + s + s + + n s n = b s + s + s n s n+ = b s n + s n+ + s n+ + + n s n = b n. f(x)dx xf(x)dx x i f(x)dx, i =,,...,n.. x i f(x)dx, x n f(x)dx

6 47CHAPTER. ORTHOGONAL POLYNOMIALS AND LEAST-SQUARES APPROXIMATIONS TO FUNCT or in mtrix nottion s s s s n b s s s 3 s n = b. s n s n+ s n+ s n n b n Denote Then we hve the system of norml equtions: S = (s i ), =., b = b.. n S = b The solution of these equtions will yield the coefficients,,..., n of the lest-squres polynomil P n (x). b b n A Specil Cse: Let the intervl be [,]. Then s i = x i dx = i+, i =,,...,n. Thus, in this cse the mtrix of the norml equtions n S = 3 n+... n n+ n which is Hilbert Mtrix. It is well-known to be ill-conditioned (see Chpter 3).

7 .. DISCRETE LEAST-SQUARES APPROXIMATIONS 47 Algorithm. (Lest-Squres Approximtion using Monomil Polynomils). Inputs: (i) f(x) - A continuous function on [, b]. (ii) n - The degree of the desired lest-squres polynomil Output:The coefficients,,..., n of the desired lest-squres polynomil: P n (x) = + x+ + n x n. Step. Compute s,s,...,s n : For i =,,...,n do s i = xi dx End Step. Compute b,b,...,b n : For i =,,...,n do b i = xi f(x)dx End Step 3. Form the mtrix S from the numbers s,s,...,s n nd the vector b from the numbers b,b,...,b n. s s... s n b s S = s... s n+..., b = b.. s n s n+... s n Step 4. Solve the (n+) (n+) system of equtions for,,... n : S = b, where =.. n b n Exmple.3 Find Liner nd Qudrtic lest-squres pproximtions to f(x) = e x on [,].

8 47CHAPTER. ORTHOGONAL POLYNOMIALS AND LEAST-SQUARES APPROXIMATIONS TO FUNCT Liner Approximtion: n = ; P (x) = + x s = s = s = dx = [ ] x xdx = = ) ( = [ ] x x 3 dx = = ( ) 3 3 = 3 3 Thus, ( ) ( ) s s S = = s s 3 b = b = e x dx = e e =.354 e x xdx = e =.7358 The norml system is: ( )( ) ( ) b = 3 b This gives =.75, =.37 The liner lest-squres polynomil P (x) = x. Accurcy Check: P (.5) =.77, e.5 =.6487 Reltive Error: =.453. e.5 P (.5) e.5 = =.475. Qudrtic Fitting: n = ; P (x) = + x+ x s =, s =, s = 3 [ x s 3 = x 3 4] dx = = 4 [ ] x s 4 = x 4 5 dx = = 5 5

9 .. DISCRETE LEAST-SQUARES APPROXIMATIONS 473 b = b = b = e x dx = e e =.354 xe x dx = e =.7358 x e x dx = e 5 e = The system of norml equtions is: = The solution of this system is: =.9963, =.37, = The qudrtic lest-squres polynomil P (x) = x x. Accurcy Check: P (.5) =.6889 e.5 =.6487 Reltive error: P (.5) e.5 e.5 = =.4. Exmple.4 Find liner nd qudrtic lest-squres polynomil pproximtion to f(x) = x + 5x + 6 in [,]. Liner Fit: P (x) = + x s = s = s = dx = xdx = x dx = 3

10 474CHAPTER. ORTHOGONAL POLYNOMIALS AND LEAST-SQUARES APPROXIMATIONS TO FUNCT b = b = = 53 6 The norml equtions re: ( (x +5x+6)dx = x(x +5x+6)dx = = = 59 3 )( ) = ( ) The liner lest squres polynomil P (x) = x. (x 3 +5x +6x)dx = = 6 Accurcy Check: Exct Vlue: f(.5) = 8.75; P (.5) = Reltive error: =.95. Qudrtic Lest-Squre Approximtion: P (x) = + x+ x S = b = 53 6, b = 59, b = x (x +5x+6)dx = The solution of the liner system is: = 6, = 5, =, (x 4 +5x 3 +6x )dx = = 69. P (x) = 6+5x+x (Exct)..3 Use of Orthogonl Polynomils in Lest-squres Approximtions The lest-squres pproximtion using monomil polynomils, s described bove, is not numericlly effective; since the system mtrix S of norml equtions is very often ill-conditioned.

11 .. DISCRETE LEAST-SQUARES APPROXIMATIONS 475 For exmple, when the intervl is [,], we hve seen tht S is Hilbert mtrix, which is notoriously ill-conditioned for even modest vlues of n. When n = 5, the condition number of this mtrix = cond(s) = O( 5 ). Such computtions cn, however, be mde computtionlly effective by using specil type of polynomils, clled orthogonl polynomils. Definition.5. The set of functions {φ,φ,...,φ n } in [,b] is clled set of orthogonl functions, with respect to weight function w(x), if where C j is rel positive number. if i j w(x)φ j (x)φ i (x)dx = C j if i = j Furthermore, if C j =, j =,,...,n, then the orthogonl set is clled n orthonorml set. Using this interesting property, lest-squres computtions cn be more numericlly effective, s shown below. Without ny loss of generlity, let s ssume tht w(x) =. Ide: The ide is to find lest-squres pproximtion of f(x) on [,b] by mens of polynomil of the form P n (x) = φ (x)+ φ (x)+ + n φ n (x), where {φ n } n k= is set of orthogonl polynomils. Tht is, the bsis for generting P n(x) in this cse is set of orthogonl polynomils. The question now rises: Is it possible to write P n (x) s liner combintion of the orthogonl polynomils? The nswer is yes nd provided in the following. It cn be shown [Exercise]: Given the set of orthogonl polynomils {Q i (x)} n i=, polynomil P n(x) of degree n, cn be written s: P n (x) = Q (x)+ Q (x)+ + n Q n (x) for some,,..., n. Finding the lest-squres pproximtion of f(x) on [, b] using orthogonl polynomils, then cn be stted s follows:

12 476CHAPTER. ORTHOGONAL POLYNOMIALS AND LEAST-SQUARES APPROXIMATIONS TO FUNCT Lest-squres Approximtion of Function Using Orthogonl Polynomils Given f(x), continuous on [,b], find,,..., n using polynomil of the form: P n (x) = φ (x)+ φ (x)+ + n φ n (x), where {φ k (x)} n k= is given set of orthogonl polynomils on [,b], such tht the error function: is minimized. E(,,..., n ) = [f(x) ( φ (x)+ n φ n (x))] dx As before, we set Now E = Setting this equl to zero, we get E i =, i =,,...,n. φ (x)[f(x) φ (x) φ (x) n φ n (x)]dx. Since, {φ k (x)} n k= nd φ (x)f(x)dx = is n orthogonl set, we hve, ( φ (x)+ + n φ n (x))φ (x)dx. φ (x)dx = C, φ (x)φ i(x) dx =, i. Applying the bove orthogonl property, we see from bove tht Tht is, Similrly, E = φ (x)f(x)dx = C. = φ (x)f(x)dx. C φ (x)[f(x) φ (x) φ (x) n φ n (x)]dx.

13 .. DISCRETE LEAST-SQUARES APPROXIMATIONS 477 Agin from the orthogonl property of {φ j (x)} n j= we hve φ (x)dx = C nd φ (x)φ i (x)dx =, i, so, setting E =, we get = φ (x)f(x)dx C In generl, we hve where k = φ k (x)f(x)dx, k =,,...,n, C k C k = φ k (x)dx...4 Expressions for k with Weight Function w(x). If the weight function w(x) is included, then k is modified to k = w(x)f(x)φ k (x)dx, k =,,...,n C k Where C k = = w(x)φ k (x)dx Algorithm.6 (Lest-Squres Approximtion Using Orthogonl Polynomils). Inputs:f(x) - A continuous function f(x) on [,b] w(x) - A weight function (n integrble function on [,b]). {φ k (x)} n k= - A set of n orthogonl functions on [,b]. Output:The coefficients,,..., n such tht is minimized. Step. Compute C k, k =,,...,n s follows: For k =,,,...,n do C k = w(x)φ k (x)dx End w(x)[f(x) φ (x) φ (x) n φ n (x)] dx

14 478CHAPTER. ORTHOGONAL POLYNOMIALS AND LEAST-SQUARES APPROXIMATIONS TO FUNCT Step. Compute k, k =,...,n s follows: For k =,,,...,n do k = C k w(x)f(x)φ k(x)dx End Generting Set of Orthogonl Polynomils The next question is: How to generte set of orthogonl polynomils on [,b], with respect to weight function w(x)? The clssicl Grm-Schmidt process (see Chpter 7), cn be used for this purpose. Strting with the set of monomils {,x,...,x n }, we cn generte the orthonorml set of polynomils {Q k (x)}.. Lest-Squres Approximtion Using Legendre s Polynomils Recll from the lst chpter tht the first few Legendre polynomils re given by: φ (x) = φ (x) = x φ (x) = x 3 φ 3 (x) = x x etc. To use the Legendre polynomils to pproximte lest-squres solution of function f(x), we set w(x) =, nd [,b] = [,] nd compute C k, k =,,...,n by Step of Algorithm.6: C k = nd k, k =,,...,n by Step of Algorithm.6: φ k (x)dx k = f(x)φ k (x)dx. C k

15 .. LEAST-SQUARES APPROXIMATION USING LEGENDRE S POLYNOMIALS 479 The lest-squres polynomil will then be given by P n (x) = Q (x)+ Q (x)+ + n Q n (x). A few C k s re now listed below: nd so on. C = φ (x)dx = dx = C = φ (x)dx = x dx = 3 C = φ (x)dx = ( x ) 3 dx = Exmple.7 Find liner nd qudrtic lest-squres pproximtion to f(x) = e x using Legendre polynomils. Liner Approximtion: P (x) = φ (x)+ φ (x) φ (x) =, φ (x) = x Step. Compute C nd C : C = φ (x)dx = dx = [x] = C = Step. Compute nd : φ (x)dx = [ x x 3 dx = 3 ] = = 3. = (x)e C φ x dx e x dx = = f(x)φ (x)dx C = 3 e x xdx = 3 e. The liner lest-squres polynomil: P (x) = φ (x)+ φ (x) = [ e ] + 3 e e x ( e ) e

16 48CHAPTER. ORTHOGONAL POLYNOMIALS AND LEAST-SQUARES APPROXIMATIONS TO FUNCT Accurcy Check: P (.5) = [ e ] =.77 e e e.5 =.6487 Reltive error: =.475. Qudrtic Approximtion: P (x) = φ (x)+ φ (x)+ φ (x) = ( e ), = 3 e e (Alredy computed bove) Step. Compute C = ( x 5 = φ (x)dx = ) 5 3 x3 3 + x ( x 3) dx = 8 45 Step. Compute = e x φ (x)dx C = 45 8 ( e x x ) dx 3 = e 7 e The qudrtic lest-squres polynomil: P (x) = ( e )+ 3e ( e x+ e 7 )( x ) e 3 Accurcy Check: P (.5) =.75 e.5 =.6487 Reltive error: =.43. Compre this reltive error with tht obtined erlier with n non-orthogonl polynomil of degree.

17 .3. CHEBYSHEV POLYNOMIALS: ANOTHER WONDERFUL FAMILY OF ORTHOGONAL POLYNOMIAL.3 Chebyshev polynomils: Another wonderful fmily of orthogonl polynomils Definition.8. The set of polynomils defined by T n (x) = cos[nrccosx], n on [, ] re clled the Chebyshev polynomils. To see tht T n (x) is polynomil of degree n in our fmilir form, we derive recursive reltion by noting tht T (x) = (the Chebyshev polynomil of degree zero). T (x) = x (the Chebyshev polynomil of degree )..3. A Recursive Reltion for Generting Chebyshev Polynomils Substitute θ = rccosx. Then, T n (x) = cos(nθ), θ π. T n+ (x) = cos(n+)θ = cosnθcosθ sinnθsinθ T n (x) = cos(n)θ = cosnθcosθ +sinnθsinθ Adding the lst two equtions, we obtin T n+ (x)+t n (x) = cosnθcosθ The right-hnd side still does not look like polynomil in x. But note tht cosθ = x So, T n+ (x) = cosnθcosθ T n (x) = xt n (x) T n (x). This bove is three-term recurrence reltion to generte the Chebyshev Polynomils. Three-Term Recurrence Formul for Chebyshev Polynomils T (x) =, T (x) = x T n+ (x) = xt n (x) T n (x), n.

18 48CHAPTER. ORTHOGONAL POLYNOMIALS AND LEAST-SQUARES APPROXIMATIONS TO FUNCT Using this recursive reltion, the Chebyshev polynomils of the successive degrees cn be generted: n = : T (x) = xt (x) T (x) = x, n = : T 3 (x) = xt (x) T (x) = x(x ) x = 4x 3 3x nd so on..3. The orthogonl property of the Chebyshev polynomils We now show tht Chebyshev polynomils re orthogonl with respect to the weight function w(x) = x in the intervl [,]. To demonstrte the orthogonl property of these polynomils, we show tht Orthogonl Property of the Chebyshev Polynomils T m (x)t n (x) x if m n dx = π if m = n. First, T m (x)t n (x) x = dx, m n. cos(m rccos x) cos(n rccos x) x dx Since θ = rccosx dθ = dx, x

19 .4. THE LEAST-SQUARE APPROXIMATION USING CHEBYSHEV POLYNOMIALS483 The bove integrl becomes: = π π cosmθcosnθdθ cosmθcosnθdθ Now, cosmθcosnθ cn be written s [cos(m+n)θ +cos(m n)θ] So, π cosmθcosnθdθ π π = cos(m+n)θdθ + cos(m n)θdθ = [ ] π (m+n) sin(m+n)θ + [ (m n) sin(m n)θ =. ] π Similrly, it cn be shown [Exercise] tht T n (x)dx x = π for n..4 The Lest-Squre Approximtion using Chebyshev Polynomils As before, the Chebyshev polynomils cn be used to find lest-squres pproximtions to function f(x) s stted below. In Algorithm.6, set w(x) = x, [,b] = [,], nd φ k (x) = T k (x), Then, it is esy to see tht using the orthogonl property of Chebyshev polynomils:

20 484CHAPTER. ORTHOGONAL POLYNOMIALS AND LEAST-SQUARES APPROXIMATIONS TO FUNCT C = C k = T (x) x dx = π T k (x) x dx = π, k =,...,n Thus, from Step of Algorithm.6, we hve = π nd i = π f(x)dx x f(x)dx x. The lest-squres pproximting polynomil P n (x) of f(x) using Chebyshev polynomils is given by: P n (x) = T (x)+ T (x)+ + n T n (x) where nd i = π f(x)t i (x)dx, i =,,n x = π f(x)dx x Exmple.9 Find liner lest-squres pproximtion of f(x) = e x using Chebyshev polynomils. Here where P (x) = φ (x)+ φ i (x) = T (x)+ T (x) = + x, = π = π e x dx x.66 xe x dx.33 x Thus, P (x) = x Accurcy Check: P (.5) =.83; e.5 =.6487

21 .5. MONIC CHEBYSHEV POLYNOMIALS 485 Reltive error: =.6..5 Monic Chebyshev Polynomils Note tht T k (x) is Chebyshev polynomil of degree k with the leding coefficient k, k. Thus we cn generte set of monic Chebyshev polynomils from the polynomils T k (x) s follows: The Monic Chebyshev Polynomils, T k (x), re then given by T (x) =, Tk (x) = kt k(x), k. The k zeros of T k (x) re esily clculted [Exercise]: ( ) j x j = cos k π, j =,,...,k. The mximum or minimum vlues of T k (x) [Exercise] occur t ( ) jπ x j = cos, k nd T k ( x j ) = ()j, j =,,...,k. k.6 Minimx Polynomil Approximtions with Chebyshev Polynomils As seen bove the Chebyshev polynomils cn, of course, be used to find lest-squres polynomil pproximtions. However, these polynomils hve severl other wonderful polynomil pproximtion properties. First, we stte the minimx property of the Chebyshev polynomils. Minimx Property of the Chebyshev Polynomils If P n (x) is ny monic polynomil of degree n, then = mx n T n (x) mx P n(x). x [,] x [,] Moreover, this hppens when P n (x) T n (x).

22 486CHAPTER. ORTHOGONAL POLYNOMIALS AND LEAST-SQUARES APPROXIMATIONS TO FUNCT Interprettion: The bove results sy tht the bsolute mximum of the monic Chebyshev polynomil of degree n, T n (x), over [,] is less thn or equl to tht of ny polynomil P n (x) over the sme intervl. Proof. By contrdiction [Exercise]..6. Choosing the interpolting nodes with the Chebyshev Zeros Recll from Chpter 6 tht error in polynomil interpoltion of function f(x) with the nodes, x,x,...,x n by polynomil P n (x) of degree t most n is given by where Ψ(x) = (x x )(x x ) (x x n ). E = f(x) P(x) = fn+ (ξ) (n+)! Ψ(x), The question is: How to choose these (n+) nodes x,x,...,x n so tht Ψ(x) is minimized in [,]? The nswer cn be given from the bove minimx property of the monic Chebyshev polynomils. Note tht Ψ(x) is monic polynomil of degree (n+). So, by the minimx property of the Chebyshev polynomils, we hve Thus, mx T n+ (x) mx Ψ(x). x [,] x [,] The mximum vlue of Ψ(x) = (x x )(x x ) (x x n ) in [,] is smllest when x,x,...,x n rechosensthe(n+) zerosofthe(n+)thdegreemonicchebyshevpolynomils T n+ (x). Tht is, when x,x,...,x n re chosen s: x k+ = cos (k +) π,k =,,,...,n. (n+) The smllest bsolute mximum vlue of Ψ(x) with x,x,...,x n s chosen bove, is: n..6. Working with n Arbitrry Intervl If the intervl is [,b], different from [,], then, the zeros of T n+ (x) need to be shifted by using the trnsformtion: x = [(b )x+(+b)]

23 .6. MINIMAX POLYNOMIAL APPROXIMATIONS WITH CHEBYSHEV POLYNOMIALS487 Exmple. Let the interpolting polynomil be of degree t most nd the intervl be [.5,]. The three zeros of T 3 (x) in [,] re given by x = cos π 6, x = cos π 6, nd x = cos pi. These zeros re to be shifted using trnsformtion: x new i = [(.5) x i +(+.5)], i =,,..6.3 Use of Chebyshev Polynomils to Economize Power Series Power Series Economiztion Let P n (x) = + x+ + n x n be polynomil of degree n obtined by truncting power series expnsion of continuous function on [,b]. The problem is to find polynomil P r (x) of degree r (< n) such tht mx x [,] P n(x) P r (x), is s smll s possible. We first consider r = n ; tht is, the problem of pproximting P n (x) by polynomil P n (x) of degree n. If the totl error (sum of trunction error nd error of pproximtion) is still within n cceptble tolernce, then we consider pproximtion by polynomil of P n (x) nd the process is continued until the ccumulted error exceeds the tolernce. We will show below how minimx property of the Chebyshev polynomils cn be ginfully used. First note tht n P n (x) P n (x) is monic polynomil. So, by the minimx property, we hve mx P n (x) P n (x) mx x [,] T n (x) = n x [,] n. Thus, if we choose P n (x) = P n (x) n Tn (x), Then the minimum vlue of the mximum error of pproximting P n (x) by P n (x) over [,] is given by: mx P n(x) P n (x) = n x n. If this quntity, n, plus error due to the trunction of the power series is within the permissible tolernce ǫ, we cn then repet the process by constructing P n (x) from P n (x) s n bove. The process cn be continued until the ccumulted error exceeds the error tolernce ǫ.

24 488CHAPTER. ORTHOGONAL POLYNOMIALS AND LEAST-SQUARES APPROXIMATIONS TO FUNCT So, the process cn be summrized s follows: Power Series Economiztion Process by Chebyshev Polynomils Inputs: (i) f(x) - (n+) times differentible function on [,b] (ii) n = positive integer Outputs: An economized power series of f(x). Step. Obtin P n (x) = + x n + + n x n by truncting the power series expnsion of f(x). Step. Find the trunction error. E TR (x) = Reminder fter n terms = f(n+) (ξ(x)) x n+ (n+)! nd compute the upper bound of E TR (x) for x. Step 3. Compute P n (x): P n (x) = P n (x) n Tn (x) Step 4. Check if the mximum vlue of the totl error pproximte P n (x) by P n (x). Compute P n (x) s: P n (x) = P n (x) n Tn (x) ( ) E TR + n is less thn ǫ. If so, n Step 5. Compute the error of the current pproximtion: P n (x) P n (x) = n n. Step 6. Compute the ccumulted error: ( ) n E TR + n + n n If this error is still less thn ǫ, continue until the ccumulted error exceeds ǫ. Exmple. Find the economized power series for cosx = x + x4 4! for x with tolernce ǫ =.5.

25 .6. MINIMAX POLYNOMIAL APPROXIMATIONS WITH CHEBYSHEV POLYNOMIALS489 Step. Let s first try with n = 4. P 4 (x) = x + x 3 + x4 4! Step. Trunction Error. T R (x) = f5 (ξ(x)) x 5 5! since f (5) (x) = sinx nd sinx for ll x, we hve T R (x) ()()5 =.83. Step 3. Compute P 3 (x): P 3 (x) = P 4 (x) 4 T4 (x) = x + x4 4! 4! =.4583x ( x 4 x + ) 8 Step 4. Mximum bsolute ccumulted error = Mximum bsolute trunction error + mximum bsolute Chebyshev error = =.35 which is greter thn ǫ =.5. Thus, the economized power series of f(x) = cosx for x with n error tolernce of ǫ =.5 is the 3 rd degree polynomil: P 3 (x) =.4583x Accurcy Check: We will check below how ccurte this pproximtion is for three vlues of x in x : two extreme vlues x = nd x =, nd one intermedite vlue x =.5. For x=.5. cos(.5) =.8776 P 3 (.5) =.88 Error = cos(.5) P 3 (.5) =.6 =.6. For x=. cos() = ; P 3 () =.9948 Error = cos() P 3 () =.5.

26 49CHAPTER. ORTHOGONAL POLYNOMIALS AND LEAST-SQUARES APPROXIMATIONS TO FUNCT For x=. cos() =.543; P 3 () =.5365 Error = cos() P 3 () =.38. Remrk: These errors re ll much less thn.5 even though theoreticl error-bound,.35, exceeded it.

Discrete Least-squares Approximations

Discrete Least-squares Approximations Discrete Lest-squres Approximtions Given set of dt points (x, y ), (x, y ),, (x m, y m ), norml nd useful prctice in mny pplictions in sttistics, engineering nd other pplied sciences is to construct curve

More information

Best Approximation. Chapter The General Case

Best Approximation. Chapter The General Case Chpter 4 Best Approximtion 4.1 The Generl Cse In the previous chpter, we hve seen how n interpolting polynomil cn be used s n pproximtion to given function. We now wnt to find the best pproximtion to given

More information

Chapter 3 Polynomials

Chapter 3 Polynomials Dr M DRAIEF As described in the introduction of Chpter 1, pplictions of solving liner equtions rise in number of different settings In prticulr, we will in this chpter focus on the problem of modelling

More information

1 The Lagrange interpolation formula

1 The Lagrange interpolation formula Notes on Qudrture 1 The Lgrnge interpoltion formul We briefly recll the Lgrnge interpoltion formul. The strting point is collection of N + 1 rel points (x 0, y 0 ), (x 1, y 1 ),..., (x N, y N ), with x

More information

Numerical Methods I Orthogonal Polynomials

Numerical Methods I Orthogonal Polynomials Numericl Methods I Orthogonl Polynomils Aleksndr Donev Cournt Institute, NYU 1 donev@cournt.nyu.edu 1 MATH-GA 2011.003 / CSCI-GA 2945.003, Fll 2014 Nov 6th, 2014 A. Donev (Cournt Institute) Lecture IX

More information

Lecture 19: Continuous Least Squares Approximation

Lecture 19: Continuous Least Squares Approximation Lecture 19: Continuous Lest Squres Approximtion 33 Continuous lest squres pproximtion We begn 31 with the problem of pproximting some f C[, b] with polynomil p P n t the discrete points x, x 1,, x m for

More information

Best Approximation in the 2-norm

Best Approximation in the 2-norm Jim Lmbers MAT 77 Fll Semester 1-11 Lecture 1 Notes These notes correspond to Sections 9. nd 9.3 in the text. Best Approximtion in the -norm Suppose tht we wish to obtin function f n (x) tht is liner combintion

More information

Lecture 6: Singular Integrals, Open Quadrature rules, and Gauss Quadrature

Lecture 6: Singular Integrals, Open Quadrature rules, and Gauss Quadrature Lecture notes on Vritionl nd Approximte Methods in Applied Mthemtics - A Peirce UBC Lecture 6: Singulr Integrls, Open Qudrture rules, nd Guss Qudrture (Compiled 6 August 7) In this lecture we discuss the

More information

Orthogonal Polynomials

Orthogonal Polynomials Mth 4401 Gussin Qudrture Pge 1 Orthogonl Polynomils Orthogonl polynomils rise from series solutions to differentil equtions, lthough they cn be rrived t in vriety of different mnners. Orthogonl polynomils

More information

Theoretical foundations of Gaussian quadrature

Theoretical foundations of Gaussian quadrature Theoreticl foundtions of Gussin qudrture 1 Inner product vector spce Definition 1. A vector spce (or liner spce) is set V = {u, v, w,...} in which the following two opertions re defined: (A) Addition of

More information

Lecture 14: Quadrature

Lecture 14: Quadrature Lecture 14: Qudrture This lecture is concerned with the evlution of integrls fx)dx 1) over finite intervl [, b] The integrnd fx) is ssumed to be rel-vlues nd smooth The pproximtion of n integrl by numericl

More information

Abstract inner product spaces

Abstract inner product spaces WEEK 4 Abstrct inner product spces Definition An inner product spce is vector spce V over the rel field R equipped with rule for multiplying vectors, such tht the product of two vectors is sclr, nd the

More information

Numerical Integration

Numerical Integration Chpter 5 Numericl Integrtion Numericl integrtion is the study of how the numericl vlue of n integrl cn be found. Methods of function pproximtion discussed in Chpter??, i.e., function pproximtion vi the

More information

Numerical Analysis. Doron Levy. Department of Mathematics Stanford University

Numerical Analysis. Doron Levy. Department of Mathematics Stanford University Numericl Anlysis Doron Levy Deprtment of Mthemtics Stnford University December 1, 2005 D. Levy Prefce i D. Levy CONTENTS Contents Prefce i 1 Introduction 1 2 Interpoltion 2 2.1 Wht is Interpoltion?............................

More information

Review of Calculus, cont d

Review of Calculus, cont d Jim Lmbers MAT 460 Fll Semester 2009-10 Lecture 3 Notes These notes correspond to Section 1.1 in the text. Review of Clculus, cont d Riemnn Sums nd the Definite Integrl There re mny cses in which some

More information

Numerical Analysis: Trapezoidal and Simpson s Rule

Numerical Analysis: Trapezoidal and Simpson s Rule nd Simpson s Mthemticl question we re interested in numericlly nswering How to we evlute I = f (x) dx? Clculus tells us tht if F(x) is the ntiderivtive of function f (x) on the intervl [, b], then I =

More information

1. Gauss-Jacobi quadrature and Legendre polynomials. p(t)w(t)dt, p {p(x 0 ),...p(x n )} p(t)w(t)dt = w k p(x k ),

1. Gauss-Jacobi quadrature and Legendre polynomials. p(t)w(t)dt, p {p(x 0 ),...p(x n )} p(t)w(t)dt = w k p(x k ), 1. Guss-Jcobi qudrture nd Legendre polynomils Simpson s rule for evluting n integrl f(t)dt gives the correct nswer with error of bout O(n 4 ) (with constnt tht depends on f, in prticulr, it depends on

More information

63. Representation of functions as power series Consider a power series. ( 1) n x 2n for all 1 < x < 1

63. Representation of functions as power series Consider a power series. ( 1) n x 2n for all 1 < x < 1 3 9. SEQUENCES AND SERIES 63. Representtion of functions s power series Consider power series x 2 + x 4 x 6 + x 8 + = ( ) n x 2n It is geometric series with q = x 2 nd therefore it converges for ll q =

More information

NUMERICAL INTEGRATION. The inverse process to differentiation in calculus is integration. Mathematically, integration is represented by.

NUMERICAL INTEGRATION. The inverse process to differentiation in calculus is integration. Mathematically, integration is represented by. NUMERICAL INTEGRATION 1 Introduction The inverse process to differentition in clculus is integrtion. Mthemticlly, integrtion is represented by f(x) dx which stnds for the integrl of the function f(x) with

More information

Lecture 4: Piecewise Cubic Interpolation

Lecture 4: Piecewise Cubic Interpolation Lecture notes on Vritionl nd Approximte Methods in Applied Mthemtics - A Peirce UBC Lecture 4: Piecewise Cubic Interpoltion Compiled 5 September In this lecture we consider piecewise cubic interpoltion

More information

CAAM 453 NUMERICAL ANALYSIS I Examination There are four questions, plus a bonus. Do not look at them until you begin the exam.

CAAM 453 NUMERICAL ANALYSIS I Examination There are four questions, plus a bonus. Do not look at them until you begin the exam. Exmintion 1 Posted 23 October 2002. Due no lter thn 5pm on Mondy, 28 October 2002. Instructions: 1. Time limit: 3 uninterrupted hours. 2. There re four questions, plus bonus. Do not look t them until you

More information

Partial Derivatives. Limits. For a single variable function f (x), the limit lim

Partial Derivatives. Limits. For a single variable function f (x), the limit lim Limits Prtil Derivtives For single vrible function f (x), the limit lim x f (x) exists only if the right-hnd side limit equls to the left-hnd side limit, i.e., lim f (x) = lim f (x). x x + For two vribles

More information

Math& 152 Section Integration by Parts

Math& 152 Section Integration by Parts Mth& 5 Section 7. - Integrtion by Prts Integrtion by prts is rule tht trnsforms the integrl of the product of two functions into other (idelly simpler) integrls. Recll from Clculus I tht given two differentible

More information

Lecture 17. Integration: Gauss Quadrature. David Semeraro. University of Illinois at Urbana-Champaign. March 20, 2014

Lecture 17. Integration: Gauss Quadrature. David Semeraro. University of Illinois at Urbana-Champaign. March 20, 2014 Lecture 17 Integrtion: Guss Qudrture Dvid Semerro University of Illinois t Urbn-Chmpign Mrch 0, 014 Dvid Semerro (NCSA) CS 57 Mrch 0, 014 1 / 9 Tody: Objectives identify the most widely used qudrture method

More information

Numerical quadrature based on interpolating functions: A MATLAB implementation

Numerical quadrature based on interpolating functions: A MATLAB implementation SEMINAR REPORT Numericl qudrture bsed on interpolting functions: A MATLAB implementtion by Venkt Ayylsomyjul A seminr report submitted in prtil fulfillment for the degree of Mster of Science (M.Sc) in

More information

Physics 116C Solution of inhomogeneous ordinary differential equations using Green s functions

Physics 116C Solution of inhomogeneous ordinary differential equations using Green s functions Physics 6C Solution of inhomogeneous ordinry differentil equtions using Green s functions Peter Young November 5, 29 Homogeneous Equtions We hve studied, especilly in long HW problem, second order liner

More information

CMDA 4604: Intermediate Topics in Mathematical Modeling Lecture 19: Interpolation and Quadrature

CMDA 4604: Intermediate Topics in Mathematical Modeling Lecture 19: Interpolation and Quadrature CMDA 4604: Intermedite Topics in Mthemticl Modeling Lecture 19: Interpoltion nd Qudrture In this lecture we mke brief diversion into the res of interpoltion nd qudrture. Given function f C[, b], we sy

More information

Properties of Integrals, Indefinite Integrals. Goals: Definition of the Definite Integral Integral Calculations using Antiderivatives

Properties of Integrals, Indefinite Integrals. Goals: Definition of the Definite Integral Integral Calculations using Antiderivatives Block #6: Properties of Integrls, Indefinite Integrls Gols: Definition of the Definite Integrl Integrl Clcultions using Antiderivtives Properties of Integrls The Indefinite Integrl 1 Riemnn Sums - 1 Riemnn

More information

The Regulated and Riemann Integrals

The Regulated and Riemann Integrals Chpter 1 The Regulted nd Riemnn Integrls 1.1 Introduction We will consider severl different pproches to defining the definite integrl f(x) dx of function f(x). These definitions will ll ssign the sme vlue

More information

Numerical integration

Numerical integration 2 Numericl integrtion This is pge i Printer: Opque this 2. Introduction Numericl integrtion is problem tht is prt of mny problems in the economics nd econometrics literture. The orgniztion of this chpter

More information

Section 7.1 Integration by Substitution

Section 7.1 Integration by Substitution Section 7. Integrtion by Substitution Evlute ech of the following integrls. Keep in mind tht using substitution my not work on some problems. For one of the definite integrls, it is not possible to find

More information

Lecture Note 4: Numerical differentiation and integration. Xiaoqun Zhang Shanghai Jiao Tong University

Lecture Note 4: Numerical differentiation and integration. Xiaoqun Zhang Shanghai Jiao Tong University Lecture Note 4: Numericl differentition nd integrtion Xioqun Zng Sngi Jio Tong University Lst updted: November, 0 Numericl Anlysis. Numericl differentition.. Introduction Find n pproximtion of f (x 0 ),

More information

III. Lecture on Numerical Integration. File faclib/dattab/lecture-notes/numerical-inter03.tex /by EC, 3/14/2008 at 15:11, version 9

III. Lecture on Numerical Integration. File faclib/dattab/lecture-notes/numerical-inter03.tex /by EC, 3/14/2008 at 15:11, version 9 III Lecture on Numericl Integrtion File fclib/dttb/lecture-notes/numerical-inter03.tex /by EC, 3/14/008 t 15:11, version 9 1 Sttement of the Numericl Integrtion Problem In this lecture we consider the

More information

Euler-Maclaurin Summation Formula 1

Euler-Maclaurin Summation Formula 1 Jnury 9, Euler-Mclurin Summtion Formul Suppose tht f nd its derivtive re continuous functions on the closed intervl [, b]. Let ψ(x) {x}, where {x} x [x] is the frctionl prt of x. Lemm : If < b nd, b Z,

More information

Unit #9 : Definite Integral Properties; Fundamental Theorem of Calculus

Unit #9 : Definite Integral Properties; Fundamental Theorem of Calculus Unit #9 : Definite Integrl Properties; Fundmentl Theorem of Clculus Gols: Identify properties of definite integrls Define odd nd even functions, nd reltionship to integrl vlues Introduce the Fundmentl

More information

Chapter 3 Solving Nonlinear Equations

Chapter 3 Solving Nonlinear Equations Chpter 3 Solving Nonliner Equtions 3.1 Introduction The nonliner function of unknown vrible x is in the form of where n could be non-integer. Root is the numericl vlue of x tht stisfies f ( x) 0. Grphiclly,

More information

Sturm-Liouville Eigenvalue problem: Let p(x) > 0, q(x) 0, r(x) 0 in I = (a, b). Here we assume b > a. Let X C 2 1

Sturm-Liouville Eigenvalue problem: Let p(x) > 0, q(x) 0, r(x) 0 in I = (a, b). Here we assume b > a. Let X C 2 1 Ch.4. INTEGRAL EQUATIONS AND GREEN S FUNCTIONS Ronld B Guenther nd John W Lee, Prtil Differentil Equtions of Mthemticl Physics nd Integrl Equtions. Hildebrnd, Methods of Applied Mthemtics, second edition

More information

Math 473: Practice Problems for the Material after Test 2, Fall 2011

Math 473: Practice Problems for the Material after Test 2, Fall 2011 Mth 473: Prctice Problems for the Mteril fter Test, Fll SOLUTION. Consider the following modified het eqution u t = u xx + u x. () Use the relevnt 3 point pproximtion formuls for u xx nd u x to derive

More information

UNIFORM CONVERGENCE MA 403: REAL ANALYSIS, INSTRUCTOR: B. V. LIMAYE

UNIFORM CONVERGENCE MA 403: REAL ANALYSIS, INSTRUCTOR: B. V. LIMAYE UNIFORM CONVERGENCE MA 403: REAL ANALYSIS, INSTRUCTOR: B. V. LIMAYE 1. Pointwise Convergence of Sequence Let E be set nd Y be metric spce. Consider functions f n : E Y for n = 1, 2,.... We sy tht the sequence

More information

Chapter 6. Infinite series

Chapter 6. Infinite series Chpter 6 Infinite series We briefly review this chpter in order to study series of functions in chpter 7. We cover from the beginning to Theorem 6.7 in the text excluding Theorem 6.6 nd Rbbe s test (Theorem

More information

The Riemann Integral

The Riemann Integral Deprtment of Mthemtics King Sud University 2017-2018 Tble of contents 1 Anti-derivtive Function nd Indefinite Integrls 2 3 4 5 Indefinite Integrls & Anti-derivtive Function Definition Let f : I R be function

More information

Math 270A: Numerical Linear Algebra

Math 270A: Numerical Linear Algebra Mth 70A: Numericl Liner Algebr Instructor: Michel Holst Fll Qurter 014 Homework Assignment #3 Due Give to TA t lest few dys before finl if you wnt feedbck. Exercise 3.1. (The Bsic Liner Method for Liner

More information

MORE FUNCTION GRAPHING; OPTIMIZATION. (Last edited October 28, 2013 at 11:09pm.)

MORE FUNCTION GRAPHING; OPTIMIZATION. (Last edited October 28, 2013 at 11:09pm.) MORE FUNCTION GRAPHING; OPTIMIZATION FRI, OCT 25, 203 (Lst edited October 28, 203 t :09pm.) Exercise. Let n be n rbitrry positive integer. Give n exmple of function with exctly n verticl symptotes. Give

More information

Math 1B, lecture 4: Error bounds for numerical methods

Math 1B, lecture 4: Error bounds for numerical methods Mth B, lecture 4: Error bounds for numericl methods Nthn Pflueger 4 September 0 Introduction The five numericl methods descried in the previous lecture ll operte by the sme principle: they pproximte the

More information

3.4 Numerical integration

3.4 Numerical integration 3.4. Numericl integrtion 63 3.4 Numericl integrtion In mny economic pplictions it is necessry to compute the definite integrl of relvlued function f with respect to "weight" function w over n intervl [,

More information

Euler, Ioachimescu and the trapezium rule. G.J.O. Jameson (Math. Gazette 96 (2012), )

Euler, Ioachimescu and the trapezium rule. G.J.O. Jameson (Math. Gazette 96 (2012), ) Euler, Iochimescu nd the trpezium rule G.J.O. Jmeson (Mth. Gzette 96 (0), 36 4) The following results were estblished in recent Gzette rticle [, Theorems, 3, 4]. Given > 0 nd 0 < s

More information

Convex Sets and Functions

Convex Sets and Functions B Convex Sets nd Functions Definition B1 Let L, +, ) be rel liner spce nd let C be subset of L The set C is convex if, for ll x,y C nd ll [, 1], we hve 1 )x+y C In other words, every point on the line

More information

Part IB Numerical Analysis

Part IB Numerical Analysis Prt IB Numericl Anlysis Theorems with proof Bsed on lectures by G. Moore Notes tken by Dexter Chu Lent 2016 These notes re not endorsed by the lecturers, nd I hve modified them (often significntly) fter

More information

Week 10: Riemann integral and its properties

Week 10: Riemann integral and its properties Clculus nd Liner Algebr for Biomedicl Engineering Week 10: Riemnn integrl nd its properties H. Führ, Lehrstuhl A für Mthemtik, RWTH Achen, WS 07 Motivtion: Computing flow from flow rtes 1 We observe the

More information

Numerical Analysis. Chassidy Bozeman. May 30, 2016

Numerical Analysis. Chassidy Bozeman. May 30, 2016 Numericl Anlysis Chssidy Bozemn My 30, 016 Contents 1 Theorems 1 1.1 561 Theorems............................................. 1 1. 56 Theorems............................................. Root Finding.1

More information

1 Linear Least Squares

1 Linear Least Squares Lest Squres Pge 1 1 Liner Lest Squres I will try to be consistent in nottion, with n being the number of dt points, nd m < n being the number of prmeters in model function. We re interested in solving

More information

New Expansion and Infinite Series

New Expansion and Infinite Series Interntionl Mthemticl Forum, Vol. 9, 204, no. 22, 06-073 HIKARI Ltd, www.m-hikri.com http://dx.doi.org/0.2988/imf.204.4502 New Expnsion nd Infinite Series Diyun Zhng College of Computer Nnjing University

More information

Chapters 4 & 5 Integrals & Applications

Chapters 4 & 5 Integrals & Applications Contents Chpters 4 & 5 Integrls & Applictions Motivtion to Chpters 4 & 5 2 Chpter 4 3 Ares nd Distnces 3. VIDEO - Ares Under Functions............................................ 3.2 VIDEO - Applictions

More information

NUMERICAL INTEGRATION

NUMERICAL INTEGRATION NUMERICAL INTEGRATION How do we evlute I = f (x) dx By the fundmentl theorem of clculus, if F (x) is n ntiderivtive of f (x), then I = f (x) dx = F (x) b = F (b) F () However, in prctice most integrls

More information

20 MATHEMATICS POLYNOMIALS

20 MATHEMATICS POLYNOMIALS 0 MATHEMATICS POLYNOMIALS.1 Introduction In Clss IX, you hve studied polynomils in one vrible nd their degrees. Recll tht if p(x) is polynomil in x, the highest power of x in p(x) is clled the degree of

More information

Numerical Integration. 1 Introduction. 2 Midpoint Rule, Trapezoid Rule, Simpson Rule. AMSC/CMSC 460/466 T. von Petersdorff 1

Numerical Integration. 1 Introduction. 2 Midpoint Rule, Trapezoid Rule, Simpson Rule. AMSC/CMSC 460/466 T. von Petersdorff 1 AMSC/CMSC 46/466 T. von Petersdorff 1 umericl Integrtion 1 Introduction We wnt to pproximte the integrl I := f xdx where we re given, b nd the function f s subroutine. We evlute f t points x 1,...,x n

More information

Z b. f(x)dx. Yet in the above two cases we know what f(x) is. Sometimes, engineers want to calculate an area by computing I, but...

Z b. f(x)dx. Yet in the above two cases we know what f(x) is. Sometimes, engineers want to calculate an area by computing I, but... Chpter 7 Numericl Methods 7. Introduction In mny cses the integrl f(x)dx cn be found by finding function F (x) such tht F 0 (x) =f(x), nd using f(x)dx = F (b) F () which is known s the nlyticl (exct) solution.

More information

1 The Riemann Integral

1 The Riemann Integral The Riemnn Integrl. An exmple leding to the notion of integrl (res) We know how to find (i.e. define) the re of rectngle (bse height), tringle ( (sum of res of tringles). But how do we find/define n re

More information

P 3 (x) = f(0) + f (0)x + f (0) 2. x 2 + f (0) . In the problem set, you are asked to show, in general, the n th order term is a n = f (n) (0)

P 3 (x) = f(0) + f (0)x + f (0) 2. x 2 + f (0) . In the problem set, you are asked to show, in general, the n th order term is a n = f (n) (0) 1 Tylor polynomils In Section 3.5, we discussed how to pproximte function f(x) round point in terms of its first derivtive f (x) evluted t, tht is using the liner pproximtion f() + f ()(x ). We clled this

More information

Overview of Calculus I

Overview of Calculus I Overview of Clculus I Prof. Jim Swift Northern Arizon University There re three key concepts in clculus: The limit, the derivtive, nd the integrl. You need to understnd the definitions of these three things,

More information

Exam 2, Mathematics 4701, Section ETY6 6:05 pm 7:40 pm, March 31, 2016, IH-1105 Instructor: Attila Máté 1

Exam 2, Mathematics 4701, Section ETY6 6:05 pm 7:40 pm, March 31, 2016, IH-1105 Instructor: Attila Máté 1 Exm, Mthemtics 471, Section ETY6 6:5 pm 7:4 pm, Mrch 1, 16, IH-115 Instructor: Attil Máté 1 17 copies 1. ) Stte the usul sufficient condition for the fixed-point itertion to converge when solving the eqution

More information

Techniques of Integration

Techniques of Integration Chpter 8 Techniques of Integrtion 8. Integrtion by Prts Some Exmples of Integrtion Exmple 8... Use π/4 +cos4x. cos θ = +cosθ. Exmple 8... Find secx. The ide is to multiply secx+tnx both the numertor nd

More information

Trapezoidal Rule, n = 1, x 0 = a, x 1 = b, h = b a. f (x)dx = h 2 (f (x 0) + f (x 1 )) h3

Trapezoidal Rule, n = 1, x 0 = a, x 1 = b, h = b a. f (x)dx = h 2 (f (x 0) + f (x 1 )) h3 Trpezoidl Rule, n = 1, x 0 =, x 1 = b, h = b f (x)dx = h 2 (f (x 0) + f (x 1 )) h3 12 f (ξ). Simpson s Rule: n = 3, x 0 =, x 1 = +b 2, x 2 = b, h = b 2. Qudrture Rule, double node t x 1 P 3 (x)dx = f (x

More information

Integrals - Motivation

Integrals - Motivation Integrls - Motivtion When we looked t function s rte of chnge If f(x) is liner, the nswer is esy slope If f(x) is non-liner, we hd to work hrd limits derivtive A relted question is the re under f(x) (but

More information

Math 520 Final Exam Topic Outline Sections 1 3 (Xiao/Dumas/Liaw) Spring 2008

Math 520 Final Exam Topic Outline Sections 1 3 (Xiao/Dumas/Liaw) Spring 2008 Mth 520 Finl Exm Topic Outline Sections 1 3 (Xio/Dums/Liw) Spring 2008 The finl exm will be held on Tuesdy, My 13, 2-5pm in 117 McMilln Wht will be covered The finl exm will cover the mteril from ll of

More information

Continuous Random Variables

Continuous Random Variables STAT/MATH 395 A - PROBABILITY II UW Winter Qurter 217 Néhémy Lim Continuous Rndom Vribles Nottion. The indictor function of set S is rel-vlued function defined by : { 1 if x S 1 S (x) if x S Suppose tht

More information

The Fundamental Theorem of Calculus. The Total Change Theorem and the Area Under a Curve.

The Fundamental Theorem of Calculus. The Total Change Theorem and the Area Under a Curve. Clculus Li Vs The Fundmentl Theorem of Clculus. The Totl Chnge Theorem nd the Are Under Curve. Recll the following fct from Clculus course. If continuous function f(x) represents the rte of chnge of F

More information

ODE: Existence and Uniqueness of a Solution

ODE: Existence and Uniqueness of a Solution Mth 22 Fll 213 Jerry Kzdn ODE: Existence nd Uniqueness of Solution The Fundmentl Theorem of Clculus tells us how to solve the ordinry differentil eqution (ODE) du = f(t) dt with initil condition u() =

More information

Construction of Gauss Quadrature Rules

Construction of Gauss Quadrature Rules Jim Lmbers MAT 772 Fll Semester 2010-11 Lecture 15 Notes These notes correspond to Sections 10.2 nd 10.3 in the text. Construction of Guss Qudrture Rules Previously, we lerned tht Newton-Cotes qudrture

More information

Advanced Computational Fluid Dynamics AA215A Lecture 3 Polynomial Interpolation: Numerical Differentiation and Integration.

Advanced Computational Fluid Dynamics AA215A Lecture 3 Polynomial Interpolation: Numerical Differentiation and Integration. Advnced Computtionl Fluid Dynmics AA215A Lecture 3 Polynomil Interpoltion: Numericl Differentition nd Integrtion Antony Jmeson Winter Qurter, 2016, Stnford, CA Lst revised on Jnury 7, 2016 Contents 3 Polynomil

More information

Chapter 1. Basic Concepts

Chapter 1. Basic Concepts Socrtes Dilecticl Process: The Þrst step is the seprtion of subject into its elements. After this, by deþning nd discovering more bout its prts, one better comprehends the entire subject Socrtes (469-399)

More information

A REVIEW OF CALCULUS CONCEPTS FOR JDEP 384H. Thomas Shores Department of Mathematics University of Nebraska Spring 2007

A REVIEW OF CALCULUS CONCEPTS FOR JDEP 384H. Thomas Shores Department of Mathematics University of Nebraska Spring 2007 A REVIEW OF CALCULUS CONCEPTS FOR JDEP 384H Thoms Shores Deprtment of Mthemtics University of Nebrsk Spring 2007 Contents Rtes of Chnge nd Derivtives 1 Dierentils 4 Are nd Integrls 5 Multivrite Clculus

More information

MA 124 January 18, Derivatives are. Integrals are.

MA 124 January 18, Derivatives are. Integrals are. MA 124 Jnury 18, 2018 Prof PB s one-minute introduction to clculus Derivtives re. Integrls re. In Clculus 1, we lern limits, derivtives, some pplictions of derivtives, indefinite integrls, definite integrls,

More information

Review of Riemann Integral

Review of Riemann Integral 1 Review of Riemnn Integrl In this chpter we review the definition of Riemnn integrl of bounded function f : [, b] R, nd point out its limittions so s to be convinced of the necessity of more generl integrl.

More information

Review of basic calculus

Review of basic calculus Review of bsic clculus This brief review reclls some of the most importnt concepts, definitions, nd theorems from bsic clculus. It is not intended to tech bsic clculus from scrtch. If ny of the items below

More information

p(x) = 3x 3 + x n 3 k=0 so the right hand side of the equality we have to show is obtained for r = b 0, s = b 1 and 2n 3 b k x k, q 2n 3 (x) =

p(x) = 3x 3 + x n 3 k=0 so the right hand side of the equality we have to show is obtained for r = b 0, s = b 1 and 2n 3 b k x k, q 2n 3 (x) = Norwegin University of Science nd Technology Deprtment of Mthemticl Sciences Pge 1 of 5 Contct during the exm: Elen Celledoni, tlf. 73593541, cell phone 48238584 PLESE NOTE: this solution is for the students

More information

B.Sc. in Mathematics (Ordinary)

B.Sc. in Mathematics (Ordinary) R48/0 DUBLIN INSTITUTE OF TECHNOLOGY KEVIN STREET, DUBLIN 8 B.Sc. in Mthemtics (Ordinry) SUPPLEMENTAL EXAMINATIONS 01 Numericl Methods Dr. D. Mckey Dr. C. Hills Dr. E.A. Cox Full mrks for complete nswers

More information

Numerical Integration

Numerical Integration Numericl Integrtion Wouter J. Den Hn London School of Economics c 2011 by Wouter J. Den Hn June 3, 2011 Qudrture techniques I = f (x)dx n n w i f (x i ) = w i f i i=1 i=1 Nodes: x i Weights: w i Qudrture

More information

AM1 Mathematical Analysis 1 Oct Feb Exercises Lecture 3. sin(x + h) sin x h cos(x + h) cos x h

AM1 Mathematical Analysis 1 Oct Feb Exercises Lecture 3. sin(x + h) sin x h cos(x + h) cos x h AM Mthemticl Anlysis Oct. Feb. Dte: October Exercises Lecture Exercise.. If h, prove the following identities hold for ll x: sin(x + h) sin x h cos(x + h) cos x h = sin γ γ = sin γ γ cos(x + γ) (.) sin(x

More information

Lecture 12: Numerical Quadrature

Lecture 12: Numerical Quadrature Lecture 12: Numericl Qudrture J.K. Ryn@tudelft.nl WI3097TU Delft Institute of Applied Mthemtics Delft University of Technology 5 December 2012 () Numericl Qudrture 5 December 2012 1 / 46 Outline 1 Review

More information

DEFINITION The inner product of two functions f 1 and f 2 on an interval [a, b] is the number. ( f 1, f 2 ) b DEFINITION 11.1.

DEFINITION The inner product of two functions f 1 and f 2 on an interval [a, b] is the number. ( f 1, f 2 ) b DEFINITION 11.1. 398 CHAPTER 11 ORTHOGONAL FUNCTIONS AND FOURIER SERIES 11.1 ORTHOGONAL FUNCTIONS REVIEW MATERIAL The notions of generlized vectors nd vector spces cn e found in ny liner lger text. INTRODUCTION The concepts

More information

Cambridge International Examinations Cambridge International Advanced Subsidiary and Advanced Level. Published

Cambridge International Examinations Cambridge International Advanced Subsidiary and Advanced Level. Published Cmbridge Interntionl Exmintions Cmbridge Interntionl Advnced Subsidiry nd Advnced Level MATHEMATICS 9709/ Pper October/November 06 MARK SCHEME Mximum Mrk: 75 Published This mrk scheme is published s n

More information

x = b a n x 2 e x dx. cdx = c(b a), where c is any constant. a b

x = b a n x 2 e x dx. cdx = c(b a), where c is any constant. a b CHAPTER 5. INTEGRALS 61 where nd x = b n x i = 1 (x i 1 + x i ) = midpoint of [x i 1, x i ]. Problem 168 (Exercise 1, pge 377). Use the Midpoint Rule with the n = 4 to pproximte 5 1 x e x dx. Some quick

More information

MATH34032: Green s Functions, Integral Equations and the Calculus of Variations 1

MATH34032: Green s Functions, Integral Equations and the Calculus of Variations 1 MATH34032: Green s Functions, Integrl Equtions nd the Clculus of Vritions 1 Section 1 Function spces nd opertors Here we gives some brief detils nd definitions, prticulrly relting to opertors. For further

More information

Indefinite Integral. Chapter Integration - reverse of differentiation

Indefinite Integral. Chapter Integration - reverse of differentiation Chpter Indefinite Integrl Most of the mthemticl opertions hve inverse opertions. The inverse opertion of differentition is clled integrtion. For exmple, describing process t the given moment knowing the

More information

THE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS.

THE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS. THE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS RADON ROSBOROUGH https://intuitiveexplntionscom/picrd-lindelof-theorem/ This document is proof of the existence-uniqueness theorem

More information

8 Laplace s Method and Local Limit Theorems

8 Laplace s Method and Local Limit Theorems 8 Lplce s Method nd Locl Limit Theorems 8. Fourier Anlysis in Higher DImensions Most of the theorems of Fourier nlysis tht we hve proved hve nturl generliztions to higher dimensions, nd these cn be proved

More information

Chapter 5 : Continuous Random Variables

Chapter 5 : Continuous Random Variables STAT/MATH 395 A - PROBABILITY II UW Winter Qurter 216 Néhémy Lim Chpter 5 : Continuous Rndom Vribles Nottions. N {, 1, 2,...}, set of nturl numbers (i.e. ll nonnegtive integers); N {1, 2,...}, set of ll

More information

c n φ n (x), 0 < x < L, (1) n=1

c n φ n (x), 0 < x < L, (1) n=1 SECTION : Fourier Series. MATH4. In section 4, we will study method clled Seprtion of Vribles for finding exct solutions to certin clss of prtil differentil equtions (PDEs. To do this, it will be necessry

More information

Sections 5.2: The Definite Integral

Sections 5.2: The Definite Integral Sections 5.2: The Definite Integrl In this section we shll formlize the ides from the lst section to functions in generl. We strt with forml definition.. The Definite Integrl Definition.. Suppose f(x)

More information

Lecture 1. Functional series. Pointwise and uniform convergence.

Lecture 1. Functional series. Pointwise and uniform convergence. 1 Introduction. Lecture 1. Functionl series. Pointwise nd uniform convergence. In this course we study mongst other things Fourier series. The Fourier series for periodic function f(x) with period 2π is

More information

x = b a N. (13-1) The set of points used to subdivide the range [a, b] (see Fig. 13.1) is

x = b a N. (13-1) The set of points used to subdivide the range [a, b] (see Fig. 13.1) is Jnury 28, 2002 13. The Integrl The concept of integrtion, nd the motivtion for developing this concept, were described in the previous chpter. Now we must define the integrl, crefully nd completely. According

More information

Definition of Continuity: The function f(x) is continuous at x = a if f(a) exists and lim

Definition of Continuity: The function f(x) is continuous at x = a if f(a) exists and lim Mth 9 Course Summry/Study Guide Fll, 2005 [1] Limits Definition of Limit: We sy tht L is the limit of f(x) s x pproches if f(x) gets closer nd closer to L s x gets closer nd closer to. We write lim f(x)

More information

Calculus and linear algebra for biomedical engineering Week 11: The Riemann integral and its properties

Calculus and linear algebra for biomedical engineering Week 11: The Riemann integral and its properties Clculus nd liner lgebr for biomedicl engineering Week 11: The Riemnn integrl nd its properties Hrtmut Führ fuehr@mth.rwth-chen.de Lehrstuhl A für Mthemtik, RWTH Achen Jnury 9, 2009 Overview 1 Motivtion:

More information

Numerical Integration

Numerical Integration Chpter 1 Numericl Integrtion Numericl differentition methods compute pproximtions to the derivtive of function from known vlues of the function. Numericl integrtion uses the sme informtion to compute numericl

More information

How can we approximate the area of a region in the plane? What is an interpretation of the area under the graph of a velocity function?

How can we approximate the area of a region in the plane? What is an interpretation of the area under the graph of a velocity function? Mth 125 Summry Here re some thoughts I ws hving while considering wht to put on the first midterm. The core of your studying should be the ssigned homework problems: mke sure you relly understnd those

More information

Chapter 28. Fourier Series An Eigenvalue Problem.

Chapter 28. Fourier Series An Eigenvalue Problem. Chpter 28 Fourier Series Every time I close my eyes The noise inside me mplifies I cn t escpe I relive every moment of the dy Every misstep I hve mde Finds wy it cn invde My every thought And this is why

More information

TABLE OF CONTENTS 3 CHAPTER 1

TABLE OF CONTENTS 3 CHAPTER 1 TABLE OF CONTENTS 3 CHAPTER 1 Set Lnguge & Nottion 3 CHAPTER 2 Functions 3 CHAPTER 3 Qudrtic Functions 4 CHAPTER 4 Indices & Surds 4 CHAPTER 5 Fctors of Polynomils 4 CHAPTER 6 Simultneous Equtions 4 CHAPTER

More information

Integral equations, eigenvalue, function interpolation

Integral equations, eigenvalue, function interpolation Integrl equtions, eigenvlue, function interpoltion Mrcin Chrząszcz mchrzsz@cernch Monte Crlo methods, 26 My, 2016 1 / Mrcin Chrząszcz (Universität Zürich) Integrl equtions, eigenvlue, function interpoltion

More information

Matrices, Moments and Quadrature, cont d

Matrices, Moments and Quadrature, cont d Jim Lmbers MAT 285 Summer Session 2015-16 Lecture 2 Notes Mtrices, Moments nd Qudrture, cont d We hve described how Jcobi mtrices cn be used to compute nodes nd weights for Gussin qudrture rules for generl

More information