POLYNOMIAL AND SPLINE ESTIMATORS OF THE DISTRIBUTION FUNCTION WITH PRESCRIBED ACCURACY
|
|
- Jeffery Bond
- 6 years ago
- Views:
Transcription
1 APPLICATIONES MATHEMATICAE 36, (29), pp. 2 Zbigniew Ciesielski (Sopot) Ryszard Zieliński (Warszawa) POLYNOMIAL AND SPLINE ESTIMATORS OF THE DISTRIBUTION FUNCTION WITH PRESCRIBED ACCURACY Abstract. Dvoretzky Kiefer Wolfowitz type inequalities for some polynomial and spline estimators of distribution functions are constructed. Moreover, ints on te corresponding algoritms are given as well.. Introduction. Te family of all continuous probability distribution functions on te real line is denoted by F. If te probability corresponding to F F is supported on te interval I ten we write F F(I). Let X,..., X n be a simple sample corresponding to a distribution F F and let (.) F n () = n n (,] (X j ). j= Te Dvoretzky Kiefer Wolfowitz (DKW) inequality in its final form (see [6]) (.2) P { F n F ε} 2e 2nε2 for all F F, were F n F = sup F n () F (), gives us a powerful tool for statistical applications (testing ypoteses concerning unknown F, confidence intervals for F etc.). It seems, owever, unnatural to estimate a continuous F F by te step function F n. In te abundant literature of te subject one can find different approaces to smooting empirical distribution functions but it turns out tat smooting may spoil te estimator. For classical kernel estimators (see e.g. [8]) no inequality of DKW type eists (Zieliński [9]). Consequently, one cannot tell ow many observations X,..., X n are 2 Matematics Subject Classification: Primary 62G7; Secondary 62G3, 6E5. Key words and prases: nonparametric estimation, distribution estimation, Dvoretzky Kiefer Wolfowitz inequality, polynomial estimators, spline estimators, smooting of empirical distribution function. DOI:.464/am36-- [] c Instytut Matematyczny PAN, 29
2 2 Z. Ciesielski and R. Zieliński needed to guarantee te prescribed accuracy of te kernel estimator. Using te metod from [9] one can prove a similar negative result for some polynomial estimators (see Section 4 below). In wat follows we discuss tree estimators and te DKW type inequalities for tem. Te first one (see Section 3), to be denoted by Φ m,n, is a smoot modification of F n. It is a piecewise polynomial estimator of te class C m F wit knots placed at te sample points X :n,..., X n:n. Te smootness parameter m =, 2,... can be fied by te statistician according to is a priori knowledge of te smootness of te estimated F F. In tis case te DKW type inequality olds in te class F of all continuous probability distribution functions on te real line. Te second one (see Section 4) is te polynomial estimator constructed in Ciesielski [3], and te tird one (see Section 5) is a spline estimator wit equally spaced knots (Ciesielski [2], [4]). In bot cases subclasses of F are eplicitly specified for wic te DKW type inequalities are proved. We start in Section 2 wit preliminaries on specific approimations by algebraic polynomials and by splines wit equally spaced knots. 2. Preliminaries from approimation teory. We recall te necessary ingredients from approimation teory, in particular te basic properties of te Bernstein polynomials and of te related B-splines. Te relation is direct: te Bernstein polynomials are simply te degenerate B-splines. Let us start wit te Bernstein polynomials. For a given integer r let Π m denote te space of real polynomials of degree at most m = r (i.e. of order r). For convenience, bot parameters r and m will be used; m is more natural for polynomials and r for splines. Te basic Bernstein polynomials of degree m are linearly independent and given by te formula (2.) N i,m () = Consequently, ( m i ) i ( ) m i wit i =,..., m. (2.2) Π m = span[n i,m : i =,..., m], and terefore eac w Π m as a unique representation m (2.3) w() = w i N i,m (). i= Now, given te coefficients w i and te (, ) we can calculate te value w() using te Casteljeau algoritm based on te identity (2.4) N i,m () = ( )N i,m () + N i,m (). Te Bernstein polynomials are positive on (, ) and tey form a partition
3 of unity, (2.5) Polynomial and spline estimators 3 m N i,m () = for i =,..., m and (, ). i= On te oter and, te modified Bernstein polynomials (2.6) M i,m () = (m + )N i,m () are normalized in L (, ), i.e. (2.7) M i,m () d =. In our construction of te polynomial estimator, te Durrmeyer kernel m (2.8) R m (, y) = M i,m ()N i,m (y) i= plays an essential role. Te kernel is symmetric and it as te following spectral representation: m (2.9) R m (, y) = λ i,m l i ()l i (y), i= were te eigenfunctions are te ortonormal Legendre polynomials l i and for te corresponding eigenvalues λ i,m we ave (cf. e.g. [5]) (2.) λ,m =, λ i,m = i j= wence, wit te notation λ k = k(k + ), (2.) 2 5 λ j λ k+ λ j,m λ j m + 2 m + j m + + j for i =,..., m, for λ k m < λ k+, j k. Now, for a given function F wic is eiter of bounded variation or continuous on [, ], te value of te underlying smooting operator is a polynomial of degree m + defined by te formula [ (2.2) T m F () = F () + Now, since (2.3) M i,m (y) dy = m+ j=i+ ] R m (y, z) df (y) dz. N j,m+ () for i =,,..., m, te Casteljeau algoritm, in case F = F n, can be applied to calculate te value T m F (). It also follows from (2.2) tat te integrated Legendre
4 4 Z. Ciesielski and R. Zieliński polynomials (2.4) L j () = l j (y) dy for j =,,... are te eigenfunctions for te operators T m wit te corresponding eigenvalues (2.6). For more details on te eigenvalues λ i,m we refer to [3]. An elementary argument gives, for any probability distribution functions F and G, bot supported on [, ], te important inequality (2.5) T m F T m G F G. Moreover, if F is a continuous function on [, ], ten (2.6) T m F 3 F. Proposition 2.. For eac F C[, ] we ave (2.7) F T m F as m. Proof. Te family {T m } of operators on C[, ] is by (2.6) uniformly bounded and terefore by te Banac Steinaus teorem it is sufficient to ceck (2.7) for F = L j wit any fied j. However, in tis case F T m F = L j T m L j = ( λ j,m )L j, and an application of (2.) completes te proof. In wat follows we use te symbol W m p (I) for te Sobolev space of order of smootness m and wit te integrability eponent p. Teorem 2.2. Let F W 2 2 [, ] F[, ], D = d/d and M = D2 F 2. Ten (2.8) F T m F M m /4 for m = 2, 3,.... Proof. For te density f = DF we ave (2.9) (f, ) = wit te usual scalar product (f, g) in L 2 [, ], and (2.2) F () T m F () = (f R m f)(z) dz, were R m is te Durrmeyer operator corresponding to (2.8). It now follows from (2.2) tat (2.2) F T m F f R m f 2. Using te spectral representation of R m we find tat (2.22) f R m f 2 2 = ( λ i,m ) 2 a 2 i, i=
5 Polynomial and spline estimators 5 were te a i s are te Fourier Legendre coefficients and by definition eac λ i,m for i > m is assumed to be. Moreover, (2.23) a i = (f, l i ). Using te notation from (2.4) we get (2.24) a i = (D 2 F, L i ) M L i 2. It remains to estimate L i 2. To tis end apply te identity (2.25) 2L i+ = l i+2 l i, i, (2i + )(2i + 3) (2i + )(2i ) to get (2.26) L i+ 2 2 = ( ) 8λ i 3 ( ) 4λ i 8λ i 3 =, 5λ 4λ i i. Tus, for te unique k satisfying te inequalities λ k m < λ k+ we obtain (2.27) a i 2 M 2 = M 2 5λ i 5 k. i=k+ By te monotonicity in m of f R m f 2 and by (2.) we get k ( ) 2 (2.28) f R m f 2 λi 2 a i 2 + M 2 m k. Now, λ = 2, L 2 2 = /, m/2 k < m, and terefore k ( ) 2 λi (2.29) a i 2 3M 2 m m. i= i= i=k Combining (2.29) and (2.28) we get (2.8). In te construction below of te spline estimator wit random knots, a particular role is played by te following polynomial density function on [, ]: ( ) 2m (2.3) φ m () := M m,2m () = (2m + ) m ( ) m, m were te positive integer m is te given parameter of smootness. Te corresponding polynomial distribution function is (2.3) Φ m () = φ m (y) dy, or else (see (2.3)) (2.32) Φ m () = 2m+ i=m+ N i,2m+ (),
6 6 Z. Ciesielski and R. Zieliński wic permits calculating Φ m () wit te elp of te Casteljeau algoritm. It is also important tat Φ m () solves te two-point Hermite interpolation problem of order m, i.e. (2.33) D k Φ m () = and D k Φ m () = δ k, for k =,..., m. For later convenience we also introduce te transformed polynomial distribution ( ) a (2.34) Φ m (; [a, b]) = Φ m. b a Clearly, Φ m (a; [a, b]) = and Φ m (b; [a, b]) =. On te real line R similar roles to polynomials and Bernstein polynomials on [, ] are played by te cardinal splines and cardinal B-splines, respectively. For a given integer r te space S r of cardinal splines of order r is te space of all functions on R of class C r 2 wose restrictions to (j, j + ) are polynomials of order r, i.e. D r S = on eac (j, j + ) for j =, ±,.... It is known tat tere is a unique B (r) S r (up to a multiplicative constant) positive on (, r) and wit support [, r]. Te function B (r) becomes unique if normalized e.g. so tat (2.35) B (r) (y) dy =. R Te density B (r) can as well be defined probabilistically by te formula (2.36) P {U + + U r < } = B (r) (y) dy were U,..., U r are independent uniformly distributed r.v. on [, ]. We also need te rescaled cardinal B-splines N (r) i, () = B(r) ( i ) and M (r) i, () = B(r) ( i ) for i Z, were > is te so called window parameter. Tey sare te nice properties (2.37) N (r) i, () = and M (r) i, (y) dy =. Clearly, supp N (r) i, formula (2.38) N (r) i, () = i (r) = supp M i, R = [i, (i + r)]. Moreover, te recurrent i (r ) N (r ) i, () + (i + r) (r ) N (r ) i+, () supplies an algoritm for calculating at a given te value of te cardinal
7 spline (2.39) Polynomial and spline estimators 7 i a i N (r) i, () given te coefficients (a i ). Te same algoritm can be used to calculate te value at of te distribution function (2.4) M (r) i, (y) dy = N (r+) i, (). Now, just as in te polynomial case (cf. (2.8)) we introduce te spline kernel (2.4) R (k,r) (, y) = M (k) (r) i+ν, ()N i, (y). i= In wat follows it is assumed tat k r and tat r k is even, i.e. r k = 2ν wit ν being a non-negative integer. It ten follows tat te supports of M (k) (r) i+ν, and of N i, are concentric. Denote by C ±(R) te linear space of all rigt-continuous functions on R wit finite limits at ±, and by BV (R) te linear space of all continuous functions of finite total variation on R. Now, for F C ± (R) BV (R) te value of te operator T (k,r) F is defined by te formula ( ) (2.42) T (k,r) F () = R (k,r) (z, y) F (dz) dy = R i= R j=i M (k) i+ν, df N (r) i, (y) dy. To recall from [4] te direct approimation teorem by te operators T (k,r), te notion of modulus of a given order m is needed: were m t ω m (F ; δ) = sup m t F, t <δ is te mt order progressive difference wit step t, i.e. m ( ) m m t f() = ( ) j+m f( + jt). j j= Now, te following teorem, important for spline estimation, was proved in [4]: Teorem 2.3. Let k r wit r k even and let >. Ten for F C ± (R) BV (R), (2.42) T (r,k) F F,
8 8 Z. Ciesielski and R. Zieliński and for F C ± (R), (2.43) F T (k,r) F 2(4 + (r + k) 2 )ω 2 (F ; ), and in particular for k =, ( (2.44) F T (,r) F ω F ; r + ). 2 Consequently, for eac continuous probability distribution F, (2.45) F T (k,r) F as A smoot modification of F n. We start, for a given positive integer m, wit te polynomial density (2.3) and its polynomial probability distribution (2.3). Let now X :n,..., X n:n wit X :n X n:n be te order statistics from te sample X,..., X n. For tecnical reasons we assume tat X :n < < X n:n ; oterwise one sould consider multiple knots. Moreover, define X :n = ma{, X :n (X 2:n X :n )} = ma{, 2X :n X 2:n }, X n+:n = min{x n:n + (X n:n X n :n ), } = min{2x n:n X n :n, }. Now, for te given sample X,..., X n and for given m a new estimator Φ m,n () for F is defined as follows: it equals for < X :n, for X n+:n, and for i =,..., n + and X i :n < X i:n, (3.) Φ m,n () = n Φ(; [X i :n, X i:n ]) + F n (X i :n ) 2n. We consider Φ m,n () as an estimator of te unknown distribution function F F wic generates te sample X,..., X n. Given te sample, te estimator Φ m,n () may be easily calculated by te Casteljeau algoritm or using te standard incomplete beta functions or distribution functions of beta random variable; te functions are available in numerical computer packages. Summarizing we get Proposition 3.. Te estimator Φ m,n as te following properties:. It is a piecewise polynomial probability distribution supported on [X :n, X n+:n ] wit knots at te sample points. 2. Te function Φ m,n ()+/2n interpolates F n at te sample points, i.e. Φ m,n (X i:n ) + 2n = F n(x i:n ) for i =,..., n. 3. Φ m,n C m (R). 4. D k Φ m,n (X i:n ) = for k =,..., m and i =,..., n. 5. Φ m,n F F n F + /2n.
9 Polynomial and spline estimators 9 6. Moreover, te following DKW type inequality olds: (3.2) P { Φ m,n F ε} 2 e 2n(ε /2n)2, n > 2ε, F F. 4. Estimating by polynomials on [, ]. A polynomial estimator on [, ] (see [3] and cf. (2.2)) can be defined by (4.) F m,n () = T m F n (), were T m transforms distributions on [, ], continuous or not, into distribution functions on [, ] wic are polynomials of degree m +. It turns out tat for te family F[, ] of all continuous distributions supported on [, ], te DKW type inequality for te estimator F m,n does not old. More precisely, we ave te following negative result Teorem 4.. Tere are ε > and η > suc tat for any m and n one can find a distribution function F F[, ] suc tat (4.2) P { F m,n F > ε} > η. To prove (4.2) it is enoug to demonstrate tat for some ε, η > and for every n and for every odd m te following inequality olds: (4.3) P {F m,n (/2) > F (/2) + ε > } > η. We start te proof by writing formula (4.) in te form (4.4) F m,n () = n m N i,m (X j ) M i,m (y) dy, n wence by (2.3), (4.5) F m,n () = n j= i= n j= i= m N i,m (X j ) m+ k=i+ N k,m+ (). Let now {ε k : k =,,...} be a sequence of independent Bernoulli r.v. wit P {ε k = } = /2 = P {ε k = }. Moreover, let ζ m+ = ε + + ε m+ be te binomial r.v. Ten for odd m = 2ν and i ν, (4.6) m+ k=i+ N k,m+ (/2) = P {ζ m+ > i} P {ζ m+ > ν} = P {ζ m+ ν} = /2. Consequently, by (2.3) we obtain, for odd m, (4.7) F m,n (/2) n ν N i,m (X j ) 2n 2n j= i= n j= X j M ν,m (y) dy.
10 Z. Ciesielski and R. Zieliński Now, te continuous function M m () = M ν,m (y) dy is decreasing on [, ], M m () =, and M m (/2) = /2. Consequently, for ε (, /6) tere is δ > suc tat M m (δ + /2) > 4ε. Coose now F F[, ] suc tat F (/2) < ε and F (/2 + δ) > η /n. Tus, by our ypotesis we get, for j =,..., n, P F {X j < /2 + δ} > η /n and P F {M m (X j ) > 4ε} > η /n. Taking into account tat n {M m (X j ) > 4ε} one obtains j= wic proves (4.3). P F { n n j= { n n j= } M m (X j ) > 4ε } M m (X j ) > 4ε > η, To obtain a positive DKW type inequality for te above polynomial estimators we reduce te space F of all continuous distribution functions to a smaller subclass. We sall discuss, for a given constant M, subclass W M of F[, ] suc tat F W M if and only if te density f = F is absolutely continuous and its derivative satisfies (4.8) f () 2 d M. Teorem 4.2. Given constants M >, ε > and η >, one can find eplicit values of m and n suc tat (4.9) P { F m,n F > ε} < η for all F W M. Specifically, it is enoug to coose m and n so tat 2M < ε and 2 ep ( 2 nm 2 ) m/4 m /2 < η. Proof. Let us start wit te identity F F m,n = (F T m F ) + T m (F F n ). Now (see [3]) te triangle inequality and contraction property (2.5) imply (4.) F F m,n F F n + F T m F,
11 Polynomial and spline estimators wence by Teorem 2.2 and by te DKW inequality we get P { F F m,n > ε} P { F F m,n > 2M/m /4 } and tis completes te proof. P { F F n + F T m F > 2M/m /4 } P { F F n + M/m /4 > 2M/m /4 } = P { F F n > M/m /4 } 2 ep ( 2 nm 2 ) < η, m /2 5. Estimating by splines wit equally spaced knots. In tis section we eibit a ric family of subclasses of continuous probability distributions on R for wic te DKW type inequality olds. Te general sceme is very muc like tat in Section 4 (cf. te proof of Teorem 4.2). We start by recalling te generalized Hölder classes. A function ω() on R + is said to be a modulus of smootness if it is bounded, continuous, vanising at, non-decreasing and subadditive, e.g. concave. Suppose we are given integers (k, r) satisfying te conditions formulated just below formula (2.4). Taking into account wat we already know it is reasonable to consider te following Hölder classes of probability distributions: (5.) (5.2) H (k,r) ω,2 = {F F : 2(4 + (r + k) 2 )ω 2 (F ; ) ω() for all > }, ( H (k,r) ω, = {F F : ω F ; r + k ) } ω() for all >. 2 According to our sceme, te spline estimator wit window parameter and wit te given (k, r) is defined by te formula (5.3) F,n = F (k,r),n = T (k,r) F n. For tese estimators we also ave te basic inequality (5.4) F F,n F F n + F T (k,r) F. We are now in a position to state te DKW type inequality for te generalized Hölder classes of continuous distributions. Teorem 5.. Let i =, 2 and k r wit r k even. Ten for all ε > and η > tere are > and n suc tat (5.5) P { F,n F > ε} < η for all F H (k,r) ω,i. It suffices to coose and n suc tat ω() < ε/2 and 2 ep( nε 2 /2) < η. Te proof is immediate from te DKW inequality, (5.4) and Teorem 2.3.
12 2 Z. Ciesielski and R. Zieliński References [] C. de Boor, Linear combinations of B-splines, in: Approimation Teory II, Academic Press, 976, 47. [2] Z. Ciesielski, Local spline approimation and nonparametric density estimation, in: Constructive Teory of Functions 87, Sofia, 988, [3], Nonparametric polynomial density estimation, Probab. Mat. Statist. 9 (988),. [4], Asymptotic nonparametric spline density estimation, ibid. 2 (99), 24. [5] Z. Ciesielski and J. Domsta, Te degenerate B-splines as basis in te space of algebraic polynomials, Ann. Polon. Mat. 46 (985), [6] P. Massart, Te tigt constant in te Dvoretzky Kiefer Wolfowitz inequality, Ann. Probab. 8 (99), [7] I. J. Scoenberg, Cardinal interpolation and spline functions, J. Appro. Teory 2 (969), [8] E. J. Wegman, Kernel estimators, in: Encyclopedia of Statistical Sciences, 2nd ed., Vol. 6, Wiley-Interscience, 26. [9] R. Zieliński, Kernel estimators and te Dvoretzky Kiefer Wolfowitz inequality, Appl. Mat. (Warsaw) 34 (27), Instytut Matematyczny PAN Abraama Sopot, Poland Z.Ciesielski@impan.gda.pl Instytut Matematyczny PAN Śniadeckic Warszawa, Poland R.Zielinski@impan.pl Received on.7.28 (945)
1 The concept of limits (p.217 p.229, p.242 p.249, p.255 p.256) 1.1 Limits Consider the function determined by the formula 3. x since at this point
MA00 Capter 6 Calculus and Basic Linear Algebra I Limits, Continuity and Differentiability Te concept of its (p.7 p.9, p.4 p.49, p.55 p.56). Limits Consider te function determined by te formula f Note
More information2.8 The Derivative as a Function
.8 Te Derivative as a Function Typically, we can find te derivative of a function f at many points of its domain: Definition. Suppose tat f is a function wic is differentiable at every point of an open
More informationPolynomial Interpolation
Capter 4 Polynomial Interpolation In tis capter, we consider te important problem of approximatinga function fx, wose values at a set of distinct points x, x, x,, x n are known, by a polynomial P x suc
More informationlecture 26: Richardson extrapolation
43 lecture 26: Ricardson extrapolation 35 Ricardson extrapolation, Romberg integration Trougout numerical analysis, one encounters procedures tat apply some simple approximation (eg, linear interpolation)
More informationOrder of Accuracy. ũ h u Ch p, (1)
Order of Accuracy 1 Terminology We consider a numerical approximation of an exact value u. Te approximation depends on a small parameter, wic can be for instance te grid size or time step in a numerical
More informationERROR BOUNDS FOR THE METHODS OF GLIMM, GODUNOV AND LEVEQUE BRADLEY J. LUCIER*
EO BOUNDS FO THE METHODS OF GLIMM, GODUNOV AND LEVEQUE BADLEY J. LUCIE* Abstract. Te expected error in L ) attimet for Glimm s sceme wen applied to a scalar conservation law is bounded by + 2 ) ) /2 T
More informationMATH745 Fall MATH745 Fall
MATH745 Fall 5 MATH745 Fall 5 INTRODUCTION WELCOME TO MATH 745 TOPICS IN NUMERICAL ANALYSIS Instructor: Dr Bartosz Protas Department of Matematics & Statistics Email: bprotas@mcmasterca Office HH 36, Ext
More informationLecture 15. Interpolation II. 2 Piecewise polynomial interpolation Hermite splines
Lecture 5 Interpolation II Introduction In te previous lecture we focused primarily on polynomial interpolation of a set of n points. A difficulty we observed is tat wen n is large, our polynomial as to
More informationContinuity and Differentiability of the Trigonometric Functions
[Te basis for te following work will be te definition of te trigonometric functions as ratios of te sides of a triangle inscribed in a circle; in particular, te sine of an angle will be defined to be te
More informationChapter 2 Limits and Continuity
4 Section. Capter Limits and Continuity Section. Rates of Cange and Limits (pp. 6) Quick Review.. f () ( ) () 4 0. f () 4( ) 4. f () sin sin 0 4. f (). 4 4 4 6. c c c 7. 8. c d d c d d c d c 9. 8 ( )(
More informationMath 161 (33) - Final exam
Name: Id #: Mat 161 (33) - Final exam Fall Quarter 2015 Wednesday December 9, 2015-10:30am to 12:30am Instructions: Prob. Points Score possible 1 25 2 25 3 25 4 25 TOTAL 75 (BEST 3) Read eac problem carefully.
More informationMA455 Manifolds Solutions 1 May 2008
MA455 Manifolds Solutions 1 May 2008 1. (i) Given real numbers a < b, find a diffeomorpism (a, b) R. Solution: For example first map (a, b) to (0, π/2) and ten map (0, π/2) diffeomorpically to R using
More informationJournal of Computational and Applied Mathematics
Journal of Computational and Applied Matematics 94 (6) 75 96 Contents lists available at ScienceDirect Journal of Computational and Applied Matematics journal omepage: www.elsevier.com/locate/cam Smootness-Increasing
More informationContinuity. Example 1
Continuity MATH 1003 Calculus and Linear Algebra (Lecture 13.5) Maoseng Xiong Department of Matematics, HKUST A function f : (a, b) R is continuous at a point c (a, b) if 1. x c f (x) exists, 2. f (c)
More informationDifferentiation in higher dimensions
Capter 2 Differentiation in iger dimensions 2.1 Te Total Derivative Recall tat if f : R R is a 1-variable function, and a R, we say tat f is differentiable at x = a if and only if te ratio f(a+) f(a) tends
More informationPoisson Equation in Sobolev Spaces
Poisson Equation in Sobolev Spaces OcMountain Dayligt Time. 6, 011 Today we discuss te Poisson equation in Sobolev spaces. It s existence, uniqueness, and regularity. Weak Solution. u = f in, u = g on
More informationPolynomial Interpolation
Capter 4 Polynomial Interpolation In tis capter, we consider te important problem of approximating a function f(x, wose values at a set of distinct points x, x, x 2,,x n are known, by a polynomial P (x
More informationSemigroups of Operators
Lecture 11 Semigroups of Operators In tis Lecture we gater a few notions on one-parameter semigroups of linear operators, confining to te essential tools tat are needed in te sequel. As usual, X is a real
More informationDerivatives of Exponentials
mat 0 more on derivatives: day 0 Derivatives of Eponentials Recall tat DEFINITION... An eponential function as te form f () =a, were te base is a real number a > 0. Te domain of an eponential function
More informationSymmetry Labeling of Molecular Energies
Capter 7. Symmetry Labeling of Molecular Energies Notes: Most of te material presented in tis capter is taken from Bunker and Jensen 1998, Cap. 6, and Bunker and Jensen 2005, Cap. 7. 7.1 Hamiltonian Symmetry
More informationPreconditioning in H(div) and Applications
1 Preconditioning in H(div) and Applications Douglas N. Arnold 1, Ricard S. Falk 2 and Ragnar Winter 3 4 Abstract. Summarizing te work of [AFW97], we sow ow to construct preconditioners using domain decomposition
More informationContinuity and Differentiability Worksheet
Continuity and Differentiability Workseet (Be sure tat you can also do te grapical eercises from te tet- Tese were not included below! Typical problems are like problems -3, p. 6; -3, p. 7; 33-34, p. 7;
More informationFunction Composition and Chain Rules
Function Composition and s James K. Peterson Department of Biological Sciences and Department of Matematical Sciences Clemson University Marc 8, 2017 Outline 1 Function Composition and Continuity 2 Function
More informationOn the best approximation of function classes from values on a uniform grid in the real line
Proceedings of te 5t WSEAS Int Conf on System Science and Simulation in Engineering, Tenerife, Canary Islands, Spain, December 16-18, 006 459 On te best approximation of function classes from values on
More informationNUMERICAL DIFFERENTIATION. James T. Smith San Francisco State University. In calculus classes, you compute derivatives algebraically: for example,
NUMERICAL DIFFERENTIATION James T Smit San Francisco State University In calculus classes, you compute derivatives algebraically: for example, f( x) = x + x f ( x) = x x Tis tecnique requires your knowing
More informationThe derivative function
Roberto s Notes on Differential Calculus Capter : Definition of derivative Section Te derivative function Wat you need to know already: f is at a point on its grap and ow to compute it. Wat te derivative
More information232 Calculus and Structures
3 Calculus and Structures CHAPTER 17 JUSTIFICATION OF THE AREA AND SLOPE METHODS FOR EVALUATING BEAMS Calculus and Structures 33 Copyrigt Capter 17 JUSTIFICATION OF THE AREA AND SLOPE METHODS 17.1 THE
More informationLecture XVII. Abstract We introduce the concept of directional derivative of a scalar function and discuss its relation with the gradient operator.
Lecture XVII Abstract We introduce te concept of directional derivative of a scalar function and discuss its relation wit te gradient operator. Directional derivative and gradient Te directional derivative
More informationERROR BOUNDS FOR FINITE-DIFFERENCE METHODS FOR RUDIN OSHER FATEMI IMAGE SMOOTHING
ERROR BOUNDS FOR FINITE-DIFFERENCE METHODS FOR RUDIN OSHER FATEMI IMAGE SMOOTHING JINGYUE WANG AND BRADLEY J. LUCIER Abstract. We bound te difference between te solution to te continuous Rudin Oser Fatemi
More informationAnalytic Functions. Differentiable Functions of a Complex Variable
Analytic Functions Differentiable Functions of a Complex Variable In tis capter, we sall generalize te ideas for polynomials power series of a complex variable we developed in te previous capter to general
More informationMath 31A Discussion Notes Week 4 October 20 and October 22, 2015
Mat 3A Discussion Notes Week 4 October 20 and October 22, 205 To prepare for te first midterm, we ll spend tis week working eamples resembling te various problems you ve seen so far tis term. In tese notes
More informationHOMEWORK HELP 2 FOR MATH 151
HOMEWORK HELP 2 FOR MATH 151 Here we go; te second round of omework elp. If tere are oters you would like to see, let me know! 2.4, 43 and 44 At wat points are te functions f(x) and g(x) = xf(x)continuous,
More informationPre-Calculus Review Preemptive Strike
Pre-Calculus Review Preemptive Strike Attaced are some notes and one assignment wit tree parts. Tese are due on te day tat we start te pre-calculus review. I strongly suggest reading troug te notes torougly
More informationChapter 1. Density Estimation
Capter 1 Density Estimation Let X 1, X,..., X n be observations from a density f X x. Te aim is to use only tis data to obtain an estimate ˆf X x of f X x. Properties of f f X x x, Parametric metods f
More information3.4 Algebraic Limits. Ex 1) lim. Ex 2)
Calculus Maimus.4 Algebraic Limits At tis point, you sould be very comfortable finding its bot grapically and numerically wit te elp of your graping calculator. Now it s time to practice finding its witout
More informationConvexity and Smoothness
Capter 4 Convexity and Smootness 4.1 Strict Convexity, Smootness, and Gateaux Differentiablity Definition 4.1.1. Let X be a Banac space wit a norm denoted by. A map f : X \{0} X \{0}, f f x is called a
More informationThe Laplace equation, cylindrically or spherically symmetric case
Numerisce Metoden II, 7 4, und Übungen, 7 5 Course Notes, Summer Term 7 Some material and exercises Te Laplace equation, cylindrically or sperically symmetric case Electric and gravitational potential,
More informationChapter 2. Limits and Continuity 16( ) 16( 9) = = 001. Section 2.1 Rates of Change and Limits (pp ) Quick Review 2.1
Capter Limits and Continuity Section. Rates of Cange and Limits (pp. 969) Quick Review..... f ( ) ( ) ( ) 0 ( ) f ( ) f ( ) sin π sin π 0 f ( ). < < < 6. < c c < < c 7. < < < < < 8. 9. 0. c < d d < c
More informationHow to Find the Derivative of a Function: Calculus 1
Introduction How to Find te Derivative of a Function: Calculus 1 Calculus is not an easy matematics course Te fact tat you ave enrolled in suc a difficult subject indicates tat you are interested in te
More information1 Calculus. 1.1 Gradients and the Derivative. Q f(x+h) f(x)
Calculus. Gradients and te Derivative Q f(x+) δy P T δx R f(x) 0 x x+ Let P (x, f(x)) and Q(x+, f(x+)) denote two points on te curve of te function y = f(x) and let R denote te point of intersection of
More informationRecall from our discussion of continuity in lecture a function is continuous at a point x = a if and only if
Computational Aspects of its. Keeping te simple simple. Recall by elementary functions we mean :Polynomials (including linear and quadratic equations) Eponentials Logaritms Trig Functions Rational Functions
More informationStationary Gaussian Markov Processes As Limits of Stationary Autoregressive Time Series
Stationary Gaussian Markov Processes As Limits of Stationary Autoregressive Time Series Lawrence D. Brown, Pilip A. Ernst, Larry Sepp, and Robert Wolpert August 27, 2015 Abstract We consider te class,
More informationA h u h = f h. 4.1 The CoarseGrid SystemandtheResidual Equation
Capter Grid Transfer Remark. Contents of tis capter. Consider a grid wit grid size and te corresponding linear system of equations A u = f. Te summary given in Section 3. leads to te idea tat tere migt
More informationDifferent Approaches to a Posteriori Error Analysis of the Discontinuous Galerkin Method
WDS'10 Proceedings of Contributed Papers, Part I, 151 156, 2010. ISBN 978-80-7378-139-2 MATFYZPRESS Different Approaces to a Posteriori Error Analysis of te Discontinuous Galerkin Metod I. Šebestová Carles
More informationarxiv: v1 [math.na] 28 Apr 2017
THE SCOTT-VOGELIUS FINITE ELEMENTS REVISITED JOHNNY GUZMÁN AND L RIDGWAY SCOTT arxiv:170500020v1 [matna] 28 Apr 2017 Abstract We prove tat te Scott-Vogelius finite elements are inf-sup stable on sape-regular
More informationA CLASS OF EVEN DEGREE SPLINES OBTAINED THROUGH A MINIMUM CONDITION
STUDIA UNIV. BABEŞ BOLYAI, MATHEMATICA, Volume XLVIII, Number 3, September 2003 A CLASS OF EVEN DEGREE SPLINES OBTAINED THROUGH A MINIMUM CONDITION GH. MICULA, E. SANTI, AND M. G. CIMORONI Dedicated to
More information3.4 Worksheet: Proof of the Chain Rule NAME
Mat 1170 3.4 Workseet: Proof of te Cain Rule NAME Te Cain Rule So far we are able to differentiate all types of functions. For example: polynomials, rational, root, and trigonometric functions. We are
More informationarxiv:math/ v1 [math.ca] 1 Oct 2003
arxiv:mat/0310017v1 [mat.ca] 1 Oct 2003 Cange of Variable for Multi-dimensional Integral 4 Marc 2003 Isidore Fleiscer Abstract Te cange of variable teorem is proved under te sole ypotesis of differentiability
More informationGlobal Existence of Classical Solutions for a Class Nonlinear Parabolic Equations
Global Journal of Science Frontier Researc Matematics and Decision Sciences Volume 12 Issue 8 Version 1.0 Type : Double Blind Peer Reviewed International Researc Journal Publiser: Global Journals Inc.
More informationA SHORT INTRODUCTION TO BANACH LATTICES AND
CHAPTER A SHORT INTRODUCTION TO BANACH LATTICES AND POSITIVE OPERATORS In tis capter we give a brief introduction to Banac lattices and positive operators. Most results of tis capter can be found, e.g.,
More informationSection 3.1: Derivatives of Polynomials and Exponential Functions
Section 3.1: Derivatives of Polynomials and Exponential Functions In previous sections we developed te concept of te derivative and derivative function. Te only issue wit our definition owever is tat it
More informationMass Lumping for Constant Density Acoustics
Lumping 1 Mass Lumping for Constant Density Acoustics William W. Symes ABSTRACT Mass lumping provides an avenue for efficient time-stepping of time-dependent problems wit conforming finite element spatial
More informationAn approximation method using approximate approximations
Applicable Analysis: An International Journal Vol. 00, No. 00, September 2005, 1 13 An approximation metod using approximate approximations FRANK MÜLLER and WERNER VARNHORN, University of Kassel, Germany,
More informationFINITE DIFFERENCE APPROXIMATIONS FOR NONLINEAR FIRST ORDER PARTIAL DIFFERENTIAL EQUATIONS
UNIVERSITATIS IAGELLONICAE ACTA MATHEMATICA, FASCICULUS XL 2002 FINITE DIFFERENCE APPROXIMATIONS FOR NONLINEAR FIRST ORDER PARTIAL DIFFERENTIAL EQUATIONS by Anna Baranowska Zdzis law Kamont Abstract. Classical
More informationUniversity Mathematics 2
University Matematics 2 1 Differentiability In tis section, we discuss te differentiability of functions. Definition 1.1 Differentiable function). Let f) be a function. We say tat f is differentiable at
More informationSolutions to the Multivariable Calculus and Linear Algebra problems on the Comprehensive Examination of January 31, 2014
Solutions to te Multivariable Calculus and Linear Algebra problems on te Compreensive Examination of January 3, 24 Tere are 9 problems ( points eac, totaling 9 points) on tis portion of te examination.
More informationOSCILLATION OF SOLUTIONS TO NON-LINEAR DIFFERENCE EQUATIONS WITH SEVERAL ADVANCED ARGUMENTS. Sandra Pinelas and Julio G. Dix
Opuscula Mat. 37, no. 6 (2017), 887 898 ttp://dx.doi.org/10.7494/opmat.2017.37.6.887 Opuscula Matematica OSCILLATION OF SOLUTIONS TO NON-LINEAR DIFFERENCE EQUATIONS WITH SEVERAL ADVANCED ARGUMENTS Sandra
More informationLECTURE 14 NUMERICAL INTEGRATION. Find
LECTURE 14 NUMERCAL NTEGRATON Find b a fxdx or b a vx ux fx ydy dx Often integration is required. However te form of fx may be suc tat analytical integration would be very difficult or impossible. Use
More informationStability properties of a family of chock capturing methods for hyperbolic conservation laws
Proceedings of te 3rd IASME/WSEAS Int. Conf. on FLUID DYNAMICS & AERODYNAMICS, Corfu, Greece, August 0-, 005 (pp48-5) Stability properties of a family of cock capturing metods for yperbolic conservation
More informationOn convexity of polynomial paths and generalized majorizations
On convexity of polynomial pats and generalized majorizations Marija Dodig Centro de Estruturas Lineares e Combinatórias, CELC, Universidade de Lisboa, Av. Prof. Gama Pinto 2, 1649-003 Lisboa, Portugal
More informationIEOR 165 Lecture 10 Distribution Estimation
IEOR 165 Lecture 10 Distribution Estimation 1 Motivating Problem Consider a situation were we ave iid data x i from some unknown distribution. One problem of interest is estimating te distribution tat
More informationConsider a function f we ll specify which assumptions we need to make about it in a minute. Let us reformulate the integral. 1 f(x) dx.
Capter 2 Integrals as sums and derivatives as differences We now switc to te simplest metods for integrating or differentiating a function from its function samples. A careful study of Taylor expansions
More information158 Calculus and Structures
58 Calculus and Structures CHAPTER PROPERTIES OF DERIVATIVES AND DIFFERENTIATION BY THE EASY WAY. Calculus and Structures 59 Copyrigt Capter PROPERTIES OF DERIVATIVES. INTRODUCTION In te last capter you
More informationAN ANALYSIS OF NEW FINITE ELEMENT SPACES FOR MAXWELL S EQUATIONS
Journal of Matematical Sciences: Advances and Applications Volume 5 8 Pages -9 Available at ttp://scientificadvances.co.in DOI: ttp://d.doi.org/.864/jmsaa_7975 AN ANALYSIS OF NEW FINITE ELEMENT SPACES
More information1 Lecture 13: The derivative as a function.
1 Lecture 13: Te erivative as a function. 1.1 Outline Definition of te erivative as a function. efinitions of ifferentiability. Power rule, erivative te exponential function Derivative of a sum an a multiple
More informationRobotic manipulation project
Robotic manipulation project Bin Nguyen December 5, 2006 Abstract Tis is te draft report for Robotic Manipulation s class project. Te cosen project aims to understand and implement Kevin Egan s non-convex
More informationBasic Nonparametric Estimation Spring 2002
Basic Nonparametric Estimation Spring 2002 Te following topics are covered today: Basic Nonparametric Regression. Tere are four books tat you can find reference: Silverman986, Wand and Jones995, Hardle990,
More informationHomework 1 Due: Wednesday, September 28, 2016
0-704 Information Processing and Learning Fall 06 Homework Due: Wednesday, September 8, 06 Notes: For positive integers k, [k] := {,..., k} denotes te set of te first k positive integers. Wen p and Y q
More informationClick here to see an animation of the derivative
Differentiation Massoud Malek Derivative Te concept of derivative is at te core of Calculus; It is a very powerful tool for understanding te beavior of matematical functions. It allows us to optimize functions,
More informationNotes on Multigrid Methods
Notes on Multigrid Metods Qingai Zang April, 17 Motivation of multigrids. Te convergence rates of classical iterative metod depend on te grid spacing, or problem size. In contrast, convergence rates of
More informationRecent Progress in the Integration of Poisson Systems via the Mid Point Rule and Runge Kutta Algorithm
Recent Progress in te Integration of Poisson Systems via te Mid Point Rule and Runge Kutta Algoritm Klaus Bucner, Mircea Craioveanu and Mircea Puta Abstract Some recent progress in te integration of Poisson
More informationREVIEW LAB ANSWER KEY
REVIEW LAB ANSWER KEY. Witout using SN, find te derivative of eac of te following (you do not need to simplify your answers): a. f x 3x 3 5x x 6 f x 3 3x 5 x 0 b. g x 4 x x x notice te trick ere! x x g
More informationEfficient algorithms for for clone items detection
Efficient algoritms for for clone items detection Raoul Medina, Caroline Noyer, and Olivier Raynaud Raoul Medina, Caroline Noyer and Olivier Raynaud LIMOS - Université Blaise Pascal, Campus universitaire
More information3.1 Extreme Values of a Function
.1 Etreme Values of a Function Section.1 Notes Page 1 One application of te derivative is finding minimum and maimum values off a grap. In precalculus we were only able to do tis wit quadratics by find
More information2.3 Algebraic approach to limits
CHAPTER 2. LIMITS 32 2.3 Algebraic approac to its Now we start to learn ow to find its algebraically. Tis starts wit te simplest possible its, and ten builds tese up to more complicated examples. Fact.
More informationMore on generalized inverses of partitioned matrices with Banachiewicz-Schur forms
More on generalized inverses of partitioned matrices wit anaciewicz-scur forms Yongge Tian a,, Yosio Takane b a Cina Economics and Management cademy, Central University of Finance and Economics, eijing,
More informationMath 102 TEST CHAPTERS 3 & 4 Solutions & Comments Fall 2006
Mat 102 TEST CHAPTERS 3 & 4 Solutions & Comments Fall 2006 f(x+) f(x) 10 1. For f(x) = x 2 + 2x 5, find ))))))))) and simplify completely. NOTE: **f(x+) is NOT f(x)+! f(x+) f(x) (x+) 2 + 2(x+) 5 ( x 2
More informationLIMITS AND DERIVATIVES CONDITIONS FOR THE EXISTENCE OF A LIMIT
LIMITS AND DERIVATIVES Te limit of a function is defined as te value of y tat te curve approaces, as x approaces a particular value. Te limit of f (x) as x approaces a is written as f (x) approaces, as
More informationTHE DISCRETE PLATEAU PROBLEM: CONVERGENCE RESULTS
MATHEMATICS OF COMPUTATION Volume 00, Number 0, Pages 000 000 S 0025-5718XX0000-0 THE DISCRETE PLATEAU PROBLEM: CONVERGENCE RESULTS GERHARD DZIUK AND JOHN E. HUTCHINSON Abstract. We solve te problem of
More informationSome Error Estimates for the Finite Volume Element Method for a Parabolic Problem
Computational Metods in Applied Matematics Vol. 13 (213), No. 3, pp. 251 279 c 213 Institute of Matematics, NAS of Belarus Doi: 1.1515/cmam-212-6 Some Error Estimates for te Finite Volume Element Metod
More informationBlanca Bujanda, Juan Carlos Jorge NEW EFFICIENT TIME INTEGRATORS FOR NON-LINEAR PARABOLIC PROBLEMS
Opuscula Matematica Vol. 26 No. 3 26 Blanca Bujanda, Juan Carlos Jorge NEW EFFICIENT TIME INTEGRATORS FOR NON-LINEAR PARABOLIC PROBLEMS Abstract. In tis work a new numerical metod is constructed for time-integrating
More informationCS522 - Partial Di erential Equations
CS5 - Partial Di erential Equations Tibor Jánosi April 5, 5 Numerical Di erentiation In principle, di erentiation is a simple operation. Indeed, given a function speci ed as a closed-form formula, its
More informationExercises for numerical differentiation. Øyvind Ryan
Exercises for numerical differentiation Øyvind Ryan February 25, 2013 1. Mark eac of te following statements as true or false. a. Wen we use te approximation f (a) (f (a +) f (a))/ on a computer, we can
More informationA posteriori error estimates for non-linear parabolic equations
A posteriori error estimates for non-linear parabolic equations R Verfürt Fakultät für Matematik, Rur-Universität Bocum, D-4478 Bocum, Germany E-mail address: rv@num1rur-uni-bocumde Date: December 24 Summary:
More information4. The slope of the line 2x 7y = 8 is (a) 2/7 (b) 7/2 (c) 2 (d) 2/7 (e) None of these.
Mat 11. Test Form N Fall 016 Name. Instructions. Te first eleven problems are wort points eac. Te last six problems are wort 5 points eac. For te last six problems, you must use relevant metods of algebra
More informationStrongly continuous semigroups
Capter 2 Strongly continuous semigroups Te main application of te teory developed in tis capter is related to PDE systems. Tese systems can provide te strong continuity properties only. 2.1 Closed operators
More informationSuperconvergence of energy-conserving discontinuous Galerkin methods for. linear hyperbolic equations. Abstract
Superconvergence of energy-conserving discontinuous Galerkin metods for linear yperbolic equations Yong Liu, Ci-Wang Su and Mengping Zang 3 Abstract In tis paper, we study superconvergence properties of
More information1. Questions (a) through (e) refer to the graph of the function f given below. (A) 0 (B) 1 (C) 2 (D) 4 (E) does not exist
Mat 1120 Calculus Test 2. October 18, 2001 Your name Te multiple coice problems count 4 points eac. In te multiple coice section, circle te correct coice (or coices). You must sow your work on te oter
More informationSome Review Problems for First Midterm Mathematics 1300, Calculus 1
Some Review Problems for First Midterm Matematics 00, Calculus. Consider te trigonometric function f(t) wose grap is sown below. Write down a possible formula for f(t). Tis function appears to be an odd,
More informationSECTION 3.2: DERIVATIVE FUNCTIONS and DIFFERENTIABILITY
(Section 3.2: Derivative Functions and Differentiability) 3.2.1 SECTION 3.2: DERIVATIVE FUNCTIONS and DIFFERENTIABILITY LEARNING OBJECTIVES Know, understand, and apply te Limit Definition of te Derivative
More informationParameter Fitted Scheme for Singularly Perturbed Delay Differential Equations
International Journal of Applied Science and Engineering 2013. 11, 4: 361-373 Parameter Fitted Sceme for Singularly Perturbed Delay Differential Equations Awoke Andargiea* and Y. N. Reddyb a b Department
More informationSection 2.7 Derivatives and Rates of Change Part II Section 2.8 The Derivative as a Function. at the point a, to be. = at time t = a is
Mat 180 www.timetodare.com Section.7 Derivatives and Rates of Cange Part II Section.8 Te Derivative as a Function Derivatives ( ) In te previous section we defined te slope of te tangent to a curve wit
More information2.11 That s So Derivative
2.11 Tat s So Derivative Introduction to Differential Calculus Just as one defines instantaneous velocity in terms of average velocity, we now define te instantaneous rate of cange of a function at a point
More informationCubic Functions: Local Analysis
Cubic function cubing coefficient Capter 13 Cubic Functions: Local Analysis Input-Output Pairs, 378 Normalized Input-Output Rule, 380 Local I-O Rule Near, 382 Local Grap Near, 384 Types of Local Graps
More informationMVT and Rolle s Theorem
AP Calculus CHAPTER 4 WORKSHEET APPLICATIONS OF DIFFERENTIATION MVT and Rolle s Teorem Name Seat # Date UNLESS INDICATED, DO NOT USE YOUR CALCULATOR FOR ANY OF THESE QUESTIONS In problems 1 and, state
More informationConvexity and Smoothness
Capter 4 Convexity and Smootness 4. Strict Convexity, Smootness, and Gateaux Di erentiablity Definition 4... Let X be a Banac space wit a norm denoted by k k. A map f : X \{0}!X \{0}, f 7! f x is called
More informationGELFAND S PROOF OF WIENER S THEOREM
GELFAND S PROOF OF WIENER S THEOREM S. H. KULKARNI 1. Introduction Te following teorem was proved by te famous matematician Norbert Wiener. Wiener s proof can be found in is book [5]. Teorem 1.1. (Wiener
More informationReflection Symmetries of q-bernoulli Polynomials
Journal of Nonlinear Matematical Pysics Volume 1, Supplement 1 005, 41 4 Birtday Issue Reflection Symmetries of q-bernoulli Polynomials Boris A KUPERSHMIDT Te University of Tennessee Space Institute Tullaoma,
More informationPolynomials 3: Powers of x 0 + h
near small binomial Capter 17 Polynomials 3: Powers of + Wile it is easy to compute wit powers of a counting-numerator, it is a lot more difficult to compute wit powers of a decimal-numerator. EXAMPLE
More information1. Introduction. We consider the model problem: seeking an unknown function u satisfying
A DISCONTINUOUS LEAST-SQUARES FINITE ELEMENT METHOD FOR SECOND ORDER ELLIPTIC EQUATIONS XIU YE AND SHANGYOU ZHANG Abstract In tis paper, a discontinuous least-squares (DLS) finite element metod is introduced
More information