NADARAYA WATSON ESTIMATE JAN 10, 2006: version 2. Y ik ( x i
|
|
- Aileen Heath
- 6 years ago
- Views:
Transcription
1 NADARAYA WATSON ESTIMATE JAN 0, 2006: version 2 DATA: (x i, Y i, i =,..., n. ESTIMATE E(Y x = m(x by n i= ˆm (x = Y ik ( x i x n i= K ( x i x EXAMPLES OF K: K(u = I{ u c} (uniform or box kernel K(u = u 2 if u, 0 else (Epanecnikov kernel K(u = exp( u 2 /(2σ 2 (normal kernel?? Does K need to integrate to???? Does K need to be positive?? Nadaraya (964, Teory of Probability and its Applications Watson (964 Sankya series A COMMENT: tis estimator as fallen out of favour, replaced by local polynomial estimators. But it s wort studying - easier asymptotics. 0-0
2 IN R, ksmoot produces te Nadaraya Watson estimate. Usage: ksmoot(x, y, kernel = c("box", "normal", bandwidt = 0.5, range.x = range(x, n.points = max(00, lengt(x, x.points Arguments: x: input x values y: input y values kernel: te kernel to be used. bandwidt: te bandwidt. Te kernels are scaled so tat teir quartiles (viewed as probability densities are at +/- 0.25*bandwidt. range.x:te range of points to be covered in te output. n.points:te number of points at wic to evaluate te fit. x.points:points at wic to evaluate te smooted fit. If missing, n.points are cosen uniformly to cover range.x. 0-
3 ?? For te uniform kernel, wat value of c is ksmoot using?? HOMEWORK: Jan 0 #: For te normal kernel, wat value of σ 2 is ksmoot using? EXAMPLES IN R (see R.txt ksmoot wit normal kernel simulation study to look at bias and variance effect of sample size 0-2
4 IN SMOOTHING WE STUDY (conditional on te x i s: Bias( ˆm (x =E( ˆm (x m(x Var( ˆm (x MSE( ˆm (x = E[ ˆm (x m(x] 2 = Bias 2 + Var IMSE( ˆm = MSE( ˆm (x dx WHY? to understand ˆm and te effect of to derive an asymptotic formula for MSE and IMSE for plug-in estimates of. ASYMPTOTICS INVOLVE smootness assumptions on m conditions on te x i s n, n 0 but not too fast properties of K THESE IDEAS ARE COMMON TO MANY/ALL smooting metods 0-3
5 ASYMPTOTIC RESULTS For rigorous presentation, see te posted notes. THROUGHOUT ASSUME THAT: Y i = m(x i + ɛ i, ɛ i iid mean 0 variance σ 2. te x i s live on [a, b], a finite interval. eiter: te x i s are realizations of iid random variables wit density f OR te x i s ave a regular design density f, tat is x i f(t dt = i/(n+. a In bot cases, f must be bounded and bounded away from 0 on [a, b]. K(u = 0 for u > (can be relaxed to include normal density and K is Lipsitz ( K(x K(u < C x u for some C. 0-4
6 MOST COMMON AND SIMPLEST CASE: and just for fixed design (random X i s is similar. In addition to previous assumptions, suppose tat K: u K(u du = 0, u 2 K(u du 0 m and f exist and are continuous on [a, b] n, = n 0, n 4 n THEN for interior x [a + n, b n ] E( ˆm (x m(x = 2 (mf (x m(xf (x 2f(x and var( ˆm (x = = 2 (mf (x m(xf (x 2f(x = σ 2 nf(x σ 2 nf(x 0-5 u 2 K(u du K(u du + o( 2 ν 2 (K ν 0 (K + o(2 K 2 ( (u du ( 2 + o K(u du n ν 0 (K 2 ( (ν 0 (K 2 + o n (
7 For boundary x, tat is, x [a, a + n or (b n, b], E( ˆm (x m(x = (mf (x m(xf (x f(x ν (K, x, ν 0 (K, x, + o( and var( ˆm (x = σ2 nf(x ν 0 (K 2 (, x, [ν 0 (K, x, ] 2 + o n were (b x/ ν j (K, x, = s j K(s ds. (a x/ NOTE: for x interior, ν j (K, x, = s j K(s ds ν j (K 0-6
8 MORE GENERAL CASE: by using a pt order kernel and assuming n p+2, 0 m (p and f (p exist and are continuous on [a, b]. THEN, for interior x: E( ˆm (x m(x = p (mf(p (x m(xf (p (x p!f(x and var( ˆm (x is as in (. ν p (K du ν 0 (K + o( p (2 For boundary x we still get E( ˆm (x m(x = B(x, + o( and var( ˆm (x = V (x, /(n + o(/(n. 0-7
9 A pt order kernel K satisfies ν 0 (K K(u du 0 ν j (K u j K(u du = 0, j =,, p ν p (K < and 0 COMMENT: consider x i equi-spaced and suppose y i x k i. THEN for x i not a boundary point: if K is an order 2 kernel, ŷ i x k i for k = 0, ; if K is an order 4 kernel, ŷ i x k i for k = 0,, 2, 3. etc SEE R CODE. 0-8
10 USING THE ASYMPTOTICS - equations (2 and (: For a fixed interior x, te tat minimizes MSE( ˆm(x is opt = Cn /(2p+ Tis yields asymptotic MSE of order n 2p/(2p+. For a boundary x, te tat minimizes MSE( ˆm(x is opt = C n /3 Tis yields asymptotic MSE of order n 2/3. NOTE: parametric rate of convergence is n, muc smaller/faster. 0-9
11 SOME o/o notation: DETERMINISTIC SEQUENCES Let a n, b n and c n be tree sequences of numbers. Ten a n = b n + o(c n iff a n b n = o(c n iff lim n a n b n c n = 0. a n = b n + O(c n iff a n b n = O(c n iff lim sup n a n b n c n <. RANDOM SEQUENCES Let a n, b n and c n be tree sequences, at least one of wic is random. a n = b n + o p (c n iff a n b n = o p (c n iff a n b n c n 0 in probability. a n = b n +O p (c n iff a n b n = O p (c n iff lim lim P { a n b n C} =. C n c n 0-0
12 RANDOM SEQUENCE EXAMPLES: suppose tat X i are iid E(X i = µ and var(x i = σ 2. Let X n = n X i/n, s 2 = n (X i X 2 /(n and ˆσ 2 = n (X i X 2 /n. Ten X = µ + o p ( ˆσ 2 s 2 = O p (/n DETERMINISTIC SEQUENCE EXAMPLE: Suppose tat n p+2 n. Ten = o( p n n 2 n 0-
13 FOR THE PROOF OF THE GENERAL RESULTS (2 and ( wit x i s non-random: implies ˆm (x = E[ ˆm (x] = n K ( x i x n K ( x i x Yi n m(x ik ( x i x n K ( x i x and ( n var[ ˆm (x] = σ 2 K2 x i x [ n K ( x i x ] 2 0-2
14 CONSIDER x in te interior. THEN (to be sown (n + n K ( xi x = f(xν 0 (K + f (p (xν p (K p p! + o(p (3 (n + n K 2 ( xi x f(xν 0 (K 2 (4 (n + n m(x i K ( xi x = m(xf(xν 0 (K +(mf p (xν p (K p p! + o(p (5 If tose tings are true ten, wit some work, we can sow ( and (2. 0-3
15 TO PROVE THE THREE EQUATIONS USE: LEMMA (proven in 998/99 notes. Let te x i s ave a regular design on [a, b] wit f bounded and bounded away from 0. Let g be Lipsitz on [a, b], M wit support [, ] and Lipsitz. Ten for all 0 > 0, tere exists C so tat (n + n ( xi x g(x i M for all n, x and for all wit 0. b a M ( u x g(u f(u du Te proof is tedious, but for intuition: suppose X i s are iid wit density f. Take expected value of te sum. PROOFS OF EQUATIONS: just (3 - oters are similar. C n 2 0-4
16 MORE HOMEWORK Jan 0 #2: For tis exercise, consider te normal kernel, used for te Nadaraya-Watson estimate of m. (a Find te expressions for te asymptotic bias and variance of ˆm (x. (b Find te optimal value of for estimating m(x at an interior x. (c Carry out a simulation to study ow te bias and variance of ˆm (x depend on. Use te regression data as in my simulation study. For fixed x consider te bias and variance as a function of. Do tis for x = 0, 0.2, 0.4, 0.6, 0.8,.0. Relate wat you see to te asymptotic expressions for te bias and variance in (a. PLEASE HAND IN: a write-up (word-processed or neatly and-written wit your calculations, describing wat you did in your simulation study, and wat you conclude. Include any relevant plots. Also include welldocumented easy to read code. Part of your evaluation will be on ow clearly you write tings up. 0-5
The Priestley-Chao Estimator
Te Priestley-Cao Estimator In tis section we will consider te Pristley-Cao estimator of te unknown regression function. It is assumed tat we ave a sample of observations (Y i, x i ), i = 1,..., n wic are
More informationChapter 1. Density Estimation
Capter 1 Density Estimation Let X 1, X,..., X n be observations from a density f X x. Te aim is to use only tis data to obtain an estimate ˆf X x of f X x. Properties of f f X x x, Parametric metods f
More informationFunction Composition and Chain Rules
Function Composition and s James K. Peterson Department of Biological Sciences and Department of Matematical Sciences Clemson University Marc 8, 2017 Outline 1 Function Composition and Continuity 2 Function
More informationIEOR 165 Lecture 10 Distribution Estimation
IEOR 165 Lecture 10 Distribution Estimation 1 Motivating Problem Consider a situation were we ave iid data x i from some unknown distribution. One problem of interest is estimating te distribution tat
More information7 Semiparametric Methods and Partially Linear Regression
7 Semiparametric Metods and Partially Linear Regression 7. Overview A model is called semiparametric if it is described by and were is nite-dimensional (e.g. parametric) and is in nite-dimensional (nonparametric).
More informationHOMEWORK HELP 2 FOR MATH 151
HOMEWORK HELP 2 FOR MATH 151 Here we go; te second round of omework elp. If tere are oters you would like to see, let me know! 2.4, 43 and 44 At wat points are te functions f(x) and g(x) = xf(x)continuous,
More informationWe name Functions f (x) or g(x) etc.
Section 2 1B: Function Notation Bot of te equations y 2x +1 and y 3x 2 are functions. It is common to ave two or more functions in terms of x in te same problem. If I ask you wat is te value for y if x
More informationHomework 1 Due: Wednesday, September 28, 2016
0-704 Information Processing and Learning Fall 06 Homework Due: Wednesday, September 8, 06 Notes: For positive integers k, [k] := {,..., k} denotes te set of te first k positive integers. Wen p and Y q
More informationBasic Nonparametric Estimation Spring 2002
Basic Nonparametric Estimation Spring 2002 Te following topics are covered today: Basic Nonparametric Regression. Tere are four books tat you can find reference: Silverman986, Wand and Jones995, Hardle990,
More informationLogistic Kernel Estimator and Bandwidth Selection. for Density Function
International Journal of Contemporary Matematical Sciences Vol. 13, 2018, no. 6, 279-286 HIKARI Ltd, www.m-ikari.com ttps://doi.org/10.12988/ijcms.2018.81133 Logistic Kernel Estimator and Bandwidt Selection
More informationApplications of the van Trees inequality to non-parametric estimation.
Brno-06, Lecture 2, 16.05.06 D/Stat/Brno-06/2.tex www.mast.queensu.ca/ blevit/ Applications of te van Trees inequality to non-parametric estimation. Regular non-parametric problems. As an example of suc
More informationUniform Convergence Rates for Nonparametric Estimation
Uniform Convergence Rates for Nonparametric Estimation Bruce E. Hansen University of Wisconsin www.ssc.wisc.edu/~bansen October 2004 Preliminary and Incomplete Abstract Tis paper presents a set of rate
More informationKernel Density Estimation
Kernel Density Estimation Univariate Density Estimation Suppose tat we ave a random sample of data X 1,..., X n from an unknown continuous distribution wit probability density function (pdf) f(x) and cumulative
More information4. The slope of the line 2x 7y = 8 is (a) 2/7 (b) 7/2 (c) 2 (d) 2/7 (e) None of these.
Mat 11. Test Form N Fall 016 Name. Instructions. Te first eleven problems are wort points eac. Te last six problems are wort 5 points eac. For te last six problems, you must use relevant metods of algebra
More informationPolynomial Interpolation
Capter 4 Polynomial Interpolation In tis capter, we consider te important problem of approximatinga function fx, wose values at a set of distinct points x, x, x,, x n are known, by a polynomial P x suc
More informationOrder of Accuracy. ũ h u Ch p, (1)
Order of Accuracy 1 Terminology We consider a numerical approximation of an exact value u. Te approximation depends on a small parameter, wic can be for instance te grid size or time step in a numerical
More informationDEPARTMENT MATHEMATIK SCHWERPUNKT MATHEMATISCHE STATISTIK UND STOCHASTISCHE PROZESSE
U N I V E R S I T Ä T H A M B U R G A note on residual-based empirical likeliood kernel density estimation Birte Musal and Natalie Neumeyer Preprint No. 2010-05 May 2010 DEPARTMENT MATHEMATIK SCHWERPUNKT
More informationSection 3: The Derivative Definition of the Derivative
Capter 2 Te Derivative Business Calculus 85 Section 3: Te Derivative Definition of te Derivative Returning to te tangent slope problem from te first section, let's look at te problem of finding te slope
More information(a) At what number x = a does f have a removable discontinuity? What value f(a) should be assigned to f at x = a in order to make f continuous at a?
Solutions to Test 1 Fall 016 1pt 1. Te grap of a function f(x) is sown at rigt below. Part I. State te value of eac limit. If a limit is infinite, state weter it is or. If a limit does not exist (but is
More informationMathematics 5 Worksheet 11 Geometry, Tangency, and the Derivative
Matematics 5 Workseet 11 Geometry, Tangency, and te Derivative Problem 1. Find te equation of a line wit slope m tat intersects te point (3, 9). Solution. Te equation for a line passing troug a point (x
More informationNumerical Differentiation
Numerical Differentiation Finite Difference Formulas for te first derivative (Using Taylor Expansion tecnique) (section 8.3.) Suppose tat f() = g() is a function of te variable, and tat as 0 te function
More information. If lim. x 2 x 1. f(x+h) f(x)
Review of Differential Calculus Wen te value of one variable y is uniquely determined by te value of anoter variable x, ten te relationsip between x and y is described by a function f tat assigns a value
More informationPolynomial Interpolation
Capter 4 Polynomial Interpolation In tis capter, we consider te important problem of approximating a function f(x, wose values at a set of distinct points x, x, x 2,,x n are known, by a polynomial P (x
More informationSolution. Solution. f (x) = (cos x)2 cos(2x) 2 sin(2x) 2 cos x ( sin x) (cos x) 4. f (π/4) = ( 2/2) ( 2/2) ( 2/2) ( 2/2) 4.
December 09, 20 Calculus PracticeTest s Name: (4 points) Find te absolute extrema of f(x) = x 3 0 on te interval [0, 4] Te derivative of f(x) is f (x) = 3x 2, wic is zero only at x = 0 Tus we only need
More information1 1. Rationalize the denominator and fully simplify the radical expression 3 3. Solution: = 1 = 3 3 = 2
MTH - Spring 04 Exam Review (Solutions) Exam : February 5t 6:00-7:0 Tis exam review contains questions similar to tose you sould expect to see on Exam. Te questions included in tis review, owever, are
More information2.3 Product and Quotient Rules
.3. PRODUCT AND QUOTIENT RULES 75.3 Product and Quotient Rules.3.1 Product rule Suppose tat f and g are two di erentiable functions. Ten ( g (x)) 0 = f 0 (x) g (x) + g 0 (x) See.3.5 on page 77 for a proof.
More informationLecture XVII. Abstract We introduce the concept of directional derivative of a scalar function and discuss its relation with the gradient operator.
Lecture XVII Abstract We introduce te concept of directional derivative of a scalar function and discuss its relation wit te gradient operator. Directional derivative and gradient Te directional derivative
More informationPolynomial Functions. Linear Functions. Precalculus: Linear and Quadratic Functions
Concepts: definition of polynomial functions, linear functions tree representations), transformation of y = x to get y = mx + b, quadratic functions axis of symmetry, vertex, x-intercepts), transformations
More informationFast optimal bandwidth selection for kernel density estimation
Fast optimal bandwidt selection for kernel density estimation Vikas Candrakant Raykar and Ramani Duraiswami Dept of computer science and UMIACS, University of Maryland, CollegePark {vikas,ramani}@csumdedu
More informationFinding and Using Derivative The shortcuts
Calculus 1 Lia Vas Finding and Using Derivative Te sortcuts We ave seen tat te formula f f(x+) f(x) (x) = lim 0 is manageable for relatively simple functions like a linear or quadratic. For more complex
More informationPractice Problem Solutions: Exam 1
Practice Problem Solutions: Exam 1 1. (a) Algebraic Solution: Te largest term in te numerator is 3x 2, wile te largest term in te denominator is 5x 2 3x 2 + 5. Tus lim x 5x 2 2x 3x 2 x 5x 2 = 3 5 Numerical
More informationMath 1241 Calculus Test 1
February 4, 2004 Name Te first nine problems count 6 points eac and te final seven count as marked. Tere are 120 points available on tis test. Multiple coice section. Circle te correct coice(s). You do
More informationMAT 1339-S14 Class 2
MAT 1339-S14 Class 2 July 07, 2014 Contents 1 Rate of Cange 1 1.5 Introduction to Derivatives....................... 1 2 Derivatives 5 2.1 Derivative of Polynomial function.................... 5 2.2 Te
More information3.4 Worksheet: Proof of the Chain Rule NAME
Mat 1170 3.4 Workseet: Proof of te Cain Rule NAME Te Cain Rule So far we are able to differentiate all types of functions. For example: polynomials, rational, root, and trigonometric functions. We are
More informationINFINITE ORDER CROSS-VALIDATED LOCAL POLYNOMIAL REGRESSION. 1. Introduction
INFINITE ORDER CROSS-VALIDATED LOCAL POLYNOMIAL REGRESSION PETER G. HALL AND JEFFREY S. RACINE Abstract. Many practical problems require nonparametric estimates of regression functions, and local polynomial
More informationBootstrap prediction intervals for Markov processes
arxiv: arxiv:0000.0000 Bootstrap prediction intervals for Markov processes Li Pan and Dimitris N. Politis Li Pan Department of Matematics University of California San Diego La Jolla, CA 92093-0112, USA
More informationf a h f a h h lim lim
Te Derivative Te derivative of a function f at a (denoted f a) is f a if tis it exists. An alternative way of defining f a is f a x a fa fa fx fa x a Note tat te tangent line to te grap of f at te point
More information1. Questions (a) through (e) refer to the graph of the function f given below. (A) 0 (B) 1 (C) 2 (D) 4 (E) does not exist
Mat 1120 Calculus Test 2. October 18, 2001 Your name Te multiple coice problems count 4 points eac. In te multiple coice section, circle te correct coice (or coices). You must sow your work on te oter
More informationExam 1 Review Solutions
Exam Review Solutions Please also review te old quizzes, and be sure tat you understand te omework problems. General notes: () Always give an algebraic reason for your answer (graps are not sufficient),
More informationFunction Composition and Chain Rules
Function Composition an Cain Rules James K. Peterson Department of Biological Sciences an Department of Matematical Sciences Clemson University November 2, 2018 Outline Function Composition an Continuity
More informationMath 102 TEST CHAPTERS 3 & 4 Solutions & Comments Fall 2006
Mat 102 TEST CHAPTERS 3 & 4 Solutions & Comments Fall 2006 f(x+) f(x) 10 1. For f(x) = x 2 + 2x 5, find ))))))))) and simplify completely. NOTE: **f(x+) is NOT f(x)+! f(x+) f(x) (x+) 2 + 2(x+) 5 ( x 2
More informationSTAT Homework X - Solutions
STAT-36700 Homework X - Solutions Fall 201 November 12, 201 Tis contains solutions for Homework 4. Please note tat we ave included several additional comments and approaces to te problems to give you better
More informationConsider a function f we ll specify which assumptions we need to make about it in a minute. Let us reformulate the integral. 1 f(x) dx.
Capter 2 Integrals as sums and derivatives as differences We now switc to te simplest metods for integrating or differentiating a function from its function samples. A careful study of Taylor expansions
More informationThe Derivative as a Function
Section 2.2 Te Derivative as a Function 200 Kiryl Tsiscanka Te Derivative as a Function DEFINITION: Te derivative of a function f at a number a, denoted by f (a), is if tis limit exists. f (a) f(a + )
More informationPreface. Here are a couple of warnings to my students who may be here to get a copy of what happened on a day that you missed.
Preface Here are my online notes for my course tat I teac ere at Lamar University. Despite te fact tat tese are my class notes, tey sould be accessible to anyone wanting to learn or needing a refreser
More informationBootstrap confidence intervals in nonparametric regression without an additive model
Bootstrap confidence intervals in nonparametric regression witout an additive model Dimitris N. Politis Abstract Te problem of confidence interval construction in nonparametric regression via te bootstrap
More information4.2 - Richardson Extrapolation
. - Ricardson Extrapolation. Small-O Notation: Recall tat te big-o notation used to define te rate of convergence in Section.: Definition Let x n n converge to a number x. Suppose tat n n is a sequence
More informationBandwidth Selection in Nonparametric Kernel Testing
Te University of Adelaide Scool of Economics Researc Paper No. 2009-0 January 2009 Bandwidt Selection in Nonparametric ernel Testing Jiti Gao and Irene Gijbels Bandwidt Selection in Nonparametric ernel
More informationHazard Rate Function Estimation Using Erlang Kernel
Pure Matematical Sciences, Vol. 3, 04, no. 4, 4-5 HIKARI Ltd, www.m-ikari.com ttp://dx.doi.org/0.988/pms.04.466 Hazard Rate Function Estimation Using Erlang Kernel Raid B. Sala Department of Matematics
More informationMath 212-Lecture 9. For a single-variable function z = f(x), the derivative is f (x) = lim h 0
3.4: Partial Derivatives Definition Mat 22-Lecture 9 For a single-variable function z = f(x), te derivative is f (x) = lim 0 f(x+) f(x). For a function z = f(x, y) of two variables, to define te derivatives,
More informationSolutions to the Multivariable Calculus and Linear Algebra problems on the Comprehensive Examination of January 31, 2014
Solutions to te Multivariable Calculus and Linear Algebra problems on te Compreensive Examination of January 3, 24 Tere are 9 problems ( points eac, totaling 9 points) on tis portion of te examination.
More informationKernel Density Based Linear Regression Estimate
Kernel Density Based Linear Regression Estimate Weixin Yao and Zibiao Zao Abstract For linear regression models wit non-normally distributed errors, te least squares estimate (LSE will lose some efficiency
More informationArtificial Neural Network Model Based Estimation of Finite Population Total
International Journal of Science and Researc (IJSR), India Online ISSN: 2319-7064 Artificial Neural Network Model Based Estimation of Finite Population Total Robert Kasisi 1, Romanus O. Odiambo 2, Antony
More informationMVT and Rolle s Theorem
AP Calculus CHAPTER 4 WORKSHEET APPLICATIONS OF DIFFERENTIATION MVT and Rolle s Teorem Name Seat # Date UNLESS INDICATED, DO NOT USE YOUR CALCULATOR FOR ANY OF THESE QUESTIONS In problems 1 and, state
More information2.3 Algebraic approach to limits
CHAPTER 2. LIMITS 32 2.3 Algebraic approac to its Now we start to learn ow to find its algebraically. Tis starts wit te simplest possible its, and ten builds tese up to more complicated examples. Fact.
More information(4.2) -Richardson Extrapolation
(.) -Ricardson Extrapolation. Small-O Notation: Recall tat te big-o notation used to define te rate of convergence in Section.: Suppose tat lim G 0 and lim F L. Te function F is said to converge to L as
More informationDifferentiation in higher dimensions
Capter 2 Differentiation in iger dimensions 2.1 Te Total Derivative Recall tat if f : R R is a 1-variable function, and a R, we say tat f is differentiable at x = a if and only if te ratio f(a+) f(a) tends
More informationLesson 6: The Derivative
Lesson 6: Te Derivative Def. A difference quotient for a function as te form f(x + ) f(x) (x + ) x f(x + x) f(x) (x + x) x f(a + ) f(a) (a + ) a Notice tat a difference quotient always as te form of cange
More informationDensity estimation Nonparametric conditional mean estimation Semiparametric conditional mean estimation. Nonparametrics. Gabriel Montes-Rojas
0 0 5 Motivation: Regression discontinuity (Angrist&Pischke) Outcome.5 1 1.5 A. Linear E[Y 0i X i] 0.2.4.6.8 1 X Outcome.5 1 1.5 B. Nonlinear E[Y 0i X i] i 0.2.4.6.8 1 X utcome.5 1 1.5 C. Nonlinearity
More informationLecture 15. Interpolation II. 2 Piecewise polynomial interpolation Hermite splines
Lecture 5 Interpolation II Introduction In te previous lecture we focused primarily on polynomial interpolation of a set of n points. A difficulty we observed is tat wen n is large, our polynomial as to
More informationGradient Descent etc.
1 Gradient Descent etc EE 13: Networked estimation and control Prof Kan) I DERIVATIVE Consider f : R R x fx) Te derivative is defined as d fx) = lim dx fx + ) fx) Te cain rule states tat if d d f gx) )
More informationDifferential Calculus (The basics) Prepared by Mr. C. Hull
Differential Calculus Te basics) A : Limits In tis work on limits, we will deal only wit functions i.e. tose relationsips in wic an input variable ) defines a unique output variable y). Wen we work wit
More information1 (10) 2 (10) 3 (10) 4 (10) 5 (10) 6 (10) Total (60)
First Name: OSU Number: Last Name: Signature: OKLAHOMA STATE UNIVERSITY Department of Matematics MATH 2144 (Calculus I) Instructor: Dr. Matias Sculze MIDTERM 1 September 17, 2008 Duration: 50 minutes No
More informationPoisson Equation in Sobolev Spaces
Poisson Equation in Sobolev Spaces OcMountain Dayligt Time. 6, 011 Today we discuss te Poisson equation in Sobolev spaces. It s existence, uniqueness, and regularity. Weak Solution. u = f in, u = g on
More informationNonparametric estimation of the average growth curve with general nonstationary error process
Nonparametric estimation of te average growt curve wit general nonstationary error process Karim Benenni, Mustapa Racdi To cite tis version: Karim Benenni, Mustapa Racdi. Nonparametric estimation of te
More informationThe Derivative The rate of change
Calculus Lia Vas Te Derivative Te rate of cange Knowing and understanding te concept of derivative will enable you to answer te following questions. Let us consider a quantity wose size is described by
More informationA = h w (1) Error Analysis Physics 141
Introduction In all brances of pysical science and engineering one deals constantly wit numbers wic results more or less directly from experimental observations. Experimental observations always ave inaccuracies.
More informationTHE IDEA OF DIFFERENTIABILITY FOR FUNCTIONS OF SEVERAL VARIABLES Math 225
THE IDEA OF DIFFERENTIABILITY FOR FUNCTIONS OF SEVERAL VARIABLES Mat 225 As we ave seen, te definition of derivative for a Mat 111 function g : R R and for acurveγ : R E n are te same, except for interpretation:
More informationSection 2: The Derivative Definition of the Derivative
Capter 2 Te Derivative Applied Calculus 80 Section 2: Te Derivative Definition of te Derivative Suppose we drop a tomato from te top of a 00 foot building and time its fall. Time (sec) Heigt (ft) 0.0 00
More informationUNIVERSITY OF MANITOBA DEPARTMENT OF MATHEMATICS MATH 1510 Applied Calculus I FIRST TERM EXAMINATION - Version A October 12, :30 am
DEPARTMENT OF MATHEMATICS MATH 1510 Applied Calculus I October 12, 2016 8:30 am LAST NAME: FIRST NAME: STUDENT NUMBER: SIGNATURE: (I understand tat ceating is a serious offense DO NOT WRITE IN THIS TABLE
More informationWYSE Academic Challenge 2004 Sectional Mathematics Solution Set
WYSE Academic Callenge 00 Sectional Matematics Solution Set. Answer: B. Since te equation can be written in te form x + y, we ave a major 5 semi-axis of lengt 5 and minor semi-axis of lengt. Tis means
More informationCombining functions: algebraic methods
Combining functions: algebraic metods Functions can be added, subtracted, multiplied, divided, and raised to a power, just like numbers or algebra expressions. If f(x) = x 2 and g(x) = x + 2, clearly f(x)
More informationExponential and logarithmic functions (pp ) () Supplement October 14, / 1. a and b positive real numbers and x and y real numbers.
MA123, Supplement Exponential and logaritmic functions pp. 315-319) Capter s Goal: Review te properties of exponential and logaritmic functions. Learn ow to differentiate exponential and logaritmic functions.
More informationPrecalculus Test 2 Practice Questions Page 1. Note: You can expect other types of questions on the test than the ones presented here!
Precalculus Test 2 Practice Questions Page Note: You can expect oter types of questions on te test tan te ones presented ere! Questions Example. Find te vertex of te quadratic f(x) = 4x 2 x. Example 2.
More informationTime (hours) Morphine sulfate (mg)
Mat Xa Fall 2002 Review Notes Limits and Definition of Derivative Important Information: 1 According to te most recent information from te Registrar, te Xa final exam will be eld from 9:15 am to 12:15
More informationBoosting local quasi-likelihood estimators
Ann Inst Stat Mat (00) 6:5 48 DOI 0.007/s046-008-07-5 Boosting local quasi-likeliood estimators Masao Ueki Kaoru Fueda Received: Marc 007 / Revised: 8 February 008 / Publised online: 5 April 008 Te Institute
More information1 Calculus. 1.1 Gradients and the Derivative. Q f(x+h) f(x)
Calculus. Gradients and te Derivative Q f(x+) δy P T δx R f(x) 0 x x+ Let P (x, f(x)) and Q(x+, f(x+)) denote two points on te curve of te function y = f(x) and let R denote te point of intersection of
More informationLIMITS AND DERIVATIVES CONDITIONS FOR THE EXISTENCE OF A LIMIT
LIMITS AND DERIVATIVES Te limit of a function is defined as te value of y tat te curve approaces, as x approaces a particular value. Te limit of f (x) as x approaces a is written as f (x) approaces, as
More informationDerivatives. By: OpenStaxCollege
By: OpenStaxCollege Te average teen in te United States opens a refrigerator door an estimated 25 times per day. Supposedly, tis average is up from 10 years ago wen te average teenager opened a refrigerator
More informationModelling Non-linear and Non-stationary Time Series
Modelling Non-linear and Non-stationary Time Series Chapter 2: Non-parametric methods Henrik Madsen Advanced Time Series Analysis September 206 Henrik Madsen (02427 Adv. TS Analysis) Lecture Notes September
More informationModel Specification Testing in Nonparametric and Semiparametric Time Series Econometrics 1
Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics 1 By Jiti Gao 2 and Maxwell King 3 Abstract We propose a simultaneous model specification procedure for te conditional
More informationChapter 4 Derivatives [ ] = ( ) ( )= + ( ) + + = ()= + ()+ Exercise 4.1. Review of Prerequisite Skills. 1. f. 6. d. 4. b. lim. x x. = lim = c.
Capter Derivatives Review of Prerequisite Skills. f. p p p 7 9 p p p Eercise.. i. ( a ) a ( b) a [ ] b a b ab b a. d. f. 9. c. + + ( ) ( + ) + ( + ) ( + ) ( + ) + + + + ( ) ( + ) + + ( ) ( ) ( + ) + 7
More informationA Jump-Preserving Curve Fitting Procedure Based On Local Piecewise-Linear Kernel Estimation
A Jump-Preserving Curve Fitting Procedure Based On Local Piecewise-Linear Kernel Estimation Peiua Qiu Scool of Statistics University of Minnesota 313 Ford Hall 224 Curc St SE Minneapolis, MN 55455 Abstract
More informationMAT 145. Type of Calculator Used TI-89 Titanium 100 points Score 100 possible points
MAT 15 Test #2 Name Solution Guide Type of Calculator Used TI-89 Titanium 100 points Score 100 possible points Use te grap of a function sown ere as you respond to questions 1 to 8. 1. lim f (x) 0 2. lim
More informationSection 3.1: Derivatives of Polynomials and Exponential Functions
Section 3.1: Derivatives of Polynomials and Exponential Functions In previous sections we developed te concept of te derivative and derivative function. Te only issue wit our definition owever is tat it
More informationLIMITATIONS OF EULER S METHOD FOR NUMERICAL INTEGRATION
LIMITATIONS OF EULER S METHOD FOR NUMERICAL INTEGRATION LAURA EVANS.. Introduction Not all differential equations can be explicitly solved for y. Tis can be problematic if we need to know te value of y
More informationMA455 Manifolds Solutions 1 May 2008
MA455 Manifolds Solutions 1 May 2008 1. (i) Given real numbers a < b, find a diffeomorpism (a, b) R. Solution: For example first map (a, b) to (0, π/2) and ten map (0, π/2) diffeomorpically to R using
More informationMath 161 (33) - Final exam
Name: Id #: Mat 161 (33) - Final exam Fall Quarter 2015 Wednesday December 9, 2015-10:30am to 12:30am Instructions: Prob. Points Score possible 1 25 2 25 3 25 4 25 TOTAL 75 (BEST 3) Read eac problem carefully.
More informationRegularized Regression
Regularized Regression David M. Blei Columbia University December 5, 205 Modern regression problems are ig dimensional, wic means tat te number of covariates p is large. In practice statisticians regularize
More informationMath 34A Practice Final Solutions Fall 2007
Mat 34A Practice Final Solutions Fall 007 Problem Find te derivatives of te following functions:. f(x) = 3x + e 3x. f(x) = x + x 3. f(x) = (x + a) 4. Is te function 3t 4t t 3 increasing or decreasing wen
More information1 Limits and Continuity
1 Limits and Continuity 1.0 Tangent Lines, Velocities, Growt In tion 0.2, we estimated te slope of a line tangent to te grap of a function at a point. At te end of tion 0.3, we constructed a new function
More informationNon-parametric Inference and Resampling
Non-parametric Inference and Resampling Exercises by David Wozabal (Last update 3. Juni 2013) 1 Basic Facts about Rank and Order Statistics 1.1 10 students were asked about the amount of time they spend
More information5.1 We will begin this section with the definition of a rational expression. We
Basic Properties and Reducing to Lowest Terms 5.1 We will begin tis section wit te definition of a rational epression. We will ten state te two basic properties associated wit rational epressions and go
More informationChapter 1D - Rational Expressions
- Capter 1D Capter 1D - Rational Expressions Definition of a Rational Expression A rational expression is te quotient of two polynomials. (Recall: A function px is a polynomial in x of degree n, if tere
More informationLogarithmic functions
Roberto s Notes on Differential Calculus Capter 5: Derivatives of transcendental functions Section Derivatives of Logaritmic functions Wat ou need to know alread: Definition of derivative and all basic
More informationQuaternion Dynamics, Part 1 Functions, Derivatives, and Integrals. Gary D. Simpson. rev 01 Aug 08, 2016.
Quaternion Dynamics, Part 1 Functions, Derivatives, and Integrals Gary D. Simpson gsim1887@aol.com rev 1 Aug 8, 216 Summary Definitions are presented for "quaternion functions" of a quaternion. Polynomial
More information1 + t5 dt with respect to x. du = 2. dg du = f(u). du dx. dg dx = dg. du du. dg du. dx = 4x3. - page 1 -
Eercise. Find te derivative of g( 3 + t5 dt wit respect to. Solution: Te integrand is f(t + t 5. By FTC, f( + 5. Eercise. Find te derivative of e t2 dt wit respect to. Solution: Te integrand is f(t e t2.
More informationMaterial for Difference Quotient
Material for Difference Quotient Prepared by Stepanie Quintal, graduate student and Marvin Stick, professor Dept. of Matematical Sciences, UMass Lowell Summer 05 Preface Te following difference quotient
More informationMAT244 - Ordinary Di erential Equations - Summer 2016 Assignment 2 Due: July 20, 2016
MAT244 - Ordinary Di erential Equations - Summer 206 Assignment 2 Due: July 20, 206 Full Name: Student #: Last First Indicate wic Tutorial Section you attend by filling in te appropriate circle: Tut 0
More informationThe derivative function
Roberto s Notes on Differential Calculus Capter : Definition of derivative Section Te derivative function Wat you need to know already: f is at a point on its grap and ow to compute it. Wat te derivative
More information