LEAST SQUARES APPROXIMATION
|
|
- Rudolph Farmer
- 5 years ago
- Views:
Transcription
1 LEAST SQUARES APPROXIMATION One more approach to approximating a function f (x) on an interval a x b is to seek an approximation p(x) with a small average error over the interval of approximation. A convenient definition of the average error of the approximation is given by E(p; f ) { b } 1 [f (x) p(x)] dx b a a (1) This is also called the root-mean-square-error (denoted subsequently by RMSE) in the approximation of f (x) by p(x). Note first that choosing p(x) to minimize E(p; f ) is equivalent to minimizing b a [f (x) p(x)] dx thus dispensing with the square root and multiplying fraction (although the minimums are generally different). The minimizing of (1) is called the least squares approximation problem.
2 Example Let f (x) = e x, p(x) = α 0 + α 1 x, α 0 and α 1 unknown. Approximate f (x) over [, 1]. Choose α 0, α 1 to minimize g(α 0, α 1 ) = Integrating, g(α 0, α 1 ) (e x α 0 α 1 x) dx () ( e x + α 0 + α 1x α 0 e x α 1 xe x + α 0 α 1 x ) dx g(α 0, α 1 ) = c 1 α 0 + c α 1 + c 3 α 0 α 1 + c 4 α 0 + c 5 α 1 + c 6 with constants {c 1,..., c 6 }, e.g. c 1 =, c 6 = ( e 1 e ) /. g is a quadratic polynomial in the two variables α 0, α 1. To find its minimum, solve the system g α 0 = 0, g α 1 = 0
3 It is simpler to differentiate () g(α 0, α 1 ) = (e x α 0 α 1 x) dx directly, obtaining (e x α 0 α 1 x) () dx = 0 This simplifies to (e x α 0 α 1 x) ( x) dx = 0 So α 0 = α 0 = e e e x dx = e e, 1 3 α 1 = xe x dx = e. = 1.175, α 1 = 3e. =
4 Using these values for α 0 and α 1, we denote the resulting linear approximation by l 1 (x) = α 0 + α 1 x It is called the best linear approximation to e x in the sense of least squares. For the maximum error, max x 1 ex l 1 (x) =
5 Errors in linear approximations of e x Approximation Max Error RMSE Taylor t 1 (x) Least squares l 1 (x) Chebyshev c 1 (x) Minimax m 1 (x) y y=e x y=l 1 (x) 1 x 1 Figure: The linear least squares approximation to e x
6 THE GENERAL CASE Approximate f (x) on [a, b], and let n 0. Seek p(x) to minimize the RMSE. Write g(α 0, α 1,..., α n ) p(x) = α 0 + α 1 x + + α n x n b a [f (x) α 0 α 1 x α n x n ] dx Find coefficients α 0, α 1,..., α n to minimize this integral. The integral g(α 0, α 1,..., α n ) is a quadratic polynomial in the n + 1 variables α 0, α 1,..., α n. To minimize g(α 0, α 1,..., α n ), invoke the conditions g α i = 0, i = 0, 1,..., n This yields a set of n + 1 equations that must be satisfied by a minimizing set α 0, α 1,..., α n for g. Manipulating this set of conditions leads to a simultaneous linear system.
7 To better understand the form of the linear system, consider the special case of [a, b] = [0, 1]. Differentiating g(α 0, α 1,..., α n ) = with respect to each α i, we obtain [f (x) α 0 α 1 x α n x n ] dx (e x α 0 α n x n ) () dx = 0 (e x α 0 α n x n ) ( x) dx = 0. (e x α 0 α n x n ) ( x n ) dx = 0
8 Then the linear system is n α j i + j + 1 = 0 x i f (x) dx, i = 0, 1,..., n We will study the solution of simultaneous linear systems in Chapter 6. There we will see that this linear system is ill-conditioned and is difficult to solve accurately, even for moderately sized values of n such as n = 5. As a consequence, this is not a good approach to solving for a minimizer of g(α 0, α 1,..., α n ). For a better way to solve the least squares approximation problem, we need Legendre polynomials.
9 LEGENDRE POLYNOMIALS Define the Legendre polynomials as follows (for x [, 1]) For example, P n (x) = 1 n! n d n [ (x dx n 1 ) ] n, n = 0, 1,,... P 0 (x) = 1 P 1 (x) = x P (x) = 1 ( 3x 1 ) P 3 (x) = 1 ( 5x 3 3x ) P 4 (x) = 1 ( 35x 4 30x + 3 ) 8 The Legendre polynomials have many special properties, and they are widely used in numerical analysis and applied mathematics.
10 y 1 1 x P 1 (x) P (x) P 3 (x) P 4 (x) Figure: Legendre polynomials of degrees 1,, 3, 4
11 PROPERTIES Degree and normalization: Triple recursion relation: P n+1 (x) = n + 1 deg P n = n, P n (1) = 1, n 0 n + 1 xp n(x) P 0 (x) = 1, P 1 (x) = x Orthogonality and size: (P i, P j ) = Here we use the notation (f, g) = n n + 1 P n(x), n 1 0, i j j + 1, for general functions f (x) and g(x). i = j f (x)g(x) dx
12 Zeroes: All zeroes of P n (x) are located in [, 1] ; all zeroes are simple roots of P n (x) Basis: Every polynomial p(x) of degree n can be written in the form n p(x) = β j P j (x) with the choice of β 0, β 1,..., β n uniquely determined from p(x): β j = (p, P j), j = 0, 1,..., n (P j, P j )
13 FINDING THE LEAST SQUARES APPROXIMATION Here we discuss the least squares approximation problem on only the interval [, 1]. Approximation problems on other intervals [a, b] can be accomplished using a linear change of variable. We seek to find a polynomial p(x) of degree n that minimizes This is equivalent to minimizing [f (x) p(x)] dx We begin by writing p(x) in the form (f p, f p) (3) p(x) = n β j P j (x)
14 Use p(x) = n β jp j (x) to obtain g (β 0, β 1,..., β n ) (f p, f p) = f Rewrite it as g = (f, f ) = (f, f ) + n β j P j, f n [ β j (P j, P j ) β j (f, P j ) ] n β i P i i=0 n (f, P j ) n [ (P j, P j ) + (P j, P j ) β j (f, P ] j) (P j, P j ) We see that g (β 0, β 1,..., β n ) is smallest when β j = (f, P j), j = 0, 1,..., n (P j, P j )
15 For the choice of coefficients the minimum is We call β j = (f, P j), j = 0, 1,..., n (P j, P j ) g = (f, f ) l n (x) = n n (f, P j ) (P j, P j ) (f, P j ) (P j, P j ) P j(x) (4) the least squares approximation of degree n to f (x) on [, 1]. If β n = 0, then its actual degree is less than n.
16 Example Approximate f (x) = e x on [, 1]. We use (4) with n = 3: l 3 (x) = 3 β j P j (x), β j = (f, P j) (P j, P j ) (5) The coefficients {β 0, β 1, β, β 3 } are as follows. j β j Using (5) and simplifying, l 3 (x) = x x x 3
17 y x Figure: Error in the cubic least squares approximation to e x
18 The error in various cubic approximations Approximation Max Error RMSE Taylor t 3 (x) Least squares l 3 (x) Chebyshev c 3 (x) Minimax m 3 (x)
Scientific Computing
2301678 Scientific Computing Chapter 2 Interpolation and Approximation Paisan Nakmahachalasint Paisan.N@chula.ac.th Chapter 2 Interpolation and Approximation p. 1/66 Contents 1. Polynomial interpolation
More informationHow might we evaluate this? Suppose that, by some good luck, we knew that. x 2 5. x 2 dx 5
8.4 1 8.4 Partial Fractions Consider the following integral. 13 2x (1) x 2 x 2 dx How might we evaluate this? Suppose that, by some good luck, we knew that 13 2x (2) x 2 x 2 = 3 x 2 5 x + 1 We could then
More informationLegendre s Equation. PHYS Southern Illinois University. October 18, 2016
Legendre s Equation PHYS 500 - Southern Illinois University October 18, 2016 PHYS 500 - Southern Illinois University Legendre s Equation October 18, 2016 1 / 11 Legendre s Equation Recall We are trying
More informationApproximation theory
Approximation theory Xiaojing Ye, Math & Stat, Georgia State University Spring 2019 Numerical Analysis II Xiaojing Ye, Math & Stat, Georgia State University 1 1 1.3 6 8.8 2 3.5 7 10.1 Least 3squares 4.2
More informationDownloaded from
Question 1: Exercise 2.1 The graphs of y = p(x) are given in following figure, for some polynomials p(x). Find the number of zeroes of p(x), in each case. (i) (ii) (iii) Page 1 of 24 (iv) (v) (v) Page
More informationMethods of Integration
Methods of Integration Professor D. Olles January 8, 04 Substitution The derivative of a composition of functions can be found using the chain rule form d dx [f (g(x))] f (g(x)) g (x) Rewriting the derivative
More informationA quadratic expression is a mathematical expression that can be written in the form 2
118 CHAPTER Algebra.6 FACTORING AND THE QUADRATIC EQUATION Textbook Reference Section 5. CLAST OBJECTIVES Factor a quadratic expression Find the roots of a quadratic equation A quadratic expression is
More informationChapter 4: Interpolation and Approximation. October 28, 2005
Chapter 4: Interpolation and Approximation October 28, 2005 Outline 1 2.4 Linear Interpolation 2 4.1 Lagrange Interpolation 3 4.2 Newton Interpolation and Divided Differences 4 4.3 Interpolation Error
More informationPower Series Solutions to the Legendre Equation
Department of Mathematics IIT Guwahati The Legendre equation The equation (1 x 2 )y 2xy + α(α + 1)y = 0, (1) where α is any real constant, is called Legendre s equation. When α Z +, the equation has polynomial
More informationCurve Fitting and Approximation
Department of Physics Cotton College State University, Panbazar Guwahati 781001, Assam December 6, 2016 Outline Curve Fitting 1 Curve Fitting Outline Curve Fitting 1 Curve Fitting Topics in the Syllabus
More informationINTERPOLATION. and y i = cos x i, i = 0, 1, 2 This gives us the three points. Now find a quadratic polynomial. p(x) = a 0 + a 1 x + a 2 x 2.
INTERPOLATION Interpolation is a process of finding a formula (often a polynomial) whose graph will pass through a given set of points (x, y). As an example, consider defining and x 0 = 0, x 1 = π/4, x
More information6.3 Partial Fractions
6.3 Partial Fractions Mark Woodard Furman U Fall 2009 Mark Woodard (Furman U) 6.3 Partial Fractions Fall 2009 1 / 11 Outline 1 The method illustrated 2 Terminology 3 Factoring Polynomials 4 Partial fraction
More informationSection 9.7 and 9.10: Taylor Polynomials and Approximations/Taylor and Maclaurin Series
Section 9.7 and 9.10: Taylor Polynomials and Approximations/Taylor and Maclaurin Series Power Series for Functions We can create a Power Series (or polynomial series) that can approximate a function around
More informationECONOMICS 207 SPRING 2006 LABORATORY EXERCISE 5 KEY. 8 = 10(5x 2) = 9(3x + 8), x 50x 20 = 27x x = 92 x = 4. 8x 2 22x + 15 = 0 (2x 3)(4x 5) = 0
ECONOMICS 07 SPRING 006 LABORATORY EXERCISE 5 KEY Problem. Solve the following equations for x. a 5x 3x + 8 = 9 0 5x 3x + 8 9 8 = 0(5x ) = 9(3x + 8), x 0 3 50x 0 = 7x + 7 3x = 9 x = 4 b 8x x + 5 = 0 8x
More information(0, 0), (1, ), (2, ), (3, ), (4, ), (5, ), (6, ).
1 Interpolation: The method of constructing new data points within the range of a finite set of known data points That is if (x i, y i ), i = 1, N are known, with y i the dependent variable and x i [x
More informationMath 2: Algebra 2, Geometry and Statistics Ms. Sheppard-Brick Chapter 4 Test Review
Chapter 4 Test Review Students will be able to (SWBAT): Write an explicit and a recursive function rule for a linear table of values. Write an explicit function rule for a quadratic table of values. Determine
More informationEXAMPLES OF PROOFS BY INDUCTION
EXAMPLES OF PROOFS BY INDUCTION KEITH CONRAD 1. Introduction In this handout we illustrate proofs by induction from several areas of mathematics: linear algebra, polynomial algebra, and calculus. Becoming
More informationSOLVED PROBLEMS ON TAYLOR AND MACLAURIN SERIES
SOLVED PROBLEMS ON TAYLOR AND MACLAURIN SERIES TAYLOR AND MACLAURIN SERIES Taylor Series of a function f at x = a is ( f k )( a) ( x a) k k! It is a Power Series centered at a. Maclaurin Series of a function
More informationProblem 1. Produce the linear and quadratic Taylor polynomials for the following functions:
Problem. Produce the linear and quadratic Taylor polynomials for the following functions: (a) f(x) = e cos(x), a = (b) log( + e x ), a = The general formula for any Taylor Polynomial is as follows: (a)
More informationPower Series Solutions to the Legendre Equation
Power Series Solutions to the Legendre Equation Department of Mathematics IIT Guwahati The Legendre equation The equation (1 x 2 )y 2xy + α(α + 1)y = 0, (1) where α is any real constant, is called Legendre
More information4 Integration. Copyright Cengage Learning. All rights reserved.
4 Integration Copyright Cengage Learning. All rights reserved. 4.1 Antiderivatives and Indefinite Integration Copyright Cengage Learning. All rights reserved. Objectives! Write the general solution of
More informationNUMERICAL METHODS. x n+1 = 2x n x 2 n. In particular: which of them gives faster convergence, and why? [Work to four decimal places.
NUMERICAL METHODS 1. Rearranging the equation x 3 =.5 gives the iterative formula x n+1 = g(x n ), where g(x) = (2x 2 ) 1. (a) Starting with x = 1, compute the x n up to n = 6, and describe what is happening.
More informationReview of Power Series
Review of Power Series MATH 365 Ordinary Differential Equations J. Robert Buchanan Department of Mathematics Fall 2018 Introduction In addition to the techniques we have studied so far, we may use power
More informationTaylor and Maclaurin Series
Taylor and Maclaurin Series MATH 211, Calculus II J. Robert Buchanan Department of Mathematics Spring 2018 Background We have seen that some power series converge. When they do, we can think of them as
More informationUNIT 3 INTEGRATION 3.0 INTRODUCTION 3.1 OBJECTIVES. Structure
Calculus UNIT 3 INTEGRATION Structure 3.0 Introduction 3.1 Objectives 3.2 Basic Integration Rules 3.3 Integration by Substitution 3.4 Integration of Rational Functions 3.5 Integration by Parts 3.6 Answers
More informationLesson 3: Linear differential equations of the first order Solve each of the following differential equations by two methods.
Lesson 3: Linear differential equations of the first der Solve each of the following differential equations by two methods. Exercise 3.1. Solution. Method 1. It is clear that y + y = 3 e dx = e x is an
More informationMath 651 Introduction to Numerical Analysis I Fall SOLUTIONS: Homework Set 1
ath 651 Introduction to Numerical Analysis I Fall 2010 SOLUTIONS: Homework Set 1 1. Consider the polynomial f(x) = x 2 x 2. (a) Find P 1 (x), P 2 (x) and P 3 (x) for f(x) about x 0 = 0. What is the relation
More informationLectures 9-10: Polynomial and piecewise polynomial interpolation
Lectures 9-1: Polynomial and piecewise polynomial interpolation Let f be a function, which is only known at the nodes x 1, x,, x n, ie, all we know about the function f are its values y j = f(x j ), j
More informationLesson 7.1 Polynomial Degree and Finite Differences
Lesson 7.1 Polynomial Degree and Finite Differences 1. Identify the degree of each polynomial. a. 3x 4 2x 3 3x 2 x 7 b. x 1 c. 0.2x 1.x 2 3.2x 3 d. 20 16x 2 20x e. x x 2 x 3 x 4 x f. x 2 6x 2x 6 3x 4 8
More informationFixed point iteration and root finding
Fixed point iteration and root finding The sign function is defined as x > 0 sign(x) = 0 x = 0 x < 0. It can be evaluated via an iteration which is useful for some problems. One such iteration is given
More information17.2 Nonhomogeneous Linear Equations. 27 September 2007
17.2 Nonhomogeneous Linear Equations 27 September 2007 Nonhomogeneous Linear Equations The differential equation to be studied is of the form ay (x) + by (x) + cy(x) = G(x) (1) where a 0, b, c are given
More informationSolving Differential Equations Using Power Series
LECTURE 25 Solving Differential Equations Using Power Series We are now going to employ power series to find solutions to differential equations of the form (25.) y + p(x)y + q(x)y = 0 where the functions
More informationSolving Differential Equations Using Power Series
LECTURE 8 Solving Differential Equations Using Power Series We are now going to employ power series to find solutions to differential equations of the form () y + p(x)y + q(x)y = 0 where the functions
More informationLecture 22: Integration by parts and u-substitution
Lecture 22: Integration by parts and u-substitution Victoria LEBED, lebed@maths.tcd.ie MA1S11A: Calculus with Applications for Scientists December 1, 2017 1 Integration vs differentiation From our first
More informationReview of Integration Techniques
A P P E N D I X D Brief Review of Integration Techniques u-substitution The basic idea underlying u-substitution is to perform a simple substitution that converts the intergral into a recognizable form
More informationAlgebra III Chapter 2 Note Packet. Section 2.1: Polynomial Functions
Algebra III Chapter 2 Note Packet Name Essential Question: Section 2.1: Polynomial Functions Polynomials -Have nonnegative exponents -Variables ONLY in -General Form n ax + a x +... + ax + ax+ a n n 1
More informationNumerical Methods. King Saud University
Numerical Methods King Saud University Aims In this lecture, we will... find the approximate solutions of derivative (first- and second-order) and antiderivative (definite integral only). Numerical Differentiation
More informationMath123 Lecture 1. Dr. Robert C. Busby. Lecturer: Office: Korman 266 Phone :
Lecturer: Math1 Lecture 1 Dr. Robert C. Busby Office: Korman 66 Phone : 15-895-1957 Email: rbusby@mcs.drexel.edu Course Web Site: http://www.mcs.drexel.edu/classes/calculus/math1_spring0/ (Links are case
More informationOutline. 1 Interpolation. 2 Polynomial Interpolation. 3 Piecewise Polynomial Interpolation
Outline Interpolation 1 Interpolation 2 3 Michael T. Heath Scientific Computing 2 / 56 Interpolation Motivation Choosing Interpolant Existence and Uniqueness Basic interpolation problem: for given data
More informationMA22S3 Summary Sheet: Ordinary Differential Equations
MA22S3 Summary Sheet: Ordinary Differential Equations December 14, 2017 Kreyszig s textbook is a suitable guide for this part of the module. Contents 1 Terminology 1 2 First order separable 2 2.1 Separable
More informationFIXED POINT ITERATION
FIXED POINT ITERATION The idea of the fixed point iteration methods is to first reformulate a equation to an equivalent fixed point problem: f (x) = 0 x = g(x) and then to use the iteration: with an initial
More information1.2. Indices. Introduction. Prerequisites. Learning Outcomes
Indices.2 Introduction Indices, or powers, provide a convenient notation when we need to multiply a number by itself several times. In this section we explain how indices are written, and state the rules
More informationQuadratic forms. Here. Thus symmetric matrices are diagonalizable, and the diagonalization can be performed by means of an orthogonal matrix.
Quadratic forms 1. Symmetric matrices An n n matrix (a ij ) n ij=1 with entries on R is called symmetric if A T, that is, if a ij = a ji for all 1 i, j n. We denote by S n (R) the set of all n n symmetric
More informationReview all the activities leading to Midterm 3. Review all the problems in the previous online homework sets (8+9+10).
MA109, Activity 34: Review (Sections 3.6+3.7+4.1+4.2+4.3) Date: Objective: Additional Assignments: To prepare for Midterm 3, make sure that you can solve the types of problems listed in Activities 33 and
More informationSeries Solution of Linear Ordinary Differential Equations
Series Solution of Linear Ordinary Differential Equations Department of Mathematics IIT Guwahati Aim: To study methods for determining series expansions for solutions to linear ODE with variable coefficients.
More informationStudent: Date: Instructor: kumnit nong Course: MATH 105 by Nong https://xlitemprodpearsoncmgcom/api/v1/print/math Assignment: CH test review 1 Find the transformation form of the quadratic function graphed
More informationNonlinear Integral Equation Formulation of Orthogonal Polynomials
Nonlinear Integral Equation Formulation of Orthogonal Polynomials Eli Ben-Naim Theory Division, Los Alamos National Laboratory with: Carl Bender (Washington University, St. Louis) C.M. Bender and E. Ben-Naim,
More informationChapter 2. First-Order Differential Equations
Chapter 2 First-Order Differential Equations i Let M(x, y) + N(x, y) = 0 Some equations can be written in the form A(x) + B(y) = 0 DEFINITION 2.2. (Separable Equation) A first-order differential equation
More informationLimits at Infinity. Horizontal Asymptotes. Definition (Limits at Infinity) Horizontal Asymptotes
Limits at Infinity If a function f has a domain that is unbounded, that is, one of the endpoints of its domain is ±, we can determine the long term behavior of the function using a it at infinity. Definition
More informationTAYLOR SERIES [SST 8.8]
TAYLOR SERIES [SST 8.8] TAYLOR SERIES: Every function f C (c R, c + R) has a unique Taylor series about x = c of the form: f (k) (c) f(x) = (x c) k = f(c) + f (c) (x c) + f (c) (x c) 2 + f (c) (x c) 3
More informationNumerical integration and differentiation. Unit IV. Numerical Integration and Differentiation. Plan of attack. Numerical integration.
Unit IV Numerical Integration and Differentiation Numerical integration and differentiation quadrature classical formulas for equally spaced nodes improper integrals Gaussian quadrature and orthogonal
More informationSolutions to Exercises, Section 2.5
Instructor s Solutions Manual, Section 2.5 Exercise 1 Solutions to Exercises, Section 2.5 For Exercises 1 4, write the domain of the given function r as a union of intervals. 1. r(x) 5x3 12x 2 + 13 x 2
More informationNumerical Methods. Equations and Partial Fractions. Jaesung Lee
Numerical Methods Equations and Partial Fractions Jaesung Lee Solving linear equations Solving linear equations Introduction Many problems in engineering reduce to the solution of an equation or a set
More informationi x i y i
Department of Mathematics MTL107: Numerical Methods and Computations Exercise Set 8: Approximation-Linear Least Squares Polynomial approximation, Chebyshev Polynomial approximation. 1. Compute the linear
More informationAn Analysis of Five Numerical Methods for Approximating Certain Hypergeometric Functions in Domains within their Radii of Convergence
An Analysis of Five Numerical Methods for Approximating Certain Hypergeometric Functions in Domains within their Radii of Convergence John Pearson MSc Special Topic Abstract Numerical approximations of
More informationQuestion 1: The graphs of y = p(x) are given in following figure, for some Polynomials p(x). Find the number of zeroes of p(x), in each case.
Class X - NCERT Maths EXERCISE NO:.1 Question 1: The graphs of y = p(x) are given in following figure, for some Polynomials p(x). Find the number of zeroes of p(x), in each case. (i) (ii) (iii) (iv) (v)
More informationThe Perrin Conjugate and the Laguerre Orthogonal Polynomial
The Perrin Conjugate and the Laguerre Orthogonal Polynomial In a previous chapter I defined the conjugate of a cubic polynomial G(x) = x 3 - Bx Cx - D as G(x)c = x 3 + Bx Cx + D. By multiplying the polynomial
More informationMarch 5, 2009 Name The problems count as marked. The total number of points available is 131. Throughout this test, show your work.
March 5, 2009 Name The problems count as marked. The total number of points available is 131. Throughout this test, show your work. 1. (12 points) Consider the cubic curve f(x) = 2x 3 + 3x + 2. (a) What
More informationReview: complex numbers
October 5/6, 01.5 extra problems page 1 Review: complex numbers Number system The complex number system consists of a + bi where a and b are real numbers, with various arithmetic operations. The real numbers
More information, a 1. , a 2. ,..., a n
CHAPTER Points to Remember :. Let x be a variable, n be a positive integer and a 0, a, a,..., a n be constants. Then n f ( x) a x a x... a x a, is called a polynomial in variable x. n n n 0 POLNOMIALS.
More informationAssignment. Disguises with Trig Identities. Review Product Rule. Integration by Parts. Manipulating the Product Rule. Integration by Parts 12/13/2010
Fitting Integrals to Basic Rules Basic Integration Rules Lesson 8.1 Consider these similar integrals Which one uses The log rule The arctangent rule The rewrite with long division principle Try It Out
More informationMATH 1231 MATHEMATICS 1B Calculus Section 4.4: Taylor & Power series.
MATH 1231 MATHEMATICS 1B 2010. For use in Dr Chris Tisdell s lectures. Calculus Section 4.4: Taylor & Power series. 1. What is a Taylor series? 2. Convergence of Taylor series 3. Common Maclaurin series
More informationNovember 20, Interpolation, Extrapolation & Polynomial Approximation
Interpolation, Extrapolation & Polynomial Approximation November 20, 2016 Introduction In many cases we know the values of a function f (x) at a set of points x 1, x 2,..., x N, but we don t have the analytic
More informationLEAST SQUARES DATA FITTING
LEAST SQUARES DATA FITTING Experiments generally have error or uncertainty in measuring their outcome. Error can be human error, but it is more usually due to inherent limitations in the equipment being
More informationMath 334 A1 Homework 3 (Due Nov. 5 5pm)
Math 334 A1 Homework 3 Due Nov. 5 5pm No Advanced or Challenge problems will appear in homeworks. Basic Problems Problem 1. 4.1 11 Verify that the given functions are solutions of the differential equation,
More informationLecture 4.6: Some special orthogonal functions
Lecture 4.6: Some special orthogonal functions Matthew Macauley Department of Mathematical Sciences Clemson University http://www.math.clemson.edu/~macaule/ Math 4340, Advanced Engineering Mathematics
More informationMath 240 Calculus III
Calculus III Summer 2015, Session II Monday, August 3, 2015 Agenda 1. 2. Introduction The reduction of technique, which applies to second- linear differential equations, allows us to go beyond equations
More informationSolution of Algebric & Transcendental Equations
Page15 Solution of Algebric & Transcendental Equations Contents: o Introduction o Evaluation of Polynomials by Horner s Method o Methods of solving non linear equations o Bracketing Methods o Bisection
More informationNewton s Method and Linear Approximations
Newton s Method and Linear Approximations Curves are tricky. Lines aren t. Newton s Method and Linear Approximations Newton s Method for finding roots Goal: Where is f (x) = 0? f (x) = x 7 + 3x 3 + 7x
More informationTest 2 Review Math 1111 College Algebra
Test 2 Review Math 1111 College Algebra 1. Begin by graphing the standard quadratic function f(x) = x 2. Then use transformations of this graph to graph the given function. g(x) = x 2 + 2 *a. b. c. d.
More informationMath 3 Variable Manipulation Part 3 Polynomials A
Math 3 Variable Manipulation Part 3 Polynomials A 1 MATH 1 & 2 REVIEW: VOCABULARY Constant: A term that does not have a variable is called a constant. Example: the number 5 is a constant because it does
More informationCHAPTER 2 POLYNOMIALS KEY POINTS
CHAPTER POLYNOMIALS KEY POINTS 1. Polynomials of degrees 1, and 3 are called linear, quadratic and cubic polynomials respectively.. A quadratic polynomial in x with real coefficient is of the form a x
More informationSOLVING TRIGONOMETRIC INEQUALITIES: METHODS, AND STEPS (By Nghi H. Nguyen Updated Nov 02, 2014)
DEFINITION. SOLVING TRIGONOMETRIC INEQUALITIES: METHODS, AND STEPS (By Nghi H. Nguyen Updated Nov 02, 2014) A trig inequality is an inequality in standard form: R(x) > 0 (or < 0) that contains one or a
More informationClass notes: Approximation
Class notes: Approximation Introduction Vector spaces, linear independence, subspace The goal of Numerical Analysis is to compute approximations We want to approximate eg numbers in R or C vectors in R
More informationCalculation of Orthogonal Polynomials and Their Derivatives
Biostatistics Department R eport Technical BST2017-0 01 C alculation of Orthogonal Polynomials T heir Derivatives and C harles R. Katholi, PhD M ay 2017 D epartment of Biostatistics S chool of Public Health
More informationAdditional Practice Lessons 2.02 and 2.03
Additional Practice Lessons 2.02 and 2.03 1. There are two numbers n that satisfy the following equations. Find both numbers. a. n(n 1) 306 b. n(n 1) 462 c. (n 1)(n) 182 2. The following function is defined
More informationLinear Algebra. and
Instructions Please answer the six problems on your own paper. These are essay questions: you should write in complete sentences. 1. Are the two matrices 1 2 2 1 3 5 2 7 and 1 1 1 4 4 2 5 5 2 row equivalent?
More informationChapter 2 notes from powerpoints
Chapter 2 notes from powerpoints Synthetic division and basic definitions Sections 1 and 2 Definition of a Polynomial Function: Let n be a nonnegative integer and let a n, a n-1,, a 2, a 1, a 0 be real
More informationSection 5.6. Integration By Parts. MATH 126 (Section 5.6) Integration By Parts The University of Kansas 1 / 10
Section 5.6 Integration By Parts MATH 126 (Section 5.6) Integration By Parts The University of Kansas 1 / 10 Integration By Parts Manipulating the Product Rule d dx (f (x) g(x)) = f (x) g (x) + f (x) g(x)
More informationUNDETERMINED COEFFICIENTS SUPERPOSITION APPROACH *
4.4 UNDETERMINED COEFFICIENTS SUPERPOSITION APPROACH 19 Discussion Problems 59. Two roots of a cubic auxiliary equation with real coeffi cients are m 1 1 and m i. What is the corresponding homogeneous
More informationTropical Polynomials
1 Tropical Arithmetic Tropical Polynomials Los Angeles Math Circle, May 15, 2016 Bryant Mathews, Azusa Pacific University In tropical arithmetic, we define new addition and multiplication operations on
More informationFurther Mathematical Methods (Linear Algebra) 2002
Further Mathematical Methods (Linear Algebra) Solutions For Problem Sheet 9 In this problem sheet, we derived a new result about orthogonal projections and used them to find least squares approximations
More informationCALCULUS JIA-MING (FRANK) LIOU
CALCULUS JIA-MING (FRANK) LIOU Abstract. Contents. Power Series.. Polynomials and Formal Power Series.2. Radius of Convergence 2.3. Derivative and Antiderivative of Power Series 4.4. Power Series Expansion
More informationInterpolation Theory
Numerical Analysis Massoud Malek Interpolation Theory The concept of interpolation is to select a function P (x) from a given class of functions in such a way that the graph of y P (x) passes through the
More information1. The profit from selling local ballet tickets depends on the ticket price. Using past receipts, we find that the profit can be modeled
Warm-up 1. The profit from selling local ballet tickets depends on the ticket price. Using past receipts, we find that the profit can be modeled by the function p x = 15x 2 + 600x + 60, where x is the
More informationn=0 xn /n!. That is almost what we have here; the difference is that the denominator is (n + 1)! in stead of n!. So we have x n+1 n=0
DISCRETE MATHEMATICS HOMEWORK 8 SOL Undergraduate Course Chukechen Honors College Zhejiang University Fall-Winter 204 HOMEWORK 8 P496 6. Find a closed form for the generating function for the sequence
More informationProjections and Least Square Solutions. Recall that given an inner product space V with subspace W and orthogonal basis for
Math 57 Spring 18 Projections and Least Square Solutions Recall that given an inner product space V with subspace W and orthogonal basis for W, B {v 1, v,..., v k }, the orthogonal projection of V onto
More informationChapter 4: Higher-Order Differential Equations Part 1
Chapter 4: Higher-Order Differential Equations Part 1 王奕翔 Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw October 8, 2013 Higher-Order Differential Equations Most of this
More informationODE Homework Series Solutions Near an Ordinary Point, Part I 1. Seek power series solution of the equation. n(n 1)a n x n 2 = n=0
ODE Homework 6 5.2. Series Solutions Near an Ordinary Point, Part I 1. Seek power series solution of the equation y + k 2 x 2 y = 0, k a constant about the the point x 0 = 0. Find the recurrence relation;
More information( 3) ( ) ( ) ( ) ( ) ( )
81 Instruction: Determining the Possible Rational Roots using the Rational Root Theorem Consider the theorem stated below. Rational Root Theorem: If the rational number b / c, in lowest terms, is a root
More informationDepartment of Applied Mathematics and Theoretical Physics. AMA 204 Numerical analysis. Exam Winter 2004
Department of Applied Mathematics and Theoretical Physics AMA 204 Numerical analysis Exam Winter 2004 The best six answers will be credited All questions carry equal marks Answer all parts of each question
More informationCourse Notes for EE227C (Spring 2018): Convex Optimization and Approximation
Course Notes for EE7C (Spring 018): Convex Optimization and Approximation Instructor: Moritz Hardt Email: hardt+ee7c@berkeley.edu Graduate Instructor: Max Simchowitz Email: msimchow+ee7c@berkeley.edu October
More informationNote on Chebyshev Regression
1 Introduction Note on Chebyshev Regression Makoto Nakajima, UIUC January 006 The family of Chebyshev polynomials is by far the most popular choice for the base functions for weighted residuals method.
More informationSOLVING TRIGONOMETRIC INEQUALITIES (CONCEPT, METHODS, AND STEPS )
SOLVING TRIGONOMETRIC INEQUALITIES (CONCEPT, METHODS, AND STEPS ) Definition. A trig inequality is an inequality in standard form: R(x) > 0 (or < 0) that contains one or a few trig functions of the variable
More informationMeasures, orthogonal polynomials, and continued fractions. Michael Anshelevich
Measures, orthogonal polynomials, and continued fractions Michael Anshelevich November 7, 2008 MEASURES AND ORTHOGONAL POLYNOMIALS. µ a positive measure on R. A linear functional µ[p ] = P (x) dµ(x), µ
More informationOther Things & Some Applications
Chapter 4 Other Things & Some Applications 4. Unimodality, Log-concavity & Real-rootedness (4.) Denition Let A = (a 0, a,..., a n ) be a sequence of positive real numbers. The sequence A is said to be:
More informationProgram : M.A./M.Sc. (Mathematics) M.A./M.Sc. (Final) Paper Code:MT-08 Numerical Analysis Section A (Very Short Answers Questions)
Program : M../M.Sc. (Mathematics) M../M.Sc. (Final) Paper Code:MT-08 Numerical nalysis Section (Very Short nswers Questions) 1. Write two examples of transcendental equations. (i) x 3 + sin x = 0 (ii)
More informationMath /Foundations of Algebra/Fall 2017 Numbers at the Foundations: Real Numbers In calculus, the derivative of a function f(x) is defined
Math 400-001/Foundations of Algebra/Fall 2017 Numbers at the Foundations: Real Numbers In calculus, the derivative of a function f(x) is defined using limits. As a particular case, the derivative of f(x)
More informationHonors Advanced Mathematics November 4, /2.6 summary and extra problems page 1 Recap: complex numbers
November 4, 013.5/.6 summary and extra problems page 1 Recap: complex numbers Number system The complex number system consists of a + bi where a and b are real numbers, with various arithmetic operations.
More informationCh 5.7: Series Solutions Near a Regular Singular Point, Part II
Ch 5.7: Series Solutions Near a Regular Singular Point, Part II! Recall from Section 5.6 (Part I): The point x 0 = 0 is a regular singular point of with and corresponding Euler Equation! We assume solutions
More information