Interpolation and Polynomial Approximation I
|
|
- Florence Boone
- 5 years ago
- Views:
Transcription
1 Interpolation and Polynomial Approximation I If f (n) (x), n are available, Taylor polynomial is an approximation: f (x) = f (x 0 )+f (x 0 )(x x 0 )+ 1 2! f (x 0 )(x x 0 ) 2 + Example: e x = 1 + x 1! + x 2 2! + x 3 3! + Chih-Jen Lin (National Taiwan Univ.) 1 / 51
2 Interpolation and Polynomial Approximation II Need only information of one point If finite terms selected, only approximate points near x 0 Primal use of Taylor polynomials for numerical methods: derivation of numerical techniques but not approximation Chih-Jen Lin (National Taiwan Univ.) 2 / 51
3 Lagrange Polynomials I Given (x 0, f (x 0 )), (x 1, f (x 1 )),..., (x n, f (x n )), find a function passing all of them Why consider polynomials: the simplest form of functions Degree 1 polynomial passing two points: A line Chih-Jen Lin (National Taiwan Univ.) 3 / 51
4 Lagrange Polynomials II Given (x 0, f (x 0 )), (x 1, f (x 1 )). Define Then L 0 (x) x x 1, L 1 (x) x x 0, x 0 x 1 x 1 x 0 P(x) L 0 (x)f (x 0 ) + L 1 (x)f (x 1 ) P(x 0 ) = 1f (x 0 ) + 0f (x 1 ) = f (x 0 ) P(x 1 ) = 0f (x 1 ) + 1f (x 1 ) = f (x 1 ) Generalization: higher-degree polynomials Chih-Jen Lin (National Taiwan Univ.) 4 / 51
5 Lagrange Polynomials III (n + 1) points a polynomial with degree at most n (x 0, f (x 0 )), (x 1, f (x 1 )),..., (x n, f (x n )) Construct L n,k (x). We hope that { 0 i k L n,k (x i ) = 1 i = k n: degree, k: index. Then P(x) = L n,k (x)f (x k ) k=0 Chih-Jen Lin (National Taiwan Univ.) 5 / 51
6 Lagrange Polynomials IV Thus we have Define P(x i ) = f (x i ) L n,k (x) (x x 0) (x x k 1 )(x x k+1 ) (x x n ) (x k x 0 ) (x k x k 1 )(x k x k+1 ) (x k x n ) Assume x i x j Chih-Jen Lin (National Taiwan Univ.) 6 / 51
7 Spline Interpolation I Disadvantages of using polynomials Very high degrees Large fluctuation We will try piecewise polynomial approximation Different polynomials on each interval Linear: a series of straight lines joining (x 0, f (x 0 )),..., (x n, f (x n )) Example x = [ ], y = [ ] Chih-Jen Lin (National Taiwan Univ.) 7 / 51
8 Spline Interpolation II Function forms: s 0 (x),..., s n 1 (x) s j (x) = x x j+1 x j x j+1 y j + x x j x j+1 x j y j+1, x j x x j+1 Chih-Jen Lin (National Taiwan Univ.) 8 / 51
9 Spline Interpolation III Disadvantage: not differentiable at end points Let f (x) be continuous We require s j (x j ) = f (x j ), j = 0,..., n 1, s n 1 (x n ) = f (x n ) s j+1 (x j+1 ) = s j (x j+1 ), j = 0,..., n 2 s j+1(x j+1 ) = s j(x j+1 ), j = 0,..., n 2 How many conditions: 2n + (n 1) = 3n 1 Chih-Jen Lin (National Taiwan Univ.) 9 / 51
10 Spline Interpolation IV Quadratic piecewise interpolation: 3n variables Each interval: a quadratic polynomial, 3 variables Most common piecewise approximation: cubic polynomials (Spline) 4n variables Chih-Jen Lin (National Taiwan Univ.) 10 / 51
11 Spline Interpolation V Let s j (x j ) = f (x j ), j = 0,..., n 1, (1) s n 1 (x n ) = f (x n ) s j+1 (x j+1 ) = s j (x j+1 ), j = 0,..., n 2 (2) s j+1(x j+1 ) = s j(x j+1 ), j = 0,..., n 2 s j+1(x j+1 ) = s j (x j+1 ), j = 0,..., n 2 Number of conditions n (n 1) = 4n 2 Chih-Jen Lin (National Taiwan Univ.) 11 / 51
12 s j (x j ) = a j = f (x j ), j = 0,..., n 1 Chih-Jen Lin (National Taiwan Univ.) 12 / 51 Spline Interpolation VI Boundary conditions s 0 (x 0 ) = s n 1(x n ) = 0 or s 0(x 0 ) = f (x 0 ) and s n 1(x n ) = f (x n ) Total 4n conditions n cubic polynomials Construct cubic polynomials s j (x) a j + b j (x x j ) + c j (x x j ) 2 + d j (x x j ) 3, j = 0,..., n 1 Immediately
13 Spline Interpolation VII Now (2) becomes Define a j+1 = s j (x j+1 ) = a j + b j (x j+1 x j ) + c j (x j+1 x j ) 2 +d j (x j+1 x j ) 3, j = 0,..., n 2 h j x j+1 x j a n f (x n ) Earlier a j is only from 0 to n 1 Chih-Jen Lin (National Taiwan Univ.) 13 / 51
14 Spline Interpolation VIII We have Then a n = s n 1 (x n ) = a n 1 + b n 1 (x n x n 1 ) + c j (x n x n 1 ) 2 + d j (x n x n 1 ) 3 a j+1 = a j + b j h j + c j h 2 j + d j h 3 j, j = 0,..., n 1 (3) Chih-Jen Lin (National Taiwan Univ.) 14 / 51
15 Spline Interpolation IX Define Earlier b j is only 0 to n 1 Using b n s n 1(x n ) (4) s j(x) = b j + 2c j (x x j ) + 3d j (x x j ) 2 s j+1(x j+1 ) = s j(x j+1 ), j = 0,..., n 2 b j+1 = b j + 2c j h j + 3d j h 2 j, j = 0,..., n 1 (5) Chih-Jen Lin (National Taiwan Univ.) 15 / 51
16 c j+1 = c j + 3d j (h j ), j = 0,..., n 1 Chih-Jen Lin (National Taiwan Univ.) 16 / 51 Spline Interpolation X Define Since c n s n 1(x n )/2 we have s j+1(x j+1 ) = s j (x j+1 ), j = 0,..., n 2 s j (x) = 2c j + 6d j (x x j ) s j (x j+1 ) = 2c j + 6d j h j s j+1(x j+1 ) = 2c j+1
17 Spline Interpolation XI Thus so (3) becomes d j = c j+1 c j 3h j a j+1 = a j + b j h j + c j h 2 j + c j+1 c j 3h j = a j + b j h j + h2 j 3 (2c j + c j+1 ), j = 0,..., n (6) 1 h 3 j Chih-Jen Lin (National Taiwan Univ.) 17 / 51
18 Spline Interpolation XII (5) becomes b j+1 = b j + 2c j h j + 3d j h 2 j = b j + 2c j h j + 3 c j+1 c j hj 2 3h j = b j + 2c j h j + h j (c j+1 c j ) = b j + h j (c j + c j+1 ), j = 0,..., n 1 (7) We have known a j, unknowns: b j, c j Chih-Jen Lin (National Taiwan Univ.) 18 / 51
19 Spline Interpolation XIII From (6) b j = 1 h j (a j+1 a j ) h j 3 (2c j + c j+1 ), j = 0,..., n 1 That is b j 1 = 1 h j 1 (a j a j 1 ) h j 1 3 (2c j 1 + c j ), j = 1,..., n Chih-Jen Lin (National Taiwan Univ.) 19 / 51
20 Spline Interpolation XIV Substituting to (7) 1 h j (a j+1 a j ) h j 3 (2c j + c j+1 ) = 1 h j 1 (a j a j 1 ) h j 1 3 (2c j 1 + c j ) + h j 1 (c j 1 + c j ), j = 1,..., n 1 j cannot be zero now because b j = b j 1 +, j = 1,..., n Chih-Jen Lin (National Taiwan Univ.) 20 / 51
21 Spline Interpolation XV Finally so h j 1 3 c j 1 + 2(h j 1 + h j ) c j + h j 3 3 c j+1 = 1 (a j+1 a j ) 1 (a j a j 1 ) h j h j 1 h j 1 c j 1 + 2(h j 1 + h j )c j + h j c j+1 = 3 (a j+1 a j ) 3 (a j a j 1 ), j = 1,..., n (8) 1 h j h j 1 Chih-Jen Lin (National Taiwan Univ.) 21 / 51
22 Spline Interpolation XVI Only unknowns: c j, j = 0,..., n Once we know c j, then we can find b j and d j Boundary conditions If s 0 (x 0) = s n 1 (x n) = 0 then s 0 (x) = 2c 0 + 6d 0 (x x 0 ) s 0 (x 0 ) = 2c 0 = 0, s n 1(x n ) = 2c n = 0 (9) Solve c j, j = 0,..., n using (n + 1) equalities: (8) and (9) Chih-Jen Lin (National Taiwan Univ.) 22 / 51
23 Spline Interpolation XVII We can use other boundary conditions: Example: s 0(x 0 ) = f (x 0 ) and s n 1(x n ) = f (x n ) >> x = [ ] ; >> y = [ ] ; >> yy=interp1(x,y,-2:0.1:2, spline ) ; >> plot(-2:0.1:2,yy); Chih-Jen Lin (National Taiwan Univ.) 23 / 51
24 Spline Interpolation XVIII Chih-Jen Lin (National Taiwan Univ.) 24 / 51
25 Spline Interpolation XIX >> [sp] = spline(x,y) sp = form: pp breaks: [ ] coefs: [4x4 double] pieces: 4 order: 4 dim: 1 spline: returns the spline structure interp1: 1-D interpolation and returns the approximate function value Chih-Jen Lin (National Taiwan Univ.) 25 / 51
26 Spline Interpolation XX Homework 8-1: Write a program which can solve general spline problems. Test your program by using some data and compare with the result of Matlab Chih-Jen Lin (National Taiwan Univ.) 26 / 51
27 Function Approximation I Given data points (x i, y i ), i = 1,..., n Find a function to approximate these points Why not just fitting them? That is, y i = f (x i ), i = 1,..., n. Data have noise. There are outliers Chih-Jen Lin (National Taiwan Univ.) 27 / 51
28 Function Approximation II Chih-Jen Lin (National Taiwan Univ.) 28 / 51
29 Function Approximation III If fitting all data, functions are not generalized enough for future use Generalization: Data under some distribution Given some samples, your approximate f has the trend Minimizing the error: min f (y i f (x i )) 2 (10) or min f y i f (x i ) Chih-Jen Lin (National Taiwan Univ.) 29 / 51
30 Function Approximation IV with f (x) = ax + b Assume x R 1, y R 1 (10): least square approximation why (10): easier calculation Chih-Jen Lin (National Taiwan Univ.) 30 / 51
31 Least Square Approximation I Finding a and b. Let E = (y i (ax i + b)) 2 Chih-Jen Lin (National Taiwan Univ.) 31 / 51
32 Least Square Approximation II Then min a,b min a,b min a,b (y i (ax i + b)) 2 y 2 i 2y i (ax i + b) + (ax i + b) 2 2y i (ax i + b) + a 2 x 2 i + 2abx i + b 2 Chih-Jen Lin (National Taiwan Univ.) 32 / 51
33 Least Square Approximation III ( min ( a,b +( 2y i x i )a + ( 2y i )b + ( ) 2x i )ab + nb 2 x 2 i )a 2 Chih-Jen Lin (National Taiwan Univ.) 33 / 51
34 Least Square Approximation IV First derivative E a = 0 ( 2y i x i ) + 2( E b = 0 ( 2y i ) + ( x 2 i )a + ( 2x i )b = 0 2x i )a + 2nb = 0 Chih-Jen Lin (National Taiwan Univ.) 34 / 51
35 Least Square Approximation V Rearrange terms: Define S xx = S xy = x 2 i, S x = x i y i, S y = x i y i Chih-Jen Lin (National Taiwan Univ.) 35 / 51
36 Least Square Approximation VI Now Then Issues: S xx a + S x b = S xy S x a + nb = S y a = ns xy S x S y ns xx S 2 x b = S xxs y S x S xy ns xx S 2 x Chih-Jen Lin (National Taiwan Univ.) 36 / 51
37 Least Square Approximation VII Does E = 0 imply optimality? We need secondary derivative (i.e. 2 E) to be positive semi-definite [ E ] 2 E E = a a a b E E [ b a b b] 2Sxx 2S = x 2S x 2n Chih-Jen Lin (National Taiwan Univ.) 37 / 51
38 Least Square Approximation VIII S xx > 0, n > 0, and determinant: = S xx n Sx ( x 2 i x i ) 2 0 Remember (a 1 b a n b n ) 2 (a a 2 n)(b b 2 n) Chih-Jen Lin (National Taiwan Univ.) 38 / 51
39 Least Square Approximation IX Nonlinear least-square min f E = m (y i f (x i )) 2 with f (x) = ax 2 + bx + c Quadratic least square Now you have three variables and three equations Homework Write down the three equations of E = 0 Chih-Jen Lin (National Taiwan Univ.) 39 / 51
40 Least Square Approximation X 2 Write a program doing quadratic least square 3 Randomly generate some (x i, y i ) and draw a figure showing your approximation Chih-Jen Lin (National Taiwan Univ.) 40 / 51
41 Data in Higher Dimensional Space I If x R m, m > 1 f (x) = a T x + b, a R m Let E = (y i (a T x i + b)) 2 Chih-Jen Lin (National Taiwan Univ.) 41 / 51
42 Data in Higher Dimensional Space II Then n min (y i (a T x i + b)) 2 a,b min a,b min a,b min n n ( n a,b n y 2 i 2y i (a T x i + b) + (a T x i + b) 2 2y i(a T x i + b) + (a T x i ) 2 + 2ba T x i + b 2y ix i ) T a + ( n (at x i ) 2 + ( n 2y i)b + 2x i) T ab + nb 2 Chih-Jen Lin (National Taiwan Univ.) 42 / 51
43 Data in Higher Dimensional Space III First derivative E a = 0 ( 2y i x i ) + 2 (a T x i )x i + ( 2x i )b = 0 E b = 0 ( 2y i ) + ( 2x i ) T a + 2nb = 0 Chih-Jen Lin (National Taiwan Univ.) 43 / 51
44 Data in Higher Dimensional Space IV Note (a T x i )x i = x i xi T : an m by m matrix Define S xx = S xy = x i x T i, S x = y i x i, S y = x i xi T a x i y i Chih-Jen Lin (National Taiwan Univ.) 44 / 51
45 Data in Higher Dimensional Space V Solve a linear system of a and b [ ] [ ] Sxx S x a Sx T = n b m + 1 variables [ Sxy S y ] Chih-Jen Lin (National Taiwan Univ.) 45 / 51
46 Application: Time Series Prediction I Given (y 1,, y n ) as known series Predict y n+1,..., Error propagation is the usual difficulty Chih-Jen Lin (National Taiwan Univ.) 46 / 51
47 A Practical Example I Electricity load forecasting. Given Electricity load per half hour from 1997 to 1998 Average daily temperature from 1995 to 1998 List of holidays Goal: Predict daily maximal load of January 1999 i.e., predict 31 values Chih-Jen Lin (National Taiwan Univ.) 47 / 51
48 Regression for Time Series Prediction I Finding a function f (x) = a T x + b Consider (y t,, y t 1 ) as attributes (features) of x i y t as the target value y i : usually called embedding dimension Solving (a, b) using (x 1, y 1 ),..., (x n, y n ) One-step ahead prediction Chih-Jen Lin (National Taiwan Univ.) 48 / 51
49 Regression for Time Series Prediction II Prediction: Starting from the last segment (y n +1,..., y n ) ŷ n+1 Repeat by using newly predicted values Chih-Jen Lin (National Taiwan Univ.) 49 / 51
50 Evaluation of Time Series Prediction I MSE (Mean Square Error): (y i ŷ i ) 2 MAPE (Mean absolute percentage error) 1 n y i ŷ i y i Error propagation: larger error later Unfair to earlier prediction if MSE is used Chih-Jen Lin (National Taiwan Univ.) 50 / 51
51 Evaluation of Time Series Prediction II There are other criteria Chih-Jen Lin (National Taiwan Univ.) 51 / 51
Cubic Splines MATH 375. J. Robert Buchanan. Fall Department of Mathematics. J. Robert Buchanan Cubic Splines
Cubic Splines MATH 375 J. Robert Buchanan Department of Mathematics Fall 2006 Introduction Given data {(x 0, f(x 0 )), (x 1, f(x 1 )),...,(x n, f(x n ))} which we wish to interpolate using a polynomial...
More informationExam 2. Average: 85.6 Median: 87.0 Maximum: Minimum: 55.0 Standard Deviation: Numerical Methods Fall 2011 Lecture 20
Exam 2 Average: 85.6 Median: 87.0 Maximum: 100.0 Minimum: 55.0 Standard Deviation: 10.42 Fall 2011 1 Today s class Multiple Variable Linear Regression Polynomial Interpolation Lagrange Interpolation Newton
More informationComputational Physics
Interpolation, Extrapolation & Polynomial Approximation Lectures based on course notes by Pablo Laguna and Kostas Kokkotas revamped by Deirdre Shoemaker Spring 2014 Introduction In many cases, a function
More informationMR. YATES. Vocabulary. Quadratic Cubic Monomial Binomial Trinomial Term Leading Term Leading Coefficient
ALGEBRA II WITH TRIGONOMETRY COURSE OUTLINE SPRING 2009. MR. YATES Vocabulary Unit 1: Polynomials Scientific Notation Exponent Base Polynomial Degree (of a polynomial) Constant Linear Quadratic Cubic Monomial
More informationEmpirical Models Interpolation Polynomial Models
Mathematical Modeling Lia Vas Empirical Models Interpolation Polynomial Models Lagrange Polynomial. Recall that two points (x 1, y 1 ) and (x 2, y 2 ) determine a unique line y = ax + b passing them (obtained
More information!"#$%&'(&)*$%&+",#$$-$%&+./#-+ (&)*$%&+%"-$+0!#1%&
!"#$%&'(&)*$%&",#$$-$%&./#- (&)*$%&%"-$0!#1%&23 44444444444444444444444444444444444444444444444444444444444444444444 &53.67689:5;978?58"@A9;8=B!=89C7DE,6=8FG=CD=CF(76F9C7D!)#!/($"%*$H!I"%"&1/%/.!"JK$&3
More informationTABLE OF CONTENTS INTRODUCTION, APPROXIMATION & ERRORS 1. Chapter Introduction to numerical methods 1 Multiple-choice test 7 Problem set 9
TABLE OF CONTENTS INTRODUCTION, APPROXIMATION & ERRORS 1 Chapter 01.01 Introduction to numerical methods 1 Multiple-choice test 7 Problem set 9 Chapter 01.02 Measuring errors 11 True error 11 Relative
More informationInput: A set (x i -yy i ) data. Output: Function value at arbitrary point x. What for x = 1.2?
Applied Numerical Analysis Interpolation Lecturer: Emad Fatemizadeh Interpolation Input: A set (x i -yy i ) data. Output: Function value at arbitrary point x. 0 1 4 1-3 3 9 What for x = 1.? Interpolation
More informationCurve Fitting and Interpolation
Chapter 5 Curve Fitting and Interpolation 5.1 Basic Concepts Consider a set of (x, y) data pairs (points) collected during an experiment, Curve fitting: is a procedure to develop or evaluate mathematical
More informationInterpolation Theory
Numerical Analysis Massoud Malek Interpolation Theory The concept of interpolation is to select a function P (x) from a given class of functions in such a way that the graph of y P (x) passes through the
More informationMTH5112 Linear Algebra I MTH5212 Applied Linear Algebra (2017/2018)
MTH5112 Linear Algebra I MTH5212 Applied Linear Algebra (2017/2018) COURSEWORK 3 SOLUTIONS Exercise ( ) 1. (a) Write A = (a ij ) n n and B = (b ij ) n n. Since A and B are diagonal, we have a ij = 0 and
More informationIncoming Magnet Precalculus / Functions Summer Review Assignment
Incoming Magnet recalculus / Functions Summer Review ssignment Students, This assignment should serve as a review of the lgebra and Geometry skills necessary for success in recalculus. These skills were
More information6. Multiple Reactions
6. Multiple Reactions o Selectivity and Yield o Reactions in Series - To give maximum selectivity o Algorithm for Multiple Reactions o Applications of Algorithm o Multiple Reactions-Gas Phase 0. Types
More informationSeventeen generic formulas that may generate prime-producing quadratic polynomials
Seventeen generic formulas that may generate prime-producing quadratic polynomials Marius Coman Bucuresti, Romania email: mariuscoman13@gmail.com Abstract. In one of my previous papers I listed forty-two
More informationLeast squares regression
Curve Fitting Least squares regression Interpolation Two categories of curve fitting. 1. Linear least squares regression, determining the straight line that best fits data points. 2. Interpolation, determining
More information(308 ) EXAMPLES. 1. FIND the quotient and remainder when. II. 1. Find a root of the equation x* = +J Find a root of the equation x 6 = ^ - 1.
(308 ) EXAMPLES. N 1. FIND the quotient and remainder when is divided by x 4. I. x 5 + 7x* + 3a; 3 + 17a 2 + 10* - 14 2. Expand (a + bx) n in powers of x, and then obtain the first derived function of
More informationLycée des arts Math Grade Algebraic expressions S.S.4
Lycée des arts Math Grade 9 015-016 lgebraic expressions S.S.4 Exercise I: Factorize each of the following algebraic expressions, and then determine its real roots. (x) = 4x (3x 1) (x + ) (3x 1) + 3x 1
More information3.1 Interpolation and the Lagrange Polynomial
MATH 4073 Chapter 3 Interpolation and Polynomial Approximation Fall 2003 1 Consider a sample x x 0 x 1 x n y y 0 y 1 y n. Can we get a function out of discrete data above that gives a reasonable estimate
More information1 Piecewise Cubic Interpolation
Piecewise Cubic Interpolation Typically the problem with piecewise linear interpolation is the interpolant is not differentiable as the interpolation points (it has a kinks at every interpolation point)
More informationLinear Regression Spring 2014
Linear Regression 18.05 Spring 2014 Agenda Fitting curves to bivariate data Measuring the goodness of fit The fit vs. complexity tradeoff Regression to the mean Multiple linear regression January 1, 2017
More informationMathB65 Ch 4 VII, VIII, IX.notebook. November 06, 2017
Chapter 4: Polynomials I. Exponents & Their Properties II. Negative Exponents III. Scientific Notation IV. Polynomials V. Addition & Subtraction of Polynomials VI. Multiplication of Polynomials VII. Greatest
More informationNovember 20, Interpolation, Extrapolation & Polynomial Approximation
Interpolation, Extrapolation & Polynomial Approximation November 20, 2016 Introduction In many cases we know the values of a function f (x) at a set of points x 1, x 2,..., x N, but we don t have the analytic
More informationSummer Packet for Students Taking Introduction to Calculus in the Fall
Summer Packet for Students Taking Introduction to Calculus in the Fall Algebra 2 Topics Needed for Introduction to Calculus Need to know: à Solve Equations Linear Quadratic Absolute Value Polynomial Rational
More informationSummer Review Packet. for students entering. IB Math SL
Summer Review Packet for students entering IB Math SL The problems in this packet are designed to help you review topics that are important to your success in IB Math SL. Please attempt the problems on
More informationChapter 3 Interpolation and Polynomial Approximation
Chapter 3 Interpolation and Polynomial Approximation Per-Olof Persson persson@berkeley.edu Department of Mathematics University of California, Berkeley Math 128A Numerical Analysis Polynomial Interpolation
More informationVector and Matrix Norms I
Vector and Matrix Norms I Scalar, vector, matrix How to calculate errors? Scalar: absolute error: ˆα α relative error: Vectors: vector norm Norm is the distance!! ˆα α / α Chih-Jen Lin (National Taiwan
More informationINTERPOLATION. and y i = cos x i, i = 0, 1, 2 This gives us the three points. Now find a quadratic polynomial. p(x) = a 0 + a 1 x + a 2 x 2.
INTERPOLATION Interpolation is a process of finding a formula (often a polynomial) whose graph will pass through a given set of points (x, y). As an example, consider defining and x 0 = 0, x 1 = π/4, x
More informationPreliminaries Lectures. Dr. Abdulla Eid. Department of Mathematics MATHS 101: Calculus I
Preliminaries 2 1 2 Lectures Department of Mathematics http://www.abdullaeid.net/maths101 MATHS 101: Calculus I (University of Bahrain) Prelim 1 / 35 Pre Calculus MATHS 101: Calculus MATHS 101 is all about
More informationVector and Matrix Norms I
Vector and Matrix Norms I Scalar, vector, matrix How to calculate errors? Scalar: absolute error: ˆα α relative error: Vectors: vector norm Norm is the distance!! ˆα α / α Chih-Jen Lin (National Taiwan
More informationPreliminary Examination in Numerical Analysis
Department of Applied Mathematics Preliminary Examination in Numerical Analysis August 7, 06, 0 am pm. Submit solutions to four (and no more) of the following six problems. Show all your work, and justify
More informationLinear Models 1. Isfahan University of Technology Fall Semester, 2014
Linear Models 1 Isfahan University of Technology Fall Semester, 2014 References: [1] G. A. F., Seber and A. J. Lee (2003). Linear Regression Analysis (2nd ed.). Hoboken, NJ: Wiley. [2] A. C. Rencher and
More informationSome notes on Chapter 8: Polynomial and Piecewise-polynomial Interpolation
Some notes on Chapter 8: Polynomial and Piecewise-polynomial Interpolation See your notes. 1. Lagrange Interpolation (8.2) 1 2. Newton Interpolation (8.3) different form of the same polynomial as Lagrange
More informationInterpolation (Shape Functions)
Mètodes Numèrics: A First Course on Finite Elements Interpolation (Shape Functions) Following: Curs d Elements Finits amb Aplicacions (J. Masdemont) http://hdl.handle.net/2099.3/36166 Dept. Matemàtiques
More informationUNIVERSIDAD CARLOS III DE MADRID Escuela Politécnica Superior Departamento de Matemáticas
UNIVERSIDAD CARLOS III DE MADRID Escuela Politécnica Superior Departamento de Matemáticas a t e a t i c a s PROBLEMS, CALCULUS I, st COURSE 2. DIFFERENTIAL CALCULUS IN ONE VARIABLE BACHELOR IN: Audiovisual
More informationSouthington High School 720 Pleasant Street Southington, CT 06489
BLUE KNIGHTS Southington High School 720 Pleasant Street Southington, CT 06489 Phone: (860) 628-3229 Fax: (860) 628-3397 Home Page: www.southingtonschools.org Principal Brian Stranieri Assistant Principals
More informationSequences and Series
CHAPTER Sequences and Series.. Convergence of Sequences.. Sequences Definition. Suppose that fa n g n= is a sequence. We say that lim a n = L; if for every ">0 there is an N>0 so that whenever n>n;ja n
More informationSolving Dense Linear Systems I
Solving Dense Linear Systems I Solving Ax = b is an important numerical method Triangular system: [ l11 l 21 if l 11, l 22 0, ] [ ] [ ] x1 b1 = l 22 x 2 b 2 x 1 = b 1 /l 11 x 2 = (b 2 l 21 x 1 )/l 22 Chih-Jen
More informationChapter 4: Interpolation and Approximation. October 28, 2005
Chapter 4: Interpolation and Approximation October 28, 2005 Outline 1 2.4 Linear Interpolation 2 4.1 Lagrange Interpolation 3 4.2 Newton Interpolation and Divided Differences 4 4.3 Interpolation Error
More informationLINEAR INEQUALITIES. Chapter Overview
LINEAR INEQUALITIES Chapter 6 6.1 Overview 6.1.1 A statement involving the symbols >, 3, x 4, x + y 9. (ii) (iii) (iv) (v) Inequalities which do not involve
More informationScientific Computing
2301678 Scientific Computing Chapter 2 Interpolation and Approximation Paisan Nakmahachalasint Paisan.N@chula.ac.th Chapter 2 Interpolation and Approximation p. 1/66 Contents 1. Polynomial interpolation
More informationInterpolation. 1. Judd, K. Numerical Methods in Economics, Cambridge: MIT Press. Chapter
Key References: Interpolation 1. Judd, K. Numerical Methods in Economics, Cambridge: MIT Press. Chapter 6. 2. Press, W. et. al. Numerical Recipes in C, Cambridge: Cambridge University Press. Chapter 3
More informationMath Numerical Analysis Mid-Term Test Solutions
Math 400 - Numerical Analysis Mid-Term Test Solutions. Short Answers (a) A sufficient and necessary condition for the bisection method to find a root of f(x) on the interval [a,b] is f(a)f(b) < 0 or f(a)
More informationSTAT 111 Recitation 7
STAT 111 Recitation 7 Xin Lu Tan xtan@wharton.upenn.edu October 25, 2013 1 / 13 Miscellaneous Please turn in homework 6. Please pick up homework 7 and the graded homework 5. Please check your grade and
More informationChapter 1 Numerical approximation of data : interpolation, least squares method
Chapter 1 Numerical approximation of data : interpolation, least squares method I. Motivation 1 Approximation of functions Evaluation of a function Which functions (f : R R) can be effectively evaluated
More informationPolynomials and Factoring
Polynomials and Factoring Jeffrey Shi January 26, 2016 1 Polynomials 1.1 Definition Definition 1 (Polynomial) A polynomial is an algebraic expression involving one or more terms with one or more unknown
More informationLecture 7. Please note. Additional tutorial. Please note that there is no lecture on Tuesday, 15 November 2011.
Lecture 7 3 Ordinary differential equations (ODEs) (continued) 6 Linear equations of second order 7 Systems of differential equations Please note Please note that there is no lecture on Tuesday, 15 November
More information1. Definition of a Polynomial
1. Definition of a Polynomial What is a polynomial? A polynomial P(x) is an algebraic expression of the form Degree P(x) = a n x n + a n 1 x n 1 + a n 2 x n 2 + + a 3 x 3 + a 2 x 2 + a 1 x + a 0 Leading
More informationLecture 10 Polynomial interpolation
Lecture 10 Polynomial interpolation Weinan E 1,2 and Tiejun Li 2 1 Department of Mathematics, Princeton University, weinan@princeton.edu 2 School of Mathematical Sciences, Peking University, tieli@pku.edu.cn
More informationTaylor Series and Numerical Approximations
Taylor Series and Numerical Approximations Hilary Weller h.weller@reading.ac.uk August 7, 05 An introduction to the concept of a Taylor series and how these are used in numerical analysis to find numerical
More informationSolving simple equations, a review/primer
ucsc supplementary notes ams/econ 11a Solving simple equations, a review/primer c 2012 Yonatan Katznelson Differential and integral calculus do not replace algebra, they build on it When working problems
More informationPolynomial expression
1 Polynomial expression Polynomial expression A expression S(x) in one variable x is an algebraic expression in x term as Where an,an-1,,a,a0 are constant and real numbers and an is not equal to zero Some
More informationTo Find the Product of Monomials. ax m bx n abx m n. Let s look at an example in which we multiply two monomials. (3x 2 y)(2x 3 y 5 )
5.4 E x a m p l e 1 362SECTION 5.4 OBJECTIVES 1. Find the product of a monomial and a polynomial 2. Find the product of two polynomials 3. Square a polynomial 4. Find the product of two binomials that
More informationCubic Spline. s(x) = s j (x) = a j + b j (x x j ) + c j (x x j ) 2 + d j (x x j ) 3, j = 0,... n 1 (1)
Cubic Spline Suppose we are given a set of interpolating points (x i, y i ) for i = 0, 1, 2, n We seek to construct a piecewise cubic function s(x) that has the for x [[x j, x j+1 ] we have: s(x) = s j
More informationCubic Splines. Antony Jameson. Department of Aeronautics and Astronautics, Stanford University, Stanford, California, 94305
Cubic Splines Antony Jameson Department of Aeronautics and Astronautics, Stanford University, Stanford, California, 94305 1 References on splines 1. J. H. Ahlberg, E. N. Nilson, J. H. Walsh. Theory of
More informationJeff Howbert Introduction to Machine Learning Winter
Classification / Regression Support Vector Machines Jeff Howbert Introduction to Machine Learning Winter 2012 1 Topics SVM classifiers for linearly separable classes SVM classifiers for non-linearly separable
More information1. 4 2y 1 2 = x = x 1 2 x + 1 = x x + 1 = x = 6. w = 2. 5 x
.... VII x + x + = x x x 8 x x = x + a = a + x x = x + x x Solve the absolute value equations.. z = 8. x + 7 =. x =. x =. y = 7 + y VIII Solve the exponential equations.. 0 x = 000. 0 x+ = 00. x+ = 8.
More information3.0 INTRODUCTION 3.1 OBJECTIVES 3.2 SOLUTION OF QUADRATIC EQUATIONS. Structure
UNIT 3 EQUATIONS Equations Structure 3.0 Introduction 3.1 Objectives 3.2 Solution of Quadratic Equations 3.3 Quadratic Formula 3.4 Cubic and Bioquadratic Equations 3.5 Answers to Check Your Progress 3.6
More information5 Years (10 Semester) Integrated UG/PG Program in Physics & Electronics
Courses Offered: 5 Years (10 ) Integrated UG/PG Program in Physics & Electronics 2 Years (4 ) Course M. Sc. Physics (Specialization in Material Science) In addition to the presently offered specialization,
More informationCS 323: Numerical Analysis and Computing
CS 323: Numerical Analysis and Computing MIDTERM #2 Instructions: This is an open notes exam, i.e., you are allowed to consult any textbook, your class notes, homeworks, or any of the handouts from us.
More informationCALCULUS AB/BC SUMMER REVIEW PACKET (Answers)
Name CALCULUS AB/BC SUMMER REVIEW PACKET (Answers) I. Simplify. Identify the zeros, vertical asymptotes, horizontal asymptotes, holes and sketch each rational function. Show the work that leads to your
More informationThirty-Ninth Annual Columbus State Invitational Mathematics Tournament
Thirty-Ninth Annual Columbus State Invitational Mathematics Tournament Sponsored by The Columbus State University Department of Mathematics and Philosophy March nd, 0 ************************* Solutions
More informationAlgebraic Expressions
ALGEBRAIC EXPRESSIONS 229 Algebraic Expressions Chapter 12 12.1 INTRODUCTION We have already come across simple algebraic expressions like x + 3, y 5, 4x + 5, 10y 5 and so on. In Class VI, we have seen
More information5.3. Polynomials and Polynomial Functions
5.3 Polynomials and Polynomial Functions Polynomial Vocabulary Term a number or a product of a number and variables raised to powers Coefficient numerical factor of a term Constant term which is only a
More informationQ 0 x if x 0 x x 1. S 1 x if x 1 x x 2. i 0,1,...,n 1, and L x L n 1 x if x n 1 x x n
. - Piecewise Linear-Quadratic Interpolation Piecewise-polynomial Approximation: Problem: Givenn pairs of data points x i, y i, i,,...,n, find a piecewise-polynomial Sx S x if x x x Sx S x if x x x 2 :
More informationGATE Engineering Mathematics SAMPLE STUDY MATERIAL. Postal Correspondence Course GATE. Engineering. Mathematics GATE ENGINEERING MATHEMATICS
SAMPLE STUDY MATERIAL Postal Correspondence Course GATE Engineering Mathematics GATE ENGINEERING MATHEMATICS ENGINEERING MATHEMATICS GATE Syllabus CIVIL ENGINEERING CE CHEMICAL ENGINEERING CH MECHANICAL
More informationCurve Fitting. Objectives
Curve Fitting Objectives Understanding the difference between regression and interpolation. Knowing how to fit curve of discrete with least-squares regression. Knowing how to compute and understand the
More informationOutline. Basic concepts: SVM and kernels SVM primal/dual problems. Chih-Jen Lin (National Taiwan Univ.) 1 / 22
Outline Basic concepts: SVM and kernels SVM primal/dual problems Chih-Jen Lin (National Taiwan Univ.) 1 / 22 Outline Basic concepts: SVM and kernels Basic concepts: SVM and kernels SVM primal/dual problems
More informationBSM510 Numerical Analysis
BSM510 Numerical Analysis Polynomial Interpolation Prof. Manar Mohaisen Department of EEC Engineering Review of Precedent Lecture Polynomial Regression Multiple Linear Regression Nonlinear Regression Lecture
More informationCHAPTER 4. Interpolation
CHAPTER 4 Interpolation 4.1. Introduction We will cover sections 4.1 through 4.12 in the book. Read section 4.1 in the book on your own. The basic problem of one-dimensional interpolation is this: Given
More informationInterpolation and the Lagrange Polynomial
Interpolation and the Lagrange Polynomial MATH 375 J. Robert Buchanan Department of Mathematics Fall 2013 Introduction We often choose polynomials to approximate other classes of functions. Theorem (Weierstrass
More informationLecture 27. Quadratic Formula
Lecture 7 Quadratic Formula Goal: to solve any quadratic equation Quadratic formula 3 Plan Completing the square 5 Completing the square 6 Proving quadratic formula 7 Proving quadratic formula 8 Proving
More informationNew Introduction to Multiple Time Series Analysis
Helmut Lütkepohl New Introduction to Multiple Time Series Analysis With 49 Figures and 36 Tables Springer Contents 1 Introduction 1 1.1 Objectives of Analyzing Multiple Time Series 1 1.2 Some Basics 2
More informationTheory of Computation
Thomas Zeugmann Hokkaido University Laboratory for Algorithmics http://www-alg.ist.hokudai.ac.jp/ thomas/toc/ Lecture 13: Algorithmic Unsolvability The Halting Problem I In the last lecture we have shown
More informationMultiplication of Polynomials
Summary 391 Chapter 5 SUMMARY Section 5.1 A polynomial in x is defined by a finite sum of terms of the form ax n, where a is a real number and n is a whole number. a is the coefficient of the term. n is
More informationTopic 7: Polynomials. Introduction to Polynomials. Table of Contents. Vocab. Degree of a Polynomial. Vocab. A. 11x 7 + 3x 3
Topic 7: Polynomials Table of Contents 1. Introduction to Polynomials. Adding & Subtracting Polynomials 3. Multiplying Polynomials 4. Special Products of Binomials 5. Factoring Polynomials 6. Factoring
More informationData Analysis-I. Interpolation. Soon-Hyung Yook. December 4, Soon-Hyung Yook Data Analysis-I December 4, / 1
Data Analysis-I Interpolation Soon-Hyung Yook December 4, 2015 Soon-Hyung Yook Data Analysis-I December 4, 2015 1 / 1 Table of Contents Soon-Hyung Yook Data Analysis-I December 4, 2015 2 / 1 Introduction
More informationChapter 2 Interpolation
Chapter 2 Interpolation Experiments usually produce a discrete set of data points (x i, f i ) which represent the value of a function f (x) for a finite set of arguments {x 0...x n }. If additional data
More informationLecture Note 3: Interpolation and Polynomial Approximation. Xiaoqun Zhang Shanghai Jiao Tong University
Lecture Note 3: Interpolation and Polynomial Approximation Xiaoqun Zhang Shanghai Jiao Tong University Last updated: October 10, 2015 2 Contents 1.1 Introduction................................ 3 1.1.1
More informationAn Introduction to Probability Theory and Its Applications
An Introduction to Probability Theory and Its Applications WILLIAM FELLER (1906-1970) Eugene Higgins Professor of Mathematics Princeton University VOLUME II SECOND EDITION JOHN WILEY & SONS Contents I
More informationI) Simplifying fractions: x x. 1) 1 1 y x. 1 1 x 1. 4 x. 13x. x y xy. x 2. Factoring: 10) 13) 12) III) Solving: x 9 Prime (using only) 11)
AP Calculus Summer Packet Answer Key Reminders:. This is not an assignment.. This will not be collected.. You WILL be assessed on these skills at various times throughout the course.. You are epected to
More informationIntroduction Linear system Nonlinear equation Interpolation
Interpolation Interpolation is the process of estimating an intermediate value from a set of discrete or tabulated values. Suppose we have the following tabulated values: y y 0 y 1 y 2?? y 3 y 4 y 5 x
More informationIn practice one often meets a situation where the function of interest, f(x), is only represented by a discrete set of tabulated points,
1 Interpolation 11 Introduction In practice one often meets a situation where the function of interest, f(x), is only represented by a discrete set of tabulated points, {x i, y i = f(x i ) i = 1 n, obtained,
More informationMHF4U Unit 2 Polynomial Equation and Inequalities
MHF4U Unit 2 Polynomial Equation and Inequalities Section Pages Questions Prereq Skills 82-83 # 1ac, 2ace, 3adf, 4, 5, 6ace, 7ac, 8ace, 9ac 2.1 91 93 #1, 2, 3bdf, 4ac, 5, 6, 7ab, 8c, 9ad, 10, 12, 15a,
More informationAnalysis of Ordinary Differential Equations
Analysis of Ordinary Differential Equations J. M. Cushing Department of Mathematics Interdisciplinary Program in Applied Mathematics University of Arizona, Tucson, AZ Version 5 August 208 Copyright 208,
More informationSECTION 7: CURVE FITTING. MAE 4020/5020 Numerical Methods with MATLAB
SECTION 7: CURVE FITTING MAE 4020/5020 Numerical Methods with MATLAB 2 Introduction Curve Fitting 3 Often have data,, that is a function of some independent variable,, but the underlying relationship is
More informationS56 (5.1) Polynomials.notebook August 25, 2016
Q1. Simplify Daily Practice 28.6.2016 Q2. Evaluate Today we will be learning about Polynomials. Q3. Write in completed square form x 2 + 4x + 7 Q4. State the equation of the line joining (0, 3) and (4,
More informationChapter 2 notes from powerpoints
Chapter 2 notes from powerpoints Synthetic division and basic definitions Sections 1 and 2 Definition of a Polynomial Function: Let n be a nonnegative integer and let a n, a n-1,, a 2, a 1, a 0 be real
More informationApplied Numerical Analysis Homework #3
Applied Numerical Analysis Homework #3 Interpolation: Splines, Multiple dimensions, Radial Bases, Least-Squares Splines Question Consider a cubic spline interpolation of a set of data points, and derivatives
More informationCHAPTER 1. Review of Algebra
CHAPTER 1 Review of Algebra Much of the material in this chapter is revision from GCSE maths (although some of the exercises are harder). Some of it particularly the work on logarithms may be new if you
More informationWiley. Methods and Applications of Linear Models. Regression and the Analysis. of Variance. Third Edition. Ishpeming, Michigan RONALD R.
Methods and Applications of Linear Models Regression and the Analysis of Variance Third Edition RONALD R. HOCKING PenHock Statistical Consultants Ishpeming, Michigan Wiley Contents Preface to the Third
More informationBD1. Reciprocal space and Fourier transforms. IB Mineral Sciences Module B: Reciprocal Space, Symmetry and Crystallography
Reciprocal space and Fourier transforms The aim of this practical is to give you a chance to develop your intuition about the relationship between real space and reciprocal space. There are two halves
More informationInterpolation APPLIED PROBLEMS. Reading Between the Lines FLY ROCKET FLY, FLY ROCKET FLY WHAT IS INTERPOLATION? Figure Interpolation of discrete data.
WHAT IS INTERPOLATION? Given (x 0,y 0 ), (x,y ), (x n,y n ), find the value of y at a value of x that is not given. Interpolation Reading Between the Lines Figure Interpolation of discrete data. FLY ROCKET
More informationA polynomial expression is the addition or subtraction of many algebraic terms with positive integer powers.
LEAVING CERT Honours Maths notes on Algebra. A polynomial expression is the addition or subtraction of many algebraic terms with positive integer powers. The degree is the highest power of x. 3x 2 + 2x
More informationMHF4U. Advanced Functions Grade 12 University Mitchell District High School. Unit 2 Polynomial Functions 9 Video Lessons
MHF4U Advanced Functions Grade 12 University Mitchell District High School Unit 2 Polynomial Functions 9 Video Lessons Allow no more than 15 class days for this unit! This includes time for review and
More informationChapter 1: Precalculus Review
: Precalculus Review Math 115 17 January 2018 Overview 1 Important Notation 2 Exponents 3 Polynomials 4 Rational Functions 5 Cartesian Coordinates 6 Lines Notation Intervals: Interval Notation (a, b) (a,
More informationKing Fahd University of Petroleum and Minerals Prep-Year Math Program Math Term 161 Recitation (R1, R2)
Math 001 - Term 161 Recitation (R1, R) Question 1: How many rational and irrational numbers are possible between 0 and 1? (a) 1 (b) Finite (c) 0 (d) Infinite (e) Question : A will contain how many elements
More informationInterpolation and extrapolation
Interpolation and extrapolation Alexander Khanov PHYS6260: Experimental Methods is HEP Oklahoma State University October 30, 207 Interpolation/extrapolation vs fitting Formulation of the problem: there
More informationTutorial 1, B. Tech. Sem III, 24 July, (Root Findings and Linear System of Equations)
Tutorial, B. Tech. Sem III, 24 July, 206 (Root Findings and Linear System of Equations). Find the root of the equation e x = 3x lying in [0,] correct to three decimal places using Bisection, Regula-Falsi
More informationMir Md. Maruf Morshed
Investigation of External Acoustic Loadings on a Launch Vehicle Fairing During Lift-off Supervisors: Professor Colin H. Hansen Associate Professor Anthony C. Zander School of Mechanical Engineering South
More informationPattern Recognition and Machine Learning
Christopher M. Bishop Pattern Recognition and Machine Learning ÖSpri inger Contents Preface Mathematical notation Contents vii xi xiii 1 Introduction 1 1.1 Example: Polynomial Curve Fitting 4 1.2 Probability
More information