DATA FITTING. Intensive Computation 2013/2014. Annalisa Massini

Similar documents
Numerical Analysis Topic 4: Least Squares Curve Fitting

Regression. By Jugal Kalita Based on Chapter 17 of Chapra and Canale, Numerical Methods for Engineers

CURVE FITTING LEAST SQUARES METHOD

PubH 7405: REGRESSION ANALYSIS REGRESSION IN MATRIX TERMS

Chapter Gauss-Seidel Method

12 Iterative Methods. Linear Systems: Gauss-Seidel Nonlinear Systems Case Study: Chemical Reactions

CHAPTER 6 CURVE FITTINGS

The z-transform. LTI System description. Prof. Siripong Potisuk

Area and the Definite Integral. Area under Curve. The Partition. y f (x) We want to find the area under f (x) on [ a, b ]

Chapter 2 Intro to Math Techniques for Quantum Mechanics

CS321. Introduction to Numerical Methods

St John s College. UPPER V Mathematics: Paper 1 Learning Outcome 1 and 2. Examiner: GE Marks: 150 Moderator: BT / SLS INSTRUCTIONS AND INFORMATION

ITERATIVE METHODS FOR SOLVING SYSTEMS OF LINEAR ALGEBRAIC EQUATIONS

In Calculus I you learned an approximation method using a Riemann sum. Recall that the Riemann sum is

Chapter 3 Supplemental Text Material

Describes techniques to fit curves (curve fitting) to discrete data to obtain intermediate estimates.

CS321. Numerical Analysis

Chapter 17. Least Square Regression

Chapter Linear Regression

3/20/2013. Splines There are cases where polynomial interpolation is bad overshoot oscillations. Examplef x. Interpolation at -4,-3,-2,-1,0,1,2,3,4

Computer Programming

Multiple Choice Test. Chapter Adequacy of Models for Regression

Objective of curve fitting is to represent a set of discrete data by a function (curve). Consider a set of discrete data as given in table.

Sequences and summations

Stats & Summary

INTERPOLATION(2) ELM1222 Numerical Analysis. ELM1222 Numerical Analysis Dr Muharrem Mercimek

Lecture 3-4 Solutions of System of Linear Equations

Chapter Unary Matrix Operations

Mathematics HL and further mathematics HL formula booklet

Preliminary Examinations: Upper V Mathematics Paper 1

COMPLEX NUMBERS AND DE MOIVRE S THEOREM

SUM PROPERTIES FOR THE K-LUCAS NUMBERS WITH ARITHMETIC INDEXES

More Regression Lecture Notes CE 311K - McKinney Introduction to Computer Methods Department of Civil Engineering The University of Texas at Austin

Module 2: Introduction to Numerical Analysis

Available online through

Chapter Simpson s 1/3 Rule of Integration. ( x)

Mathematics HL and further mathematics HL formula booklet

Advanced Algorithmic Problem Solving Le 3 Arithmetic. Fredrik Heintz Dept of Computer and Information Science Linköping University

On Several Inequalities Deduced Using a Power Series Approach

Rendering Equation. Linear equation Spatial homogeneous Both ray tracing and radiosity can be considered special case of this general eq.

ME 501A Seminar in Engineering Analysis Page 1

PGE 310: Formulation and Solution in Geosystems Engineering. Dr. Balhoff. Interpolation

Level-2 BLAS. Matrix-Vector operations with O(n 2 ) operations (sequentially) BLAS-Notation: S --- single precision G E general matrix M V --- vector

Chapter 7. Bounds for weighted sums of Random Variables

Lecture 12 APPROXIMATION OF FIRST ORDER DERIVATIVES

L5 Polynomial / Spline Curves

Linear Algebra Concepts

Numerical Differentiation and Integration

Chapter 2 Intro to Math Techniques for Quantum Mechanics

The definite Riemann integral

Linear Algebra Concepts

Numerical differentiation (Finite difference)

Roberto s Notes on Integral Calculus Chapter 4: Definite integrals and the FTC Section 2. Riemann sums

Objectives of Multiple Regression

POWERS OF COMPLEX PERSYMMETRIC ANTI-TRIDIAGONAL MATRICES WITH CONSTANT ANTI-DIAGONALS

Mathematics HL and further mathematics HL formula booklet

Fibonacci and Lucas Numbers as Tridiagonal Matrix Determinants

MATRIX AND VECTOR NORMS

MTH 146 Class 7 Notes

Probabilistic approach to the distribution of primes and to the proof of Legendre and Elliott-Halberstam conjectures VICTOR VOLFSON

Differential Entropy 吳家麟教授

Cooper and McGillem Chapter 4: Moments Linear Regression

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1

INTRODUCTION ( ) 1. Errors

Numerical Analysis Third Class Chemical Engineering Department University of Technology Assoc. Prof. Dr. Zaidoon Mohsin shakor

under the curve in the first quadrant.

1 Onto functions and bijections Applications to Counting

Chapter 12-b Integral Calculus - Extra

UNIVERSITI KEBANGSAAN MALAYSIA PEPERIKSAAN AKHIR SEMESTER I SESI AKADEMIK 2007/2008 IJAZAH SARJANAMUDA DENGAN KEPUJIAN NOVEMBER 2007 MASA : 3 JAM

A Technique for Constructing Odd-order Magic Squares Using Basic Latin Squares

On a class of analytic functions defined by Ruscheweyh derivative

Simple Linear Regression

6. Chemical Potential and the Grand Partition Function

European Journal of Mathematics and Computer Science Vol. 3 No. 1, 2016 ISSN ISSN

Introduction to mathematical Statistics

1 4 6 is symmetric 3 SPECIAL MATRICES 3.1 SYMMETRIC MATRICES. Defn: A matrix A is symmetric if and only if A = A, i.e., a ij =a ji i, j. Example 3.1.

MATH2999 Directed Studies in Mathematics Matrix Theory and Its Applications

Soo King Lim Figure 1: Figure 2: Figure 3: Figure 4: Figure 5: Figure 6: Figure 7: Figure 8: Figure 9: Figure 10: Figure 11:

ZETA REGULARIZATION METHOD APPLIED TO THE CALCULATION OF DIVERGENT DIVERGENT INTEGRALS

Mu Sequences/Series Solutions National Convention 2014

Lecture Notes 2. The ability to manipulate matrices is critical in economics.

Taylor s Series and Interpolation. Interpolation & Curve-fitting. CIS Interpolation. Basic Scenario. Taylor Series interpolates at a specific

Matrix. Definition 1... a1 ... (i) where a. are real numbers. for i 1, 2,, m and j = 1, 2,, n (iii) A is called a square matrix if m n.

19 22 Evaluate the integral by interpreting it in terms of areas. (1 x ) dx. y Write the given sum or difference as a single integral in

20 23 Evaluate the integral by interpreting it in terms of areas. (1 x ) dx. y 2 2

A Brief Introduction to Olympiad Inequalities

Analytical Approach for the Solution of Thermodynamic Identities with Relativistic General Equation of State in a Mixture of Gases

Review of Linear Algebra

arxiv:math/ v1 [math.gm] 8 Dec 2005

14.2 Line Integrals. determines a partition P of the curve by points Pi ( xi, y

6.6 Moments and Centers of Mass

CS473-Algorithms I. Lecture 3. Solving Recurrences. Cevdet Aykanat - Bilkent University Computer Engineering Department

APPLICATION OF THE CHEBYSHEV POLYNOMIALS TO APPROXIMATION AND CONSTRUCTION OF MAP PROJECTIONS

Chapter 1. Introduction. Fundamental Concepts. Introduction. Historical background. Historical background. Fundamental Concepts

Fast Fourier Transform 1) Legendre s Interpolation 2) Vandermonde Matrix 3) Roots of Unity 4) Polynomial Evaluation

this is the indefinite integral Since integration is the reverse of differentiation we can check the previous by [ ]

Lecture 9: Tolerant Testing

ENGI 4421 Propagation of Error Page 8-01

Assignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class)

Transcription:

DATA FITTING Itesve Computto 3/4 Als Mss

Dt fttg Dt fttg cocers the problem of fttg dscrete dt to obt termedte estmtes. There re two geerl pproches two curve fttg: Iterpolto Dt s ver precse. The strteg s to pss curve or seres of curves through ech of the pots. Appromto Dt ehbt sgfct degree of sctter. The strteg s to derve sgle curve tht represets the geerl tred of the dt.

Defto Iterpolto dt pots, obted b smplg or epermetto, represet the vlues of fucto ffor lmted umber of vlues of the depedet vrble f s fucto ble to descrbe the relto betwee the set of vlues d the set of vlues = f wth terpolto we c compute ew dt pots wth the rge of dscrete set of ow dt pots

Defto Gve sequece of rel vlues Gve vlue for ech We wt to fd fucto f - fucto fml such tht f = =,..,, re sd dt pot f s sd the terpolt for the gve pot

Defto There re m dfferet terpolto methods Some of the cocers to cosder whe choosg lgorthm re: How ccurte s the method? How epesve s t? How smooth s the terpolt? How m dt pots re eeded?

Iterpolto methods Smple terpolto methods re: Ler terpolto Poloml terpolto Sple terpolto

Ler terpolto Ler terpolto cosders prs of dt pots Gve, d b, b the terpolt s gve b: b b Ler terpolto s quc d es, but t s ot ver precse Wth ler terpolto the terpolt s ot dfferetble t the pot

Ler terpolto Emple 5 4 3 - - -3-4 -5 3 4 5 6 7 8

Poloml terpolto Poloml terpolto s geerlzto of ler terpolto We ow replce ths terpolt wth poloml of hgher degree Gve dt pots, we loo for the poloml of degree t most gog through ll the dt pots

Poloml terpolto Some questos re: Does the poloml est? If the poloml est, s t uque? If the poloml est d s uque, s t possble to compute t? Does the poloml tht terpoltes,f ppromte better th other polomls?

Poloml terpolto = Gve two pots,,, fd the poloml of degree oe pssg through the two pots s equvlet to fd the le pssg through the two gve pots rett che pss per due put ssegt = Gve three pots,,,,, fd the poloml of degree two pssg through the three pots s equvlet to fd the prbol = + + 3 pssg through the three gve pots

Poloml terpolto Hece =3 gve dt pots m=3 codtos dt pots belog to the prbol 3 coeffcets to determe I geerl: Number of codtos = Number of coeffcets to determe Well posed problem

Poloml terpolto Emple Gve the three dt pots,,, 9 we wt to comput the terpolt Frst pproch Method of udertermed coeffcets From the terpolto codtos we obt the sstem

Poloml terpolto I geerl: Gve pots, =,,, fd the terpolt s the poloml of degree t most - wth the method of udetermed coeffcets correspods to solve the ler equto sstem... c c c P c c c c c c c c c............

Poloml terpolto I geerl the sstem could hve o soluto, tht s the problem s ot well posed problem s well posed f the coeffcets mtr ot sgulr, tht s ts determt s ot Whe the ler sstem s ot es to solve we c use other pproch: Lgrge terpolto

Poloml terpolto Secod pproch - Lgrge The terpolt s the poloml: P _ = _ l _ + _ l _ + + l tht s the poloml s ler combto of the l poloml tht re Lgrge bss polomls wth s coeffcets

Poloml terpolto I the poloml: P _ = _ l _ + _ l _ + + l The Lgrge bss polomls re gve b: l j s - degree poloml d hs the propert:............ l j j j j j j j j j j se j se l j

Poloml terpolto Emple Compute the Lgrge terpolt terpoltg the dt pots,,, 9 We hve to compute the two degree poloml: P l l l l

Poloml terpolto The Lgrge bss polomls re: l l l

Poloml terpolto B substtutg we obt: Observe tht the poloml P obted b the Lgrge method s the sme obted wth the udetermed coffcets method 3 9 l l l P

Poloml terpolto The terpolt obted b poloml terpolto s clerl dfferetble Poloml terpolto lso hs some dsdvtges: Clcultg the terpoltg poloml s computtoll epesve compred to ler terpolto. the shpe of the resultg curve, especll for ver hgh or low vlues of, m be cotrr to commosese The terpolto error s proportol to the dstce betwee the dt pots to the power

Poloml terpolto Poloml terpolto m ehbt osclltor rtfcts, especll t the ed pots - Ruge's pheomeo

Sple terpolto Sple terpolto: s pecewce terpolto uses polomls ech tervl [, + ] uses low-degree polomls curs smller error th ler terpolto d the terpolt s smoother the terpolt s eser to evlute th hgh-degree poloml such s the terpolt does ot suffer from Ruge's pheomeo.

Sple terpolto I cubc sple ech pece s thrd-degree poloml It s es to compute Ech pece of the sple s poloml of the form p = 3 + b + c + d Sce we hve to determe the four coeffcets, b, c d d, we eed four equtos

Sple terpolto Two codtos re obted b mposg the pots belog to the poloml, tht s: = 3 + b + c + d + = + 3 + b + + c + + d The other two codtos re obted b usg the dervtves For emple we c mpose the frst dervtves mtch t the pots the secod dervtves mtch t the pots Note tht the dervtve of the poloml s ver smple d s: p' = 3 + b + c

Appromto If vlble dt re: lrge set ffected b errors t s possble cpturg the tred the dt b ssgg sgle fucto cross the etre rge. I the process we eplot the formto gve b dt, tg to ccout tht dt re ffected b errors We eed:. To choose the tpe of ppromtg fucto. To choose mesure of the dfferece betwee dt d ppromtg fucto

Ler ppromto Suppose tht there re prs of dt, {, }, =,,.., d plot of these dt ppers s Wht s plusble mthemtcl model descrbg d relto?

Ler ppromto Suppose vrble s relted to vrble d ther reltoshps c be epressed, geerl, s = g where g s the geerl epresso for fucto; s the depedet or respose vrble; s the depedet or epltor vrbles. If vlble dt show ler depedece t s possble to cosder regresso le For ech pot we hve: = + b + resdul tht s = + b + ε 8 6 4 4 5 6 7 8 9

Ler ppromto The questos re: Whch le s the most represettve? How c we chhose the coeffcets of the le? We m to mmse the resduls or errors: Resduls should be smll both postve d egtve resduls We eed fucto of resduls depedet of the sg, such s the bsolute vlue or the squre

Lest squre method The lest squres LS crtero requres tht the sum of the squres of resduls or errors, devtos s mmum tht s, b [ b]

Lest squre method Hece we wt determe d such tht the qutt s mmum tht s we wt to solve the sstem of orml equtos: ~ b ~ b b b, ] [ m ~ ~, b b b ] [ ] [

Lest squre method Ths results sstem wth two equtos d two uows Ths mmzto problem hs uque soluto The soluto of the sstem gves the coeffcets of the le relzg the best dt fttg the lest squre sese mb b

Lest squre method Dt c be ppromted wth poloml sted of le The poloml of secod degree gvg the best ft the lest squre sese s poloml the form: p ~ ~ b c~ where the coeffcets re determed b mposg: ~ ~, b, c ~ m, b, c [ m, b, c [ b p ] c]

Lest squre method Ths results the followg sstem of orml equtos: The soluto of the sstem gves the coeffcets of the prbol relzg the best dt fttg the lest squre sese c b c b c b c b 3 3 4

Lest squre method If the reltoshp betwee the depedet vrble d the depedet vrble s modelled s th order poloml the the sstem of orml equtos s: Poloml regresso fts oler reltoshp betwee the vlue of d the correspodg ~ ~ ~ ~ p

Lest squre method The poloml regresso model c be epressed mtr form Cosderg the mtr A The coeffcet mtr of the sstem of orml equtos s gve b: T A A......... A.....

Lest squre method The vector o the rght hd sde s gve b: The mtr form of the sstem of orml equtos s A T *A =A t To vod tht A T *A gves ll-codtoed sstem, severl methods of fctorzto re used. T A....

Lest squre method Emple of ler regresso d poloml regresso wth degree =, 3, 4.

Lest squre method A poloml wth hgher degree does ot ecessrl provde better ppromto. Aother pproch cosder ppromto fucto: tht uses fuctos φ d the mtr f A

Lest squre method As emple we c cosder the trgoometrc poloml T gvg the best ft the lest squre sese: T s s s I ths cse the mtr A s: A s s s s 3 s s s s 3 s s s s 3

Mtlb The Mtlb fucto polft gves both the terpolt poloml the lest squre sese ppromto poloml The st of polft s polft,, where d re the coordte vectors d s the degree of the poloml If = legth-, the we obt the terpolt poloml If < legth-, the we obt the lest squre sese ppromto poloml