CURVE FITTING LEAST SQUARES METHOD

Similar documents
More Regression Lecture Notes CE 311K - McKinney Introduction to Computer Methods Department of Civil Engineering The University of Texas at Austin

Regression. By Jugal Kalita Based on Chapter 17 of Chapra and Canale, Numerical Methods for Engineers

DATA FITTING. Intensive Computation 2013/2014. Annalisa Massini

ITERATIVE METHODS FOR SOLVING SYSTEMS OF LINEAR ALGEBRAIC EQUATIONS

APPLICATION OF THE CHEBYSHEV POLYNOMIALS TO APPROXIMATION AND CONSTRUCTION OF MAP PROJECTIONS

CS321. Numerical Analysis

Chapter 3 Supplemental Text Material

Numerical Analysis Topic 4: Least Squares Curve Fitting

MATRIX AND VECTOR NORMS

Chapter 17. Least Square Regression

Soo King Lim Figure 1: Figure 2: Figure 3: Figure 4: Figure 5: Figure 6: Figure 7: Figure 8: Figure 9: Figure 10: Figure 11:

Describes techniques to fit curves (curve fitting) to discrete data to obtain intermediate estimates.

CHAPTER 6 CURVE FITTINGS

Chapter Linear Regression

The z-transform. LTI System description. Prof. Siripong Potisuk

6.6 Moments and Centers of Mass

Chapter 2 Intro to Math Techniques for Quantum Mechanics

St John s College. UPPER V Mathematics: Paper 1 Learning Outcome 1 and 2. Examiner: GE Marks: 150 Moderator: BT / SLS INSTRUCTIONS AND INFORMATION

Chapter Gauss-Seidel Method

Multiple Choice Test. Chapter Adequacy of Models for Regression

PubH 7405: REGRESSION ANALYSIS REGRESSION IN MATRIX TERMS

COMPLEX NUMBERS AND DE MOIVRE S THEOREM

MTH 146 Class 7 Notes

PGE 310: Formulation and Solution in Geosystems Engineering. Dr. Balhoff. Interpolation

CS321. Introduction to Numerical Methods

7.0 Equality Contraints: Lagrange Multipliers

Area and the Definite Integral. Area under Curve. The Partition. y f (x) We want to find the area under f (x) on [ a, b ]

Chapter Unary Matrix Operations

Chapter 2 Intro to Math Techniques for Quantum Mechanics

INTERPOLATION(2) ELM1222 Numerical Analysis. ELM1222 Numerical Analysis Dr Muharrem Mercimek

Maximum Likelihood Estimation

On Solution of Min-Max Composition Fuzzy Relational Equation

2/20/2013. Topics. Power Flow Part 1 Text: Power Transmission. Power Transmission. Power Transmission. Power Transmission

Review of Linear Algebra

A Technique for Constructing Odd-order Magic Squares Using Basic Latin Squares

Algorithms behind the Correlation Setting Window

KURODA S METHOD FOR CONSTRUCTING CONSISTENT INPUT-OUTPUT DATA SETS. Peter J. Wilcoxen. Impact Research Centre, University of Melbourne.

12.2 Estimating Model parameters Assumptions: ox and y are related according to the simple linear regression model

Lecture 3-4 Solutions of System of Linear Equations

12 Iterative Methods. Linear Systems: Gauss-Seidel Nonlinear Systems Case Study: Chemical Reactions

Bond Additive Modeling 5. Mathematical Properties of the Variable Sum Exdeg Index

residual. (Note that usually in descriptions of regression analysis, upper-case

Introduction to mathematical Statistics

Statistical Modeling and Analysis of the Correlation between the Gross Domestic Product per Capita and the Life Expectancy

UNIT 2 SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS

Lecture 12 APPROXIMATION OF FIRST ORDER DERIVATIVES

Preliminary Examinations: Upper V Mathematics Paper 1

i+1 by A and imposes Ax

Non-degenerate Perturbation Theory

A Brief Introduction to Olympiad Inequalities

Autar Kaw Benjamin Rigsby. Transforming Numerical Methods Education for STEM Undergraduates

Some Different Perspectives on Linear Least Squares

Random variables and sampling theory

CS473-Algorithms I. Lecture 3. Solving Recurrences. Cevdet Aykanat - Bilkent University Computer Engineering Department

ENGI 3423 Simple Linear Regression Page 12-01

3.1 Introduction to Multinomial Logit and Probit

Analytical Approach for the Solution of Thermodynamic Identities with Relativistic General Equation of State in a Mixture of Gases

PAIR OF STRAIGHT LINES. will satisfy L1 L2 0, and thus L1 L. 0 represent? It is obvious that any point lying on L 1

4 Linear Homogeneous Recurrence Relation 4-1 Fibonacci Rabbits. 组合数学 Combinatorics

Some Unbiased Classes of Estimators of Finite Population Mean

Objective of curve fitting is to represent a set of discrete data by a function (curve). Consider a set of discrete data as given in table.

Simple Linear Regression

The Algebraic Least Squares Fitting Of Ellipses

Mu Sequences/Series Solutions National Convention 2014

Rendering Equation. Linear equation Spatial homogeneous Both ray tracing and radiosity can be considered special case of this general eq.

A METHOD FOR THE RAPID NUMERICAL CALCULATION OF PARTIAL SUMS OF GENERALIZED HARMONICAL SERIES WITH PRESCRIBED ACCURACY

SUMMARY OF THE ZETA REGULARIZATION METHOD APPLIED TO THE CALCULATION OF DIVERGENT SERIES

hp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations

INTRODUCTION ( ) 1. Errors

Line Fitting and Regression

Multivariate Transformation of Variables and Maximum Likelihood Estimation

24 Concept of wave function. x 2. Ae is finite everywhere in space.

ME 501A Seminar in Engineering Analysis Page 1

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

ME/BioE C117 April 13, 2006 Professor Lisa Pruitt Exam #2. This is a closed notes/closed book exam. Show all work. Write your name on every page.

In Calculus I you learned an approximation method using a Riemann sum. Recall that the Riemann sum is

ECON 482 / WH Hong The Simple Regression Model 1. Definition of the Simple Regression Model

4. Runge-Kutta Formula For Differential Equations. A. Euler Formula B. Runge-Kutta Formula C. An Example for Fourth-Order Runge-Kutta Formula

Debabrata Dey and Atanu Lahiri

lower lower median upper upper proportions. 1 cm= 10 mm extreme quartile quartile extreme 28mm =?cm I I I

Sequences and summations

Mathematics HL and further mathematics HL formula booklet

Multiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades

ESS Line Fitting

Wu-Hausman Test: But if X and ε are independent, βˆ. ECON 324 Page 1

Chapter 2 Supplemental Text Material

4. Runge-Kutta Formula For Differential Equations

Cooper and McGillem Chapter 4: Moments Linear Regression

In an algebraic expression of the form (1), like terms are terms with the same power of the variables (in this case

On Several Inequalities Deduced Using a Power Series Approach

ANSWERS, HINTS & SOLUTIONS FULL TEST II (PAPER - 2) Q. No. PHYSICS CHEMISTRY MATHEMATICS

Chapter Newton-Raphson Method of Solving a Nonlinear Equation

Mathematics HL and further mathematics HL formula booklet

Correlation and Regression Analysis

Linear Algebra Concepts

Available online through

Third handout: On the Gini Index

A New Efficient Approach to Solve Multi-Objective Transportation Problem in the Fuzzy Environment (Product approach)

Applying the condition for equilibrium to this equilibrium, we get (1) n i i =, r G and 5 i

Computer Programming

Transcription:

Nuercl Alss for Egeers Ger Jord Uverst CURVE FITTING Although, the for of fucto represetg phscl sste s kow, the fucto tself ot be kow. Therefore, t s frequetl desred to ft curve to set of dt pots the ssued for of the sste. LEAST SQUARES METHOD Whle fttg le or curve to set of dt pots, the gol s to ze the devtos of the pots fro the pproted le or curve. Severl possble ws of zg the devtos wll be dscussed Mze the Su of Errors e stes.google.co/ste/zdsoud/uercl 5

Nuercl Alss for Egeers Ger Jord Uverst A le pssg through the dpot stsfes the bove crtero. Mze the Su of Errors Mgtudes e but e e e costt stes.google.co/ste/zdsoud/uercl 53

Nuercl Alss for Egeers Ger Jord Uverst whch es tht le lg betwee les d b stsfes the bove crtero. Mze the Su of Squres of the Errors I the fgure show below, f the pprote le psses through pot, the devtos becoe The su of squres of the devtos s e e e e d e stes.google.co/ste/zdsoud/uercl 54

Nuercl Alss for Egeers Ger Jord Uverst s e e e d For the optl postog of the pot, the su s s zed wth respect to the devto e. ds de e d e d e whch loctes the pot o top of pot, whch s tur the desred pssg pot of the pprote le. POLYNOMIAL REGRESSION Polol regresso s the process of fttg polol of th order to set of dt pot the for stes.google.co/ste/zdsoud/uercl 55

Nuercl Alss for Egeers Ger Jord Uverst stes.google.co/ste/zdsoud/uercl 56 The error betwee the ect vlue of d the vlue pproted b the polol bove s e the e It s the requred to detere the coeffcets of the polol whch wll ze the su of squres of the errors wth respect to ll coeffcets. The su of squres of the errors s e s ) ( To ze the su wth respect to the coeffcet, the prtl dervtve of the su wth respect to the coeffcet s set to zero ) )( ( s To ze the su wth respect to the rest of the coeffcets, the prtl dervtve of the su wth respect to ll coeffcets s set to zero s ) )( ( ) )( ( ) )( ( s s s

Nuercl Alss for Egeers Ger Jord Uverst stes.google.co/ste/zdsoud/uercl 57 The d ters the bove set of equtos c be rerrged s 4 3 3 The ter The bove set of equtos c be preseted tr for s 4 3 3

Nuercl Alss for Egeers Ger Jord Uverst stes.google.co/ste/zdsoud/uercl 58 The bove tr geerll ll-codtoed but, up to 4 th or 5 th order polols, d usg double precso clcultos, the soluto c be cceptble. Eple Detere the best le ft to the gve set of dt pots usg lest squres ethod..5 765 3.7 86 5 873 73. 94 95.7 3 The best le ft s gve b To detere the coeffcets of the bove equto, tble s costructed whch cludes the orgl dt d the su of ll quttes the followg equto Usg 8 sgfct fgures clcultos

Nuercl Alss for Egeers Ger Jord Uverst The bove tr equto becoes.5 765 4.5 568.5 3.7 86 69.9 7. 3 5 873 6 4453 4 73. 94 5358.4 68954.4 5 95.7 3 958.49 6896.4 73. 4438 867.7 5493.5 5 73. Solvg the sste, the coeffcets re 73. 867.7 7.7 3.394873 4438 5493.5 stes.google.co/ste/zdsoud/uercl 59

Nuercl Alss for Egeers Ger Jord Uverst = 3.3949 + 7.7 9 8 7 6 4 6 8 Therefore, the equto of the best le ft becoes 7.7 3. 394873 WHAT DEGREE OF POLYNOMIAL SHOULD BE USED? Hgher order polols reduce devtos of pots fro the pproted chrt. Whe the degree of the polol reches (-), where s the uber of dt pots, the polol psses through ll pots (ssug o duplcted pots t the se vlue). Oe crese the degree of polol s log s there s sttstcll sgfct decrese the stdrd error defed s s e ( ) stes.google.co/ste/zdsoud/uercl 6

Nuercl Alss for Egeers Ger Jord Uverst The bove qutt s dvded b ( ) becuse degrees re used d hece ( ) re the lost coeffcets or degrees of freedo. Eple Detere the stdrd error of the curve fts of the followg set of dt pots usg st order through 4 th order polols..5.956..89.5.83.3.77.46.57.5.539.7.378.74.37.8.36.98.4.7.4 Costruct tble to detere the coeffcets of the tr equto of the st order polol s follows. sgfct fgures clcultos re used. Ol 3 sgfct fgures re show for clrt of the soluto steps. stes.google.co/ste/zdsoud/uercl 6

Nuercl Alss for Egeers Ger Jord Uverst 5..56 3 9.5 4.78. 8.9. 9.79 3.5 8.3.5.5 4 3. 7.7 9.6. 5 4.6 5.7..63 6 5. 5.39.7.8 7 7. 3.78 4.9.65 8 7.4 3.7 5.48.74 9 8. 3.6 6.7.5 9.8.4 9.6.37.7.4. The st order tr equto s.37. 6 5.9 4.65.8 Substtutg vlues fro the bove tble we get stes.google.co/ste/zdsoud/uercl 6

Nuercl Alss for Egeers Ger Jord Uverst 6. 6. 4.65 5.9.8 Solvg the bove sste for the coeffcets of the st order polol we get The equto of the polol becoes 9.5 7.6.95. 76 To detere the error of the pproto t ll dt pot, costruct the followg tble whch cludes the ect pots d the pprote vlues of obted fro the st order polol bove. stes.google.co/ste/zdsoud/uercl 63

Nuercl Alss for Egeers Ger Jord Uverst 5..56.95. 76 9 9.4 e e 3 4.7.74 4. 8.9 8.69.4 4.57 3 3 5.5 8.3 8.38 6. 3.86 4 4 7 3. 7.7 7.7 4.49. 5 4 4.6 5.7 6. 3.5 9.9 6 4 5. 5.39 5.57.79 3.9 7 3 7. 3.78 4. 4..76 8 4 7.4 3.7 3.9.96 3.83 9 4 8. 3.6 3.9.7 5.7 9.8 3.4.7 3.49..7.4. The stdrd error s 3 6.6 4.4.7 3 6 5.9 9.5 e 3 9.5 s. ( ) () where s the uber of pots, d s the order of the polol. 3 stes.google.co/ste/zdsoud/uercl 64

Nuercl Alss for Egeers Ger Jord Uverst The bove steps re repeted fro the d, 3 rd, d 4 th order polols. The followg tble shows the obted polols d the stdrd error of ech ft. Degree Polol Stdrd error.95. 76 3....5 4.33 3 3..8.35. 689 4.59 4 3 456 4.988.837.57.5. 4.74 Mu stdrd error s cheved usg d order polol. The stdrd error strts to crese fter the d order. Ths due to the ll-codto of the curve fttg tr. The degree of lless of the tr creses wth the crese of ts sze. Therefore, sttstcll, d order polol gves the best ft to the gve dt. The ctul dt gve the eple tble ws obted usg the followg d order polol. LINEARIZING NONLINEAR RELATIONSHIPS The respose of phscl sstes s geerll oler, such s dped vbrtos. The pltude of osclltos t te s gve b e t stes.google.co/ste/zdsoud/uercl 65

Nuercl Alss for Egeers Ger Jord Uverst Oe of the coeffcets the bove equto ( ) s cluded wth oler fucto. Ths proble c be solved b trsforg the oler reltoshp to ler reltoshp usg vrble trsforto s New vrbles c be defed s Therefore, the ew reltoshp becoes where e l l l l t t e t l e l l t z l t z l e The gve dt s trsfored to the ew vrbles usg the reltoshps z l d t, the best le s obted for the ew dt usg z. The obted coeffcets re the trsfored bck to the orgl for. Eple 3 Ft oler curve the for e to the followg set of dt pots. stes.google.co/ste/zdsoud/uercl 66

Nuercl Alss for Egeers Ger Jord Uverst.5 4.4 3.7.49 5.8767 73..3499 95.7. To trsfor the gve oler reltoshp to ler oe, wth costts pperg le wth the depedet vrble, the turl logrth of both sdes of the equto s used s follows Appl the trsfortos The resultg ler reltoshp becoes e l l l l The ler curve fttg tr equto s e l e l l z l l z stes.google.co/ste/zdsoud/uercl 67

Nuercl Alss for Egeers Ger Jord Uverst stes.google.co/ste/zdsoud/uercl 68 z z Costruct the lest-squres curve fttg tble s follows z l z.5.438 4.5 9.4875 3.7.85 69.9 6.59 3 5 -.36 6-6.7 4 73. -.5 5358.4-76.8679 5 95.7 -.97 958.49 -.98 73. -.93 867.3-37.787 Clcultos re crred out usg sgfct fgures. The dspled vlues re rouded to 6 sgfct fgures. The tr equto becoes 37.787.93 867.3 73. 73. 5 Solvg the sste, the coeffcets re.47787.3855

Nuercl Alss for Egeers Ger Jord Uverst Therefore, The fl for of the ftted curve becoes l e.89.47787 47787.89e. The fgure below shows the orgl dt pots d the curve ft. 8 7 6 5 4 3 3 4 5 6 7 8 9 GOODNESS OF FIT To qutf the goodess of ft, the totl su of the squres of errors roud the e s copred to the totl su of the squres of errors roud the curve ft. The e vlue of the dt s detered s stes.google.co/ste/zdsoud/uercl 69

Nuercl Alss for Egeers Ger Jord Uverst The su of squres roud the e s The su of squres roud the ft s S t S r where s the vlue pproted b the curve ft. 8 6 Curve ft 4 Me 3 4 5 6 The reltve dfferece betwee the two sus qutfes the out of proveet cheved. Ths reltve dfferece s kow s the Coeffcet of Deterto ( r ), d s defed s stes.google.co/ste/zdsoud/uercl 7

Nuercl Alss for Egeers Ger Jord Uverst r St S S The squre root of the Coeffcet of Deterto ( r ) s kow s the Correlto Fctor. A Correlto Fctor r correspods to perfect ft (%). A zero Correlto Fctor ( r ) ples o proveet or o dvtge to the curve ft over the e of the dt. Eple 4 I eple, strght le ws ftted to the followg set of dt pots. t r The e vlue of the dt s The equto of the strght le ws.5 765 3.7 86 5 873 73. 94 95.7 3 4438 887.6 5 7.7 3. 394873 stes.google.co/ste/zdsoud/uercl 7

Nuercl Alss for Egeers Ger Jord Uverst The followg tble shows the orgl vlues of d the vlues obted fro the le equto. The errors d the squres of the errors re lso cluded the tble. 7.7 3.394873 e e e.5 765 77.767-6.767 -.6 45.7936 53.8 3.7 86 83.85.855-6.6 64.36 3794.56 3 5 873 875.3 -.37-4.6 5.33944 3.6 4 73. 94 95.677-8.6769 54.4 75.887 959.36 5 95.7 3 7.6 4.93845 44.4 4.3883 85.4 The Coeffcet of Deterto s clculted s The Correlto Fctor s r 5 5 e e St Sr 4849. 35.46 S 5 t 4849. e r.99648.99637 e 35.46 4849..99648 Ths dctes 99.6% proveet cheved usg the best le ft over the e vlue of the gve dt. stes.google.co/ste/zdsoud/uercl 7