NUMERICAL DIFFERENTIATION
|
|
- Jordan Williams
- 6 years ago
- Views:
Transcription
1 NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the dervatve of y wth respect to x. In more precse language, the dependence of y upon x means that y s a functon of x. Ths functonal relatonshp s often denoted y = f(x), where f denotes the functon. If x and y are real numbers, and f the graph of y s plotted aganst x, the dervatve measures the slope of ths graph at each pont. When the functonal dependence s gven as a smple mathematcal expresson, the dervatve can be determned analytcally. When analytcal dfferentaton of the expresson s dffcult or not possble, numercal dfferentaton has to be used. When the functonal dependence s specfed as a set of dscrete ponts, dfferentaton s completed usng a numercal method. For a gven set of ponts two approaches can be used to calculate a numercal approxmaton of the dervatve at one of the ponts Fnte dfference approxmaton: In ths approach we approxmate the dervatve based on values of ponts n the neghborhood of the pont. The accuracy of a fnte dfference approxmaton depends on the accuracy of the data ponts, the spacng between the pont, and the specfc formula used for the approxmaton. In the example below, the frst dervatve at x s approxmated by the slope of the lne connectng the ponts adjacent to x. Ths approxmaton s called Two ponts central dfference approxmaton. df dx x=x = f(x +1) f(x 1 ) x +1 x 1 Two addtonal two ponts fnte dfference approxmatons: Two ponts forward dfference approxmaton where the frst dervatve x s approxmated by the slope of the lne connectng x and x + 1 df dx x=x = f(x +1) f(x ) x +1 x 1
2 Two ponts backward dfference approxmaton where the frst dervatve x s approxmated by the slope of the lne connectng x and x 1 df dx x=x = f(x ) f(x 1 ) x x 1 The second approach s to approxmate the ponts wth an analytcal expresson that can be easly dfferentated and then to calculate the dervatve by dfferentatng the analytcal expresson. The approxmate analytcal expresson can be derved usng curve fttng. Note: Sometmes when the measured data contan scatter as shown n the fgure below, usng one of the two ponts fnte dfference approxmaton may be erroneous and better results may be obtaned usng a hgher order fnte dfference approxmaton as wll be dscussed later n ths chapter or by usng a curve ft. Ths elmnates the problem of wrongly amplfed slopes between successve ponts. 2
3 2 Fnte dfference formulas usng Taylor seres expanson 2.1 Taylor seres expanson of a functon Taylor seres expanson of a functon s a way to fnd the value of a functon near a known pont, that s, a pont where the value of the functon s known. The functon s represented by a sum of terms of a convergent seres. In some cases (f the functon s a polynomal), the Taylor seres can gve the exact value of the functon. In most cases, however, a sum of an nfnte number of terms s requred for the exact value. If only a few terms are used, the value of the functon that s obtaned from the Taylor seres s an approxmaton. Gven a functon that s dfferentable (n+1) tmes n an nterval contanng a pont x o, Taylor s theorem states that for each x n the nterval, there exsts a value η between x and x o such that: f(x) = f(x o ) + (x x o ) df dx x=x o + (x x o) 2 d 2 f 2! dx 2 x=x o (x x o) n d n f n! dx n x=x o + R n (η) where the remander R n (x) s gven by R n (η) = (x x o) n+1 (n + 1)! d n+1 f dx n+1 x=η 2.2 Fnte dfference formulas of frst dervatves Several fnte dfference formulas, ncludng the two ponts fnte dfference approxmatons can be derved from the Taylor seres expanson of the functon. These approxmatons vares n the number of ponts nvolved n the approxmaton, the spacng and accuracy of the measured values. We assume the spacng between adjacent ponts to be fxed and equal to h Two ponts forward dfference approxmaton f(x +1 ) = f(x ) + (x +1 x ) df dx x=x + (x +1 x ) 2 d 2 f 2! dx 2 x=η f(x +1 ) = f(x ) + hf (x ) + h2 2! f (η) f (x ) = f(x +1) f(x ) h h 2! f (η) If the second term s gnored, the prevous expresson reduces to the two ponts forward dfference approxmaton. 3
4 Ignorng the second term ntroduces a truncaton error that s proportonal to h. The truncaton error s sad to be of on the order of h Two ponts backward dfference approxmaton truncaton error = h 2! f (η) = O(h) f(x 1 ) = f(x ) + (x 1 x ) df dx x=x + (x 1 x ) 2 d 2 f 2! dx 2 x=η f(x 1 ) = f(x ) hf (x ) + h2 2! f (η) f (x ) = f(x ) f(x 1 ) h + h 2! f (η) If the second term s gnored, the prevous expresson reduces to the two ponts backward fnte dfference approxmaton. Ignorng the second term ntroduces a truncaton error that s proportonal to h. The truncaton error s sad to be of on the order of h Two ponts central dfference approxmaton truncaton error = h 2! f (η) = O(h) f(x +1 ) = f(x ) + (x +1 x ) df dx x=x + (x +1 x ) 2 d 2 f 2! dx 2 x=x + (x +1 x ) 3 d 3 f 3! dx 3 x=η 1 f(x 1 ) = f(x ) + (x 1 x ) df dx x=x + (x 1 x ) 2 d 2 f 2! dx 2 x=x + (x +1 x ) 3 d 3 f 3! dx 3 x=η 2 f(x +1 ) = f(x ) + hf (x ) + h2 2! f (x ) + h3 3! f (η 1 ) f(x 1 ) = f(x ) hf (x ) + h2 2! f (x ) h3 3! f (η 2 ) f (x ) = f(x +1) f(x 1 ) h + h2 3! f (η 1 ) h2 3! f (η 2 ) If the second term s gnored, the prevous expresson reduces to the two ponts central fnte dfference approxmaton. Ignorng the second term ntroduces a truncaton error that s proportonal to h 2. The truncaton error s sad to be of on the order of h 2 truncaton error = h3 3! f (η 1 ) h2 3! f (η 2 ) = O(h 2 ) A comparson between the last three approxmatons show that for small h, the central dfference approxmaton gves better approxmaton that the forward or backward approxmatons. The central dfference approxmaton s useful only for nteror ponts and not for the end ponts x 1 or x n 4
5 Three ponts forward dfference approxmaton f(x +1 ) = f(x ) + hf (x ) + h2 2! f (x ) + h3 3! f (η 1 ) f(x +2 ) = f(x ) + 2hf (x ) + (2h)2 2! f (x ) = 3f(x ) + 4f(x +1 ) f(x +2 ) 2h f (x ) + (2h)3 f (η 2 ) 3! 2h2 3! f (η 1 ) + 4h2 3! f (η 2 ) If the second term s gnored, the prevous expresson reduces to the three ponts forward fnte dfference approxmaton. Ignorng the second term ntroduces a truncaton error that s proportonal to h 2. The truncaton error s sad to be of on the order of h 2 truncaton error = 2h2 3! f (η 1 ) + 4h2 3! f (η 2 ) = O(h 2 ) The three ponts forward dfference approxmaton s only useful for ponts = 1 to = n 2 Three ponts backward dfference approxmaton f(x 1 ) = f(x ) hf (x ) + h2 2! f (x ) h3 3! f (η 1 ) f(x 2 ) = f(x ) 2hf (x ) + (2h)2 2! f (x ) = 3f(x ) 4f(x 1 ) + f(x 2 ) 2h f (x ) (2h)3 f (η 2 ) 3! 2h2 3! f (η 1 ) + 4h2 3! f (η 2 ) If the second term s gnored, the prevous expresson reduces to the three ponts forward fnte dfference approxmaton. Ignorng the second term ntroduces a truncaton error that s proportonal to h 2. The truncaton error s sad to be of on the order of h 2 truncaton error = 2h2 3! f (η 1 ) 4h2 3! f (η 2 ) = O(h 2 ) The three ponts backward dfference approxmaton s only useful for ponts = n to = 2 The same approach can be used to derve the four ponts central dfference approxmaton f (x ) = f(x 2) 8f(x 1 ) + 8f(x +1 ) f(x +2 ) 12h + O(h 4 ) 5
6 2.3 Fnte dfference formulas of second dervatves Three ponts forward dfference approxmaton f(x +1 ) = f(x ) + hf (x ) + h2 2! f (x ) + h3 3! f (η 1 ) f(x +2 ) = f(x ) + 2hf (x ) + (2h)2 2! f (x ) = f(x +2) 2f(x +1 ) + f(x ) h 2 f (x ) + (2h)3 f (η 2 ) 3! 8h 3! f (η 2 ) + h 3! f (η 1 ) If the second term s gnored, the prevous expresson reduces to the three ponts forward fnte dfference approxmaton. Ignorng the second term ntroduces a truncaton error that s proportonal to h. The truncaton error s sad to be of on the order of h Three ponts backward dfference approxmaton truncaton error = 8h 3! f (η 2 ) + h 3! f (η 1 ) = O(h) f(x 1 ) = f(x ) hf (x ) + h2 2! f (x ) h3 3! f (η 1 ) f(x 2 ) = f(x ) 2hf (x ) + (2h)2 2! f (x ) = f(x 2) 2f(x 1 ) + f(x ) h 2 f (x ) (2h)3 f (η 2 ) 3! + 8h 3! f (η 2 ) h 3! f (η 1 ) If the second term s gnored, the prevous expresson reduces to the three ponts backward fnte dfference approxmaton. 6
7 Ignorng the second term ntroduces a truncaton error that s proportonal to h. The truncaton error s sad to be of on the order of h Three ponts central dfference approxmaton truncaton error = 8h 3! f (η 2 ) h 3! f (η 1 ) = O(h) f(x +1 ) = f(x ) + hf (x ) + h2 2! f (x ) + h3 3! f (x ) + h4 4! f (η 1 ) f(x 1 ) = f(x ) hf (x ) + h2 2! f (x ) h3 3! f (x ) h4 4! f (η 2 ) f (x ) = f(x +1) + f(x 1 ) 2f(x ) h 2 + h2 4! f (η 2 ) h2 4! f (η 1 ) If the second term s gnored, the prevous expresson reduces to the three ponts central dfference approxmaton. Ignorng the second term ntroduces a truncaton error that s proportonal to h 2. The truncaton error s sad to be of on the order of h 2 truncaton error = h2 4! f (η 2 ) h2 4! f (η 1 ) = O(h 2 ) The same procedure can be used to develop hgher order fnte dfference approxmatons. The result s summarzed n the table below 7
8 2.4 3 Fnte dfference formulas of thrd and fourth Rchardson s extrapolaton To ths pont, we have seen that there are two ways to mprove dervatve estmates when employng fnte dvded dfferences: (1) decrease the step sze or (2) use hgher order formula that employs more ponts. A thrd approach, based on Rchardson extrapolaton uses two dervatve estmates to compute a thrd, more accurate approxmaton. In general terms, consder the value, D, of a dervatve (unknown) that s calculated by the dfference formula: D = D(h) + k2 h2 + k4 h4 8
9 where D(h) s a functon that approxmates the value of the dervatve and k 2 h 2 and k 4 h 4 are error terms n whch the coeffcents, k 2 and k 4 are ndependent of the spacng h. Usng the same formula for calculatng the value of D but usng a spacng of h/2 gves: D = D(h/2) + k 2 ( h 2 Combnng the last two equatons we get D = 1 ( ( ) ) h h 4 4D D(h) k = 1 3 ) 2 ( ) 4 h + k 4 2 ( 4D ( ) ) h D(h) + O(h 4 ) 2 Ths means that an approxmated value of D wth error O(h 4 ) s obtaned from two lower-order approxmatons (D(h) and D(h/2)) that were calculated wth an error O(h 2 ). Example: f(x +1 ) = f(x ) + hf (x ) + h2 2! f (x ) + h3 3! f (x ) + h4 4! f v (x ) + h5 5! f v (η 1 ) f(x 1 ) = f(x ) hf (x ) + h2 2! f (x ) h3 3! f (x ) + h4 4! f v (x ) h5 5! f v (η 2 ) f(x +1 ) f(x 1 ) = 2hf (x ) + 2 h2 2! f (x ) + h3 3! f (x ) + h5 5! f v (η 1 ) + h5 5! f v (η 2 ) f (x ) = f(x +1) f(x 1 ) 2h f (x ) = 1 3 h2 3! f (x ) (f v (η 1 ) + f v (η 2 )) h4 5! D(h) = f(x + h) f(x h) 2h [ 4 f(x + h/2) f(x h/2) f(x ] + h) f(x h) + O(h 4 ) h 2h 4 Error n numercal dfferentaton Throughout ths chapter, expressons have been gven for the truncaton error, also known as the dscretzaton error. These expressons are generated by the partcular numercal scheme used for dervng a specfc fnte dfference formula to estmate the dervatve. In each case, the truncaton error depends on h (the spacng between the ponts) rased to some power. Clearly, the mplcaton s that as h s made smaller and smaller, the error could be made arbtrarly small. When the functon to be dfferentated s specfed as a set of dscrete data ponts, the spacng s fxed, and the truncaton error cannot be reduced by reducng the sze of h. In ths case, a smaller truncaton error can be obtaned by usng a fnte dfference formula that has a hgher-order truncaton error. When the functon that s beng dfferentated s gven by a mathematcal expresson, the spacng h for the ponts that are used n the fnte dfference formulas can be defned by the user. It mght appear then that h can be made arbtrarly small and there s no lmt to how small the error can be made. Ths, however, s not true because the total error s composed of two parts. One s the truncaton error arsng from the numercal method (the specfc fnte dfference formula) that s used. The second part s a round-off error arsng from the fnte precson of the partcular computer used. Therefore, even f the truncaton error can be made vanshngly small by choosng smaller and smaller values of h, the round-off error stll remans, or can even grow as h s made smaller and smaller. 9
10 5 Numercal partal dfferentaton For a functon of several ndependent varables, the partal dervatve of the functon wth respect to one of the varables represents the rate of change of the value of the functon wth respect to ths varable, whle all the other varables are kept constant. For a functon wth two ndependent varables, the partal dervatves wth respect to x and y at the pont (a, b) are defned as: f(x, b) f(a, b) x=a,y=b = lm x a x a f(a, y) f(a, b) x=a,y=b = lm y y b y b Ths means that the fnte dfference formulas that are used for approxmatng the dervatves of functons wth one ndependent varable can be adopted for calculatng partal dervatves. The formulas are appled for one of the varables, whle the other varables are kept constant. Two ponts forward dfference approxmaton Two ponts backward dfference approxmaton Two ponts central dfference approxmaton f(x +1, y ) f(x, y ) x +1 x y f(x, y +1 ) f(x, y ) y +1 y f(x, y ) f(x 1, y ) x x 1 y f(x, y ) f(x, y 1 ) y y 1 f(x +1, y ) f(x 1, y ) x +1 x 1 y f(x, y +1 ) f(x, y 1 ) y +1 y 1 The second partal dervatves wth the three-pont central dfference formula are: 2 f(x, y) 2 f(x 1, y ) 2f(x, y ) + f(x +1, y ) (x +1 x ) 2 2 f(x, y) y 2 f(x, y 1 ) 2f(x, y ) + f(x, y +1 ) (y +1 y ) 2 Mxed dervatves 2 f(x, y) y = = ( y ( f(x, y+1 ) f(x, y 1 ) y +1 y 1 ) ) = f(x +1, y +1 ) f(x +1, y 1 ) f(x 1, y +1 ) f(x 1, y 1 ) (y +1 y 1 )(x +1 x 1 ) 10
One-sided finite-difference approximations suitable for use with Richardson extrapolation
Journal of Computatonal Physcs 219 (2006) 13 20 Short note One-sded fnte-dfference approxmatons sutable for use wth Rchardson extrapolaton Kumar Rahul, S.N. Bhattacharyya * Department of Mechancal Engneerng,
More informationNumerical Solution of Ordinary Differential Equations
Numercal Methods (CENG 00) CHAPTER-VI Numercal Soluton of Ordnar Dfferental Equatons 6 Introducton Dfferental equatons are equatons composed of an unknown functon and ts dervatves The followng are examples
More informationCHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE
CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng
More informationLecture 13 APPROXIMATION OF SECOMD ORDER DERIVATIVES
COMPUTATIONAL FLUID DYNAMICS: FDM: Appromaton of Second Order Dervatves Lecture APPROXIMATION OF SECOMD ORDER DERIVATIVES. APPROXIMATION OF SECOND ORDER DERIVATIVES Second order dervatves appear n dffusve
More informationDifferentiating Gaussian Processes
Dfferentatng Gaussan Processes Andrew McHutchon Aprl 17, 013 1 Frst Order Dervatve of the Posteror Mean The posteror mean of a GP s gven by, f = x, X KX, X 1 y x, X α 1 Only the x, X term depends on the
More information2 Finite difference basics
Numersche Methoden 1, WS 11/12 B.J.P. Kaus 2 Fnte dfference bascs Consder the one- The bascs of the fnte dfference method are best understood wth an example. dmensonal transent heat conducton equaton T
More information2.29 Numerical Fluid Mechanics Fall 2011 Lecture 12
REVIEW Lecture 11: 2.29 Numercal Flud Mechancs Fall 2011 Lecture 12 End of (Lnear) Algebrac Systems Gradent Methods Krylov Subspace Methods Precondtonng of Ax=b FINITE DIFFERENCES Classfcaton of Partal
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More informationLecture 2: Numerical Methods for Differentiations and Integrations
Numercal Smulaton of Space Plasmas (I [AP-4036] Lecture 2 by Lng-Hsao Lyu March, 2018 Lecture 2: Numercal Methods for Dfferentatons and Integratons As we have dscussed n Lecture 1 that numercal smulaton
More informationChapter 3 Differentiation and Integration
MEE07 Computer Modelng Technques n Engneerng Chapter Derentaton and Integraton Reerence: An Introducton to Numercal Computatons, nd edton, S. yakowtz and F. zdarovsky, Mawell/Macmllan, 990. Derentaton
More informationChapter 12. Ordinary Differential Equation Boundary Value (BV) Problems
Chapter. Ordnar Dfferental Equaton Boundar Value (BV) Problems In ths chapter we wll learn how to solve ODE boundar value problem. BV ODE s usuall gven wth x beng the ndependent space varable. p( x) q(
More information6.3.4 Modified Euler s method of integration
6.3.4 Modfed Euler s method of ntegraton Before dscussng the applcaton of Euler s method for solvng the swng equatons, let us frst revew the basc Euler s method of numercal ntegraton. Let the general from
More informationCALCULUS CLASSROOM CAPSULES
CALCULUS CLASSROOM CAPSULES SESSION S86 Dr. Sham Alfred Rartan Valley Communty College salfred@rartanval.edu 38th AMATYC Annual Conference Jacksonvlle, Florda November 8-, 202 2 Calculus Classroom Capsules
More informationInductance Calculation for Conductors of Arbitrary Shape
CRYO/02/028 Aprl 5, 2002 Inductance Calculaton for Conductors of Arbtrary Shape L. Bottura Dstrbuton: Internal Summary In ths note we descrbe a method for the numercal calculaton of nductances among conductors
More informationMA 323 Geometric Modelling Course Notes: Day 13 Bezier Curves & Bernstein Polynomials
MA 323 Geometrc Modellng Course Notes: Day 13 Bezer Curves & Bernsten Polynomals Davd L. Fnn Over the past few days, we have looked at de Casteljau s algorthm for generatng a polynomal curve, and we have
More informationChapter 4: Root Finding
Chapter 4: Root Fndng Startng values Closed nterval methods (roots are search wthn an nterval o Bsecton Open methods (no nterval o Fxed Pont o Newton-Raphson o Secant Method Repeated roots Zeros of Hgher-Dmensonal
More informationSupplementary Notes for Chapter 9 Mixture Thermodynamics
Supplementary Notes for Chapter 9 Mxture Thermodynamcs Key ponts Nne major topcs of Chapter 9 are revewed below: 1. Notaton and operatonal equatons for mxtures 2. PVTN EOSs for mxtures 3. General effects
More informationEEE 241: Linear Systems
EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they
More informationReview of Taylor Series. Read Section 1.2
Revew of Taylor Seres Read Secton 1.2 1 Power Seres A power seres about c s an nfnte seres of the form k = 0 k a ( x c) = a + a ( x c) + a ( x c) + a ( x c) k 2 3 0 1 2 3 + In many cases, c = 0, and the
More informationGlobal Sensitivity. Tuesday 20 th February, 2018
Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values
More information3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X
Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationLecture 4 Hypothesis Testing
Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to
More informationMore metrics on cartesian products
More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of
More informationTransfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system
Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng
More informationChapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems
Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons
More informationOpen Systems: Chemical Potential and Partial Molar Quantities Chemical Potential
Open Systems: Chemcal Potental and Partal Molar Quanttes Chemcal Potental For closed systems, we have derved the followng relatonshps: du = TdS pdv dh = TdS + Vdp da = SdT pdv dg = VdP SdT For open systems,
More informationNumerical Heat and Mass Transfer
Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and
More information6) Derivatives, gradients and Hessian matrices
30C00300 Mathematcal Methods for Economsts (6 cr) 6) Dervatves, gradents and Hessan matrces Smon & Blume chapters: 14, 15 Sldes by: Tmo Kuosmanen 1 Outlne Defnton of dervatve functon Dervatve notatons
More informationPolynomial Regression Models
LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More information2.29 Numerical Fluid Mechanics
REVIEW Lecture 10: Sprng 2015 Lecture 11 Classfcaton of Partal Dfferental Equatons PDEs) and eamples wth fnte dfference dscretzatons Parabolc PDEs Ellptc PDEs Hyperbolc PDEs Error Types and Dscretzaton
More informationBernoulli Numbers and Polynomials
Bernoull Numbers and Polynomals T. Muthukumar tmk@tk.ac.n 17 Jun 2014 The sum of frst n natural numbers 1, 2, 3,..., n s n n(n + 1 S 1 (n := m = = n2 2 2 + n 2. Ths formula can be derved by notng that
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have
More informationUsing T.O.M to Estimate Parameter of distributions that have not Single Exponential Family
IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran
More informationLaboratory 1c: Method of Least Squares
Lab 1c, Least Squares Laboratory 1c: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly
More informationMarginal Effects in Probit Models: Interpretation and Testing. 1. Interpreting Probit Coefficients
ECON 5 -- NOE 15 Margnal Effects n Probt Models: Interpretaton and estng hs note ntroduces you to the two types of margnal effects n probt models: margnal ndex effects, and margnal probablty effects. It
More informationPhysics 5153 Classical Mechanics. Principle of Virtual Work-1
P. Guterrez 1 Introducton Physcs 5153 Classcal Mechancs Prncple of Vrtual Work The frst varatonal prncple we encounter n mechancs s the prncple of vrtual work. It establshes the equlbrum condton of a mechancal
More informationLaboratory 3: Method of Least Squares
Laboratory 3: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly they are correlated wth
More informationNew Method for Solving Poisson Equation. on Irregular Domains
Appled Mathematcal Scences Vol. 6 01 no. 8 369 380 New Method for Solvng Posson Equaton on Irregular Domans J. Izadan and N. Karamooz Department of Mathematcs Facult of Scences Mashhad BranchIslamc Azad
More informationComplex Numbers Alpha, Round 1 Test #123
Complex Numbers Alpha, Round Test #3. Wrte your 6-dgt ID# n the I.D. NUMBER grd, left-justfed, and bubble. Check that each column has only one number darkened.. In the EXAM NO. grd, wrte the 3-dgt Test
More informationFoundations of Arithmetic
Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an
More informationThe optimal delay of the second test is therefore approximately 210 hours earlier than =2.
THE IEC 61508 FORMULAS 223 The optmal delay of the second test s therefore approxmately 210 hours earler than =2. 8.4 The IEC 61508 Formulas IEC 61508-6 provdes approxmaton formulas for the PF for smple
More informationSuppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl
RECURSIVE SPLINE INTERPOLATION METHOD FOR REAL TIME ENGINE CONTROL APPLICATIONS A. Stotsky Volvo Car Corporaton Engne Desgn and Development Dept. 97542, HA1N, SE- 405 31 Gothenburg Sweden. Emal: astotsky@volvocars.com
More informationIntroduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law:
CE304, Sprng 2004 Lecture 4 Introducton to Vapor/Lqud Equlbrum, part 2 Raoult s Law: The smplest model that allows us do VLE calculatons s obtaned when we assume that the vapor phase s an deal gas, and
More informationLecture 12: Discrete Laplacian
Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationReport on Image warping
Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.
More informationSTAT 3340 Assignment 1 solutions. 1. Find the equation of the line which passes through the points (1,1) and (4,5).
(out of 15 ponts) STAT 3340 Assgnment 1 solutons (10) (10) 1. Fnd the equaton of the lne whch passes through the ponts (1,1) and (4,5). β 1 = (5 1)/(4 1) = 4/3 equaton for the lne s y y 0 = β 1 (x x 0
More informationLecture 5.8 Flux Vector Splitting
Lecture 5.8 Flux Vector Splttng 1 Flux Vector Splttng The vector E n (5.7.) can be rewrtten as E = AU (5.8.1) (wth A as gven n (5.7.4) or (5.7.6) ) whenever, the equaton of state s of the separable form
More informationREAL ANALYSIS I HOMEWORK 1
REAL ANALYSIS I HOMEWORK CİHAN BAHRAN The questons are from Tao s text. Exercse 0.0.. If (x α ) α A s a collecton of numbers x α [0, + ] such that x α
More informationModelli Clamfim Equazioni differenziali 22 settembre 2016
CLAMFIM Bologna Modell 1 @ Clamfm Equazon dfferenzal 22 settembre 2016 professor Danele Rtell danele.rtell@unbo.t 1/22? Ordnary Dfferental Equatons A dfferental equaton s an equaton that defnes a relatonshp
More informationStatistics Chapter 4
Statstcs Chapter 4 "There are three knds of les: les, damned les, and statstcs." Benjamn Dsrael, 1895 (Brtsh statesman) Gaussan Dstrbuton, 4-1 If a measurement s repeated many tmes a statstcal treatment
More informationProf. Dr. I. Nasser Phys 630, T Aug-15 One_dimensional_Ising_Model
EXACT OE-DIMESIOAL ISIG MODEL The one-dmensonal Isng model conssts of a chan of spns, each spn nteractng only wth ts two nearest neghbors. The smple Isng problem n one dmenson can be solved drectly n several
More informationNegative Binomial Regression
STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...
More informationSimulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests
Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth
More informationLectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix
Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could
More information6. Stochastic processes (2)
Contents Markov processes Brth-death processes Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 Markov process Consder a contnuous-tme and dscrete-state stochastc process X(t) wth state space
More information= z 20 z n. (k 20) + 4 z k = 4
Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5
More informationModelli Clamfim Equazione del Calore Lezione ottobre 2014
CLAMFIM Bologna Modell 1 @ Clamfm Equazone del Calore Lezone 17 15 ottobre 2014 professor Danele Rtell danele.rtell@unbo.t 1/24? Convoluton The convoluton of two functons g(t) and f(t) s the functon (g
More information6. Stochastic processes (2)
6. Stochastc processes () Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 6. Stochastc processes () Contents Markov processes Brth-death processes 6. Stochastc processes () Markov process
More informationFinding Dense Subgraphs in G(n, 1/2)
Fndng Dense Subgraphs n Gn, 1/ Atsh Das Sarma 1, Amt Deshpande, and Rav Kannan 1 Georga Insttute of Technology,atsh@cc.gatech.edu Mcrosoft Research-Bangalore,amtdesh,annan@mcrosoft.com Abstract. Fndng
More informationModule 2. Random Processes. Version 2 ECE IIT, Kharagpur
Module Random Processes Lesson 6 Functons of Random Varables After readng ths lesson, ou wll learn about cdf of functon of a random varable. Formula for determnng the pdf of a random varable. Let, X be
More informationDUE: WEDS FEB 21ST 2018
HOMEWORK # 1: FINITE DIFFERENCES IN ONE DIMENSION DUE: WEDS FEB 21ST 2018 1. Theory Beam bendng s a classcal engneerng analyss. The tradtonal soluton technque makes smplfyng assumptons such as a constant
More informationn α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0
MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector
More informationCHAPTER 14 GENERAL PERTURBATION THEORY
CHAPTER 4 GENERAL PERTURBATION THEORY 4 Introducton A partcle n orbt around a pont mass or a sphercally symmetrc mass dstrbuton s movng n a gravtatonal potental of the form GM / r In ths potental t moves
More informationThe equation of motion of a dynamical system is given by a set of differential equations. That is (1)
Dynamcal Systems Many engneerng and natural systems are dynamcal systems. For example a pendulum s a dynamcal system. State l The state of the dynamcal system specfes t condtons. For a pendulum n the absence
More informationLecture 21: Numerical methods for pricing American type derivatives
Lecture 21: Numercal methods for prcng Amercan type dervatves Xaoguang Wang STAT 598W Aprl 10th, 2014 (STAT 598W) Lecture 21 1 / 26 Outlne 1 Fnte Dfference Method Explct Method Penalty Method (STAT 598W)
More informationThe Exact Formulation of the Inverse of the Tridiagonal Matrix for Solving the 1D Poisson Equation with the Finite Difference Method
Journal of Electromagnetc Analyss and Applcatons, 04, 6, 0-08 Publshed Onlne September 04 n ScRes. http://www.scrp.org/journal/jemaa http://dx.do.org/0.46/jemaa.04.6000 The Exact Formulaton of the Inverse
More informationOne Dimension Again. Chapter Fourteen
hapter Fourteen One Dmenson Agan 4 Scalar Lne Integrals Now we agan consder the dea of the ntegral n one dmenson When we were ntroduced to the ntegral back n elementary school, we consdered only functons
More informationNumerical Methods. ME Mechanical Lab I. Mechanical Engineering ME Lab I
5 9 Mechancal Engneerng -.30 ME Lab I ME.30 Mechancal Lab I Numercal Methods Volt Sne Seres.5 0.5 SIN(X) 0 3 7 5 9 33 37 4 45 49 53 57 6 65 69 73 77 8 85 89 93 97 0-0.5 Normalzed Squared Functon - 0.07
More informationLecture 10 Support Vector Machines II
Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed
More informationBezier curves. Michael S. Floater. August 25, These notes provide an introduction to Bezier curves. i=0
Bezer curves Mchael S. Floater August 25, 211 These notes provde an ntroducton to Bezer curves. 1 Bernsten polynomals Recall that a real polynomal of a real varable x R, wth degree n, s a functon of the
More informationThis column is a continuation of our previous column
Comparson of Goodness of Ft Statstcs for Lnear Regresson, Part II The authors contnue ther dscusson of the correlaton coeffcent n developng a calbraton for quanttatve analyss. Jerome Workman Jr. and Howard
More informationFinite Differences, Interpolation, and Numerical Differentiation
4 Fnte Dfferences, Interpolaton, and Numercal Dfferentaton 4. INTRODUCTION Lnear nterpolaton s dscussed n the precedng chapter as a method for fndng a partcular root of a polynomal, or, transcendental
More informationSolution Thermodynamics
Soluton hermodynamcs usng Wagner Notaton by Stanley. Howard Department of aterals and etallurgcal Engneerng South Dakota School of nes and echnology Rapd Cty, SD 57701 January 7, 001 Soluton hermodynamcs
More informationLecture 3: Probability Distributions
Lecture 3: Probablty Dstrbutons Random Varables Let us begn by defnng a sample space as a set of outcomes from an experment. We denote ths by S. A random varable s a functon whch maps outcomes nto the
More informationFormal solvers of the RT equation
Formal solvers of the RT equaton Formal RT solvers Runge- Kutta (reference solver) Pskunov N.: 979, Master Thess Long characterstcs (Feautrer scheme) Cannon C.J.: 970, ApJ 6, 55 Short characterstcs (Hermtan
More informationx yi In chapter 14, we want to perform inference (i.e. calculate confidence intervals and perform tests of significance) in this setting.
The Practce of Statstcs, nd ed. Chapter 14 Inference for Regresson Introducton In chapter 3 we used a least-squares regresson lne (LSRL) to represent a lnear relatonshp etween two quanttatve explanator
More informationAppendix B. The Finite Difference Scheme
140 APPENDIXES Appendx B. The Fnte Dfference Scheme In ths appendx we present numercal technques whch are used to approxmate solutons of system 3.1 3.3. A comprehensve treatment of theoretcal and mplementaton
More informationFTCS Solution to the Heat Equation
FTCS Soluton to the Heat Equaton ME 448/548 Notes Gerald Recktenwald Portland State Unversty Department of Mechancal Engneerng gerry@pdx.edu ME 448/548: FTCS Soluton to the Heat Equaton Overvew 1. Use
More informationMath 426: Probability MWF 1pm, Gasson 310 Homework 4 Selected Solutions
Exercses from Ross, 3, : Math 26: Probablty MWF pm, Gasson 30 Homework Selected Solutons 3, p. 05 Problems 76, 86 3, p. 06 Theoretcal exercses 3, 6, p. 63 Problems 5, 0, 20, p. 69 Theoretcal exercses 2,
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationProblem Set 9 Solutions
Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem
More informationMMA and GCMMA two methods for nonlinear optimization
MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons
More informationLinear Feature Engineering 11
Lnear Feature Engneerng 11 2 Least-Squares 2.1 Smple least-squares Consder the followng dataset. We have a bunch of nputs x and correspondng outputs y. The partcular values n ths dataset are x y 0.23 0.19
More informationErrors for Linear Systems
Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch
More informationCorrelation and Regression. Correlation 9.1. Correlation. Chapter 9
Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,
More informationU.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016
U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and
More informationx = , so that calculated
Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to
More informationDigital Signal Processing
Dgtal Sgnal Processng Dscrete-tme System Analyss Manar Mohasen Offce: F8 Emal: manar.subh@ut.ac.r School of IT Engneerng Revew of Precedent Class Contnuous Sgnal The value of the sgnal s avalable over
More informationNumerical Simulation of One-Dimensional Wave Equation by Non-Polynomial Quintic Spline
IOSR Journal of Matematcs (IOSR-JM) e-issn: 78-578, p-issn: 319-765X. Volume 14, Issue 6 Ver. I (Nov - Dec 018), PP 6-30 www.osrournals.org Numercal Smulaton of One-Dmensonal Wave Equaton by Non-Polynomal
More informationCausal Diamonds. M. Aghili, L. Bombelli, B. Pilgrim
Causal Damonds M. Aghl, L. Bombell, B. Plgrm Introducton The correcton to volume of a causal nterval due to curvature of spacetme has been done by Myrhem [] and recently by Gbbons & Solodukhn [] and later
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationThe Expectation-Maximization Algorithm
The Expectaton-Maxmaton Algorthm Charles Elan elan@cs.ucsd.edu November 16, 2007 Ths chapter explans the EM algorthm at multple levels of generalty. Secton 1 gves the standard hgh-level verson of the algorthm.
More informationLecture 17 : Stochastic Processes II
: Stochastc Processes II 1 Contnuous-tme stochastc process So far we have studed dscrete-tme stochastc processes. We studed the concept of Makov chans and martngales, tme seres analyss, and regresson analyss
More informationStatistical mechanics handout 4
Statstcal mechancs handout 4 Explan dfference between phase space and an. Ensembles As dscussed n handout three atoms n any physcal system can adopt any one of a large number of mcorstates. For a quantum
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More information