AMTH142 Lecture 16. Least Squares
|
|
- Dortha Joseph
- 6 years ago
- Views:
Transcription
1 AMTH1 Lecture 1 Least Squares April, 7 All the Scilab functions defined in this Lecture can be found in the file l1.sci in the directory for this lecture. Contents 1.1 Least Squares The General Problem Linear Least Squares The Computational Problem Over-Determined Linear Systems Scilab Linear Functions Polynomials Analyzing Results
2 1.1 Least Squares In the previous lecture we looked at interpolation problems where we were given some data (x i, y i ), i = 1,..., n and we wanted to find a function y = f(x) which interpolated the data so that y i = f(x i ), i = 1,..., n. This approach is only useful when the data are relatively free from error, otherwise the interpolating function will exhibit the same kind of fluctuations that are present in the data. When we are dealing with data containing random errors the most common approach to fitting a function to data is the method of least squares The General Problem The general least squares problem can be formulated as follows: given data (x i, y i ), i = 1,..., n and a function y = f(x, a 1, a,..., a k ) depending on the parameters a 1,..., a k, let r i = y i f(x i, a 1,..., a k ) denote the distance between the graph of f(x, a 1, a,..., a k ) and the data point (x i, y i ). (x i, y i ) r i f(x, a 1,..., a k ) We want to find values for the parameters a 1,..., a k which minimizes the sum of squares of the r i n Minimize S = ri = i=1 n (y i f(x i, a 1,..., a k )) i=1 Typically the number of parameters, k, is much smaller than the number of data points, n.
3 Least squares problems are optimization problems. They are classified as linear or nonlinear, depending on whether the function f(x, a 1,..., a k ) depends linearly or non-linearly on the parameters a 1,..., a k. Nonlinear least squares problems are often difficult to solve and the theory behind them is rather involved. 1. Linear Least Squares The most common data fitting problem is fitting a straight line y = ax + b to data. This is an example of a linear least squares problem with two parameters, in this case a and b, to be determined. More generally, fitting a polynomial of degree k y = a + a 1 x + a x +... a k x k to data is another example of linear least squares. Although y is a nonlinear function of x it is a linear function of the parameters a,..., a k. Linear least squares have a number of similarities to the general interpolation problem discussed in the previous lecture. Like interpolation it can be formulated as a problem in linear algebra The Computational Problem Saying that the function f(x, a 1, a,..., a k ) depends linearly on the parameters a j means that it can be written as a linear combination of some basis functions f 1 (x),..., f k (x): f(x, a 1, a,..., a k ) = a 1 f 1 (x) + a f (x) + + a k f k (x) The least squares approach leads us to minimizing the sum of squares n S = [y i (a 1 f 1 (x i ) + a f (x i ) + + a k f k (x i ))] i=1 Note that the sum is over the data points, and once the data and basis functions are given, the sum of squares S is a function of the parameters a 1,..., a k only. The individual terms inside the square brackets r i = y i (a 1 f 1 (x i ) + a f (x i ) + + a k f k (x i )) can be written in vector/matrix form r 1 y 1 f 1 (x 1 ) f (x 1 )... f k (x 1 ) a 1 r. = y. f 1 (x ) f (x )... f k (x ) a..... r n y n f 1 (x n ) f (x n )... f k (x n ) 3 a k
4 The matrix in this equation is the same as the basis matrix used in interpolation. Like interpolation our aim is to find the coefficients a 1,..., a k, this time to minimize the sum of squares of the r i. Note that when we have the same number of parameters a i as data points, the problem reduces to an interpolation problem. In this case we could find values for the parameters so that all the r i are zero. 1.. Over-Determined Linear Systems The formulation of the linear least squares problem given above is closely related to solving linear equations when there are more equations than unknowns. Consider a system of n linear equations in k unknowns: In matrix form, b 11 a 1 + b 1 a b 1k a k = y 1 b 1 a 1 + b a b k a k = y.... b n1 a 1 + b n a b nk a k = y n Ba = y where B is a given n k matrix, y is a given n vector, and a is the k vector to be solved for. When n > k then the system of equations will not, in general, have a solution. For any vector a the residual is r = Ba y When we have the same number of equations as unknowns, the residual is zero for the solution vector a. When we have more equations than unknowns, there is no vector a for which the residual is zero. However what we can do in this case is to try to find a vector a for which the residual is as small as possible. If we measure the size of the residual by its norm r = [ m i=1 r i ] 1 then minimizing the norm is equivalent to minimizing S = r i. The linear least squares problem has exactly the same mathematical structure. Given (x i, y i ), i = 1,..., n and basis functions f 1 (x),..., f k (x)
5 form the basis matrix f 1 (x 1 ) f (x 1 )... f k (x 1 ) f 1 (x ) f (x )... f k (x ) B =.... f 1 (x n ) f (x n )... f k (x n ) then we want to find the coefficients a i of the basis functions minimize the norm of the residual r = Ba y Scilab In Scilab least squares problems, which as we have seen are equivalent to over-determined linear systems, are solved with the backslash operator \ the same way as linear equations are solved. Example We will look at example of fitting a straight line to data. Our basis functions are f 1 (x) = 1 and f (x) = x and the basis matrix is 1 x 1 1 x.. 1 x n For our example we will generate some x and y data where -->x1 = (:9) ; y = 3x random perturbation -->y1 = -3*x rand(x1, normal ); -->plotd(x1, y1, style = -1)
6 To fit a straight line to this data we first create the the basis matrix: -->aa1 = [ones(x1) x1] aa1 =! 1..!! 1. 1.!! 1..!! 1. 3.!! 1..!! 1. 5.!! 1..!! 1. 7.!! 1. 8.!! 1. 9.! Solving with the backslash operator -->a = aa1\y1 a =! 5.7!! ! The components of the solution, a, are the coefficients of the basis functions f 1 (x) = 1 and f (x) = x, so our least squares straight line is y = 3.3x We can now evaluate and plot the straight line -->xx = :.1:9; -->yy = a(1) + a()*xx; -->plotd(xx,yy)
7 Example Here is another example. Again we will generate some data, but this time using trigonometric functions: -->x = (:) ; -->y = *sin(x)+3*sin(*x)+*sin(*x)+.5*rand(x, normal ); -->plotd(x, y, style = -1) In this problem our basis functions will be f 1 (x) = sin(x) f (x) = sin(x) f 3 (x) = sin(x) Our computations follow the same pattern as before: -->aa = [sin(x) sin(*x) sin(*x)]; -->a = aa\y a =! !!.887!!.73987! -->xx = :.1:; -->yy = a(1)*sin(xx) + a()*sin(*xx) + a(3)*sin(*xx); -->plotd(xx,yy) 7
8 Linear Functions As we have seen, fitting a linear function to data is a simple application of linear least squares. It is handy to have a Scilab function to do this for us. Given data in vectors x and y we first construct the basis matrix, in this case the column matrix aa = [ones(x) x] (we have assumed x is a column vector), and then solve the least-squares problem to get the coefficients a = aa\y Here is our function: function a = linfit(x, y) aa = [ones(x) x] a = aa\y endfunction Example We will use the same data x1 and y1 as before -->a = linfit(x1,y1) a =! 5.7!! ! (and, of course, get the same result.) 8
9 1..5 Polynomials This is another application of linear least squares. To fit a polynomial of degree k y = a + a 1 x a k x k to a data set we use the basis matrix aa = [ones(x) x x.^... x.^k] Again we will write a Scilab function to do the job for us. Not surprisingly it is similar to the function for polynomial interpolation in Lecture 15. function a = polyfit(x, y, k) n = length(x) aa = zeros(n, k+1) aa(:,1) = ones(x); for i = 1:k // loop to construct the basis matrix aa(:,i+1) = x.^i end a = aa\y endfunction The function polyeval from Lecture 15 can be used to evaluate the polynomial. Example Again we will generate some noisy data: -->x3 = (:.1:) ; -->y3 = x3.^5-3*x3.^3-5*x *rand(x3, normal ); -->plotd(x3,y3,style = -1)
10 -->p = polyfit(x3,y3,5) p =! !! !!.311!! !! !! ! -->xx = (:.1:) ; -->yy = polyeval(p,xx); -->plotd(xx,yy) We can compare to the original unperturbed polynomial: -->pp = [ ] pp =! 7.!! - 5.!!.!! - 3.!!.!! 1.! -->yy1 = polyeval(pp,xx); -->plotd(xx,yy1) 1
11 Although some of the coefficients of the two polynomials are quite different, the graphs are quite similar. Put another way, we have two quite different polynomials which both give a reasonable fit to the data. 1.. Analyzing Results The residuals, that is the differences between the data and the fitted function, are good way to determine to determine how well a function fits a set of data. For our example these are: -->res3 = y3 - polyeval(p,x3); -->plotd(x3,res3) The graph of the residuals should look random with no discernible pattern as in this example. 11
Lecture 1: Interpolation and approximation
ecture notes on Variational and Approximate Methods in Applied Mathematics - A Peirce UBC ecture : Interpolation and approximation (Compiled 6 August 207 In this lecture we introduce the concept of approximation
More informationMA3457/CS4033: Numerical Methods for Calculus and Differential Equations
MA3457/CS4033: Numerical Methods for Calculus and Differential Equations Course Materials P A R T II B 14 2014-2015 1 2. APPROXIMATION CLASS 9 Approximation Key Idea Function approximation is closely related
More informationCurve Fitting. Objectives
Curve Fitting Objectives Understanding the difference between regression and interpolation. Knowing how to fit curve of discrete with least-squares regression. Knowing how to compute and understand the
More informationLeast squares regression
Curve Fitting Least squares regression Interpolation Two categories of curve fitting. 1. Linear least squares regression, determining the straight line that best fits data points. 2. Interpolation, determining
More information1 Last time: least-squares problems
MATH Linear algebra (Fall 07) Lecture Last time: least-squares problems Definition. If A is an m n matrix and b R m, then a least-squares solution to the linear system Ax = b is a vector x R n such that
More informationInterpolation and Polynomial Approximation I
Interpolation and Polynomial Approximation I If f (n) (x), n are available, Taylor polynomial is an approximation: f (x) = f (x 0 )+f (x 0 )(x x 0 )+ 1 2! f (x 0 )(x x 0 ) 2 + Example: e x = 1 + x 1! +
More informationNumerical Methods. Lecture Notes #08 Discrete Least Square Approximation
Numerical Methods Discrete Least Square Approximation Pavel Ludvík, March 30, 2016 Department of Mathematics and Descriptive Geometry VŠB-TUO http://homen.vsb.cz/ lud0016/ 1 / 23
More informationPreliminaries Lectures. Dr. Abdulla Eid. Department of Mathematics MATHS 101: Calculus I
Preliminaries 2 1 2 Lectures Department of Mathematics http://www.abdullaeid.net/maths101 MATHS 101: Calculus I (University of Bahrain) Prelim 1 / 35 Pre Calculus MATHS 101: Calculus MATHS 101 is all about
More informationMathematics Revision Guide. Algebra. Grade C B
Mathematics Revision Guide Algebra Grade C B 1 y 5 x y 4 = y 9 Add powers a 3 a 4.. (1) y 10 y 7 = y 3 (y 5 ) 3 = y 15 Subtract powers Multiply powers x 4 x 9...(1) (q 3 ) 4...(1) Keep numbers without
More informationMath 307: Problems for section 3.1
Math 307: Problems for section 3.. Show that if P is an orthogonal projection matrix, then P x x for every x. Use this inequality to prove the Cauchy Schwarz inequality x y x y. If P is an orthogonal projection
More informationNumerical integration
Numerical integration Responsible teacher: Anatoliy Malyarenko November 8, 003 Contents of the lecture: Black Scholes model. The trapezoidal rule. Simpson s rule. Error handling in MATLAB. Error analysis.
More informationSV6: Polynomial Regression and Neural Networks
Signal and Information Processing Laboratory Institut für Signal- und Informationsverarbeitung Fachpraktikum Signalverarbeitung SV6: Polynomial Regression and Neural Networks 1 Introduction Consider the
More informationCurve Fitting and Interpolation
Chapter 5 Curve Fitting and Interpolation 5.1 Basic Concepts Consider a set of (x, y) data pairs (points) collected during an experiment, Curve fitting: is a procedure to develop or evaluate mathematical
More informationSOLUTIONS FOR PROBLEMS 1-30
. Answer: 5 Evaluate x x + 9 for x SOLUTIONS FOR PROBLEMS - 0 When substituting x in x be sure to do the exponent before the multiplication by to get (). + 9 5 + When multiplying ( ) so that ( 7) ( ).
More informationCHAPTER 1. FUNCTIONS 7
CHAPTER 1. FUNCTIONS 7 1.3.2 Polynomials A polynomial is a function P with a general form P (x) a 0 + a 1 x + a 2 x 2 + + a n x n, (1.4) where the coe cients a i (i 0, 1,...,n) are numbers and n is a non-negative
More informationFactors of Polynomials Factoring For Experts
Factors of Polynomials SUGGESTED LEARNING STRATEGIES: Shared Reading, Activating Prior Knowledge, Discussion Group, Note-taking When you factor a polynomial, you rewrite the original polynomial as a product
More informationWarm Up answers. 1. x 2. 3x²y 8xy² 3. 7x² - 3x 4. 1 term 5. 2 terms 6. 3 terms
Warm Up answers 1. x 2. 3x²y 8xy² 3. 7x² - 3x 4. 1 term 5. 2 terms 6. 3 terms Warm Up Assignment 10/23/14 Section 6.1 Page 315: 2 12 (E) 40 58 (E) 66 Section 6.2 Page 323: 2 12 (E) 16 36 (E) 42 46 (E)
More information5 Numerical Integration & Dierentiation
5 Numerical Integration & Dierentiation Department of Mathematics & Statistics ASU Outline of Chapter 5 1 The Trapezoidal and Simpson Rules 2 Error Formulas 3 Gaussian Numerical Integration 4 Numerical
More information3 What is the degree of the polynomial function that generates the data shown below?
hapter 04 Test Name: ate: 1 For the polynomial function, describe the end behavior of its graph. The leading term is down. The leading term is and down.. Since n is 1 and a is positive, the end behavior
More information1 Lecture 8: Interpolating polynomials.
1 Lecture 8: Interpolating polynomials. 1.1 Horner s method Before turning to the main idea of this part of the course, we consider how to evaluate a polynomial. Recall that a polynomial is an expression
More informationJim Lambers MAT 419/519 Summer Session Lecture 13 Notes
Jim Lambers MAT 419/519 Summer Session 2011-12 Lecture 13 Notes These notes correspond to Section 4.1 in the text. Least Squares Fit One of the most fundamental problems in science and engineering is data
More information5.3. Polynomials and Polynomial Functions
5.3 Polynomials and Polynomial Functions Polynomial Vocabulary Term a number or a product of a number and variables raised to powers Coefficient numerical factor of a term Constant term which is only a
More informationChapter 8 ~ Quadratic Functions and Equations In this chapter you will study... You can use these skills...
Chapter 8 ~ Quadratic Functions and Equations In this chapter you will study... identifying and graphing quadratic functions transforming quadratic equations solving quadratic equations using factoring
More informationBSM510 Numerical Analysis
BSM510 Numerical Analysis Polynomial Interpolation Prof. Manar Mohaisen Department of EEC Engineering Review of Precedent Lecture Polynomial Regression Multiple Linear Regression Nonlinear Regression Lecture
More informationInput: A set (x i -yy i ) data. Output: Function value at arbitrary point x. What for x = 1.2?
Applied Numerical Analysis Interpolation Lecturer: Emad Fatemizadeh Interpolation Input: A set (x i -yy i ) data. Output: Function value at arbitrary point x. 0 1 4 1-3 3 9 What for x = 1.? Interpolation
More informationMidterm Review. Name: Class: Date: ID: A. Short Answer. 1. For each graph, write the equation of a radical function of the form y = a b(x h) + k.
Name: Class: Date: ID: A Midterm Review Short Answer 1. For each graph, write the equation of a radical function of the form y = a b(x h) + k. a) b) c) 2. Determine the domain and range of each function.
More informationApproximate Linear Relationships
Approximate Linear Relationships In the real world, rarely do things follow trends perfectly. When the trend is expected to behave linearly, or when inspection suggests the trend is behaving linearly,
More informationRegression and Nonlinear Axes
Introduction to Chemical Engineering Calculations Lecture 2. What is regression analysis? A technique for modeling and analyzing the relationship between 2 or more variables. Usually, 1 variable is designated
More informationLinear Algebra II Lecture 22
Linear Algebra II Lecture 22 Xi Chen University of Alberta March 4, 24 Outline Characteristic Polynomial, Eigenvalue, Eigenvector and Eigenvalue, Eigenvector and Let T : V V be a linear endomorphism. We
More informationLeast square fit of a line/polynomial to input/output data
of a line/polynomial to input/output data Dr. Madhu N. Belur Control & Computing group Department of Electrical Engineering Indian Institute of Technology Bombay Email: belur@ee.iitb.ac.in 30th Nov, 2010
More informationLesson 6. Diana Pell. Monday, March 17. Section 4.1: Solve Linear Inequalities Using Properties of Inequality
Lesson 6 Diana Pell Monday, March 17 Section 4.1: Solve Linear Inequalities Using Properties of Inequality Example 1. Solve each inequality. Graph the solution set and write it using interval notation.
More informationMath 251 Midterm II Information Spring 2018
Math 251 Midterm II Information Spring 2018 WHEN: Thursday, April 12 (in class). You will have the entire period (125 minutes) to work on the exam. RULES: No books or notes. You may bring a non-graphing
More informationInverse Variation. y varies inversely as x. REMEMBER: Direct variation y = kx where k is not equal to 0.
Inverse Variation y varies inversely as x. REMEMBER: Direct variation y = kx where k is not equal to 0. Inverse variation xy = k or y = k where k is not equal to 0. x Identify whether the following functions
More information10.3 Steepest Descent Techniques
The advantage of the Newton and quasi-newton methods for solving systems of nonlinear equations is their speed of convergence once a sufficiently accurate approximation is known. A weakness of these methods
More informationMathematical Economics: Lecture 2
Mathematical Economics: Lecture 2 Yu Ren WISE, Xiamen University September 25, 2012 Outline 1 Number Line The number line, origin (Figure 2.1 Page 11) Number Line Interval (a, b) = {x R 1 : a < x < b}
More informationS56 (5.1) Integration.notebook March 09, 2017
Today we will be learning about integration (indefinite integrals) Integration What would you get if you undo the differentiation? Integration is the reverse process of differentiation. It is sometimes
More informationFitting Linear Statistical Models to Data by Least Squares I: Introduction
Fitting Linear Statistical Models to Data by Least Squares I: Introduction Brian R. Hunt and C. David Levermore University of Maryland, College Park Math 420: Mathematical Modeling January 25, 2012 version
More informationFunctions. Remark 1.2 The objective of our course Calculus is to study functions.
Functions 1.1 Functions and their Graphs Definition 1.1 A function f is a rule assigning a number to each of the numbers. The number assigned to the number x via the rule f is usually denoted by f(x).
More informationFind all of the real numbers x that satisfy the algebraic equation:
Appendix C: Factoring Algebraic Expressions Factoring algebraic equations is the reverse of expanding algebraic expressions discussed in Appendix B. Factoring algebraic equations can be a great help when
More informationSect Polynomial and Rational Inequalities
158 Sect 10.2 - Polynomial and Rational Inequalities Concept #1 Solving Inequalities Graphically Definition A Quadratic Inequality is an inequality that can be written in one of the following forms: ax
More information4 Problem Set 4 Bifurcations
4 PROBLEM SET 4 BIFURCATIONS 4 Problem Set 4 Bifurcations 1. Each of the following functions undergoes a bifurcation at the given parameter value. In each case use analytic or graphical techniques to identify
More informationClasses 6. Scilab: Symbolic and numerical calculations
Classes 6. Scilab: Symbolic and numerical calculations Note: When copying and pasting, you need to delete pasted single quotation marks and type them manually for each occurrence. 6.1 Creating polynomials
More informationStudent Instruction Sheet: Unit 1 Lesson 3. Polynomials
Student Instruction Sheet: Unit 1 Lesson 3 Suggested time: 150 min Polynomials What s important in this lesson: You will use algebra tiles to learn how to add/subtract polynomials. Problems are provided
More information1 The relation between a second order linear ode and a system of two rst order linear odes
Math 1280 Spring, 2010 1 The relation between a second order linear ode and a system of two rst order linear odes In Chapter 3 of the text you learn to solve some second order linear ode's, such as x 00
More informationSuppose that f is continuous on [a, b] and differentiable on (a, b). Then
Lectures 1/18 Derivatives and Graphs When we have a picture of the graph of a function f(x), we can make a picture of the derivative f (x) using the slopes of the tangents to the graph of f. In this section
More information3. Use absolute value notation to write an inequality that represents the statement: x is within 3 units of 2 on the real line.
PreCalculus Review Review Questions 1 The following transformations are applied in the given order) to the graph of y = x I Vertical Stretch by a factor of II Horizontal shift to the right by units III
More informationECS130 Scientific Computing. Lecture 1: Introduction. Monday, January 7, 10:00 10:50 am
ECS130 Scientific Computing Lecture 1: Introduction Monday, January 7, 10:00 10:50 am About Course: ECS130 Scientific Computing Professor: Zhaojun Bai Webpage: http://web.cs.ucdavis.edu/~bai/ecs130/ Today
More informationCalculus I Exam 1 Review Fall 2016
Problem 1: Decide whether the following statements are true or false: (a) If f, g are differentiable, then d d x (f g) = f g. (b) If a function is continuous, then it is differentiable. (c) If a function
More informationRelations and Functions (for Math 026 review)
Section 3.1 Relations and Functions (for Math 026 review) Objective 1: Understanding the s of Relations and Functions Relation A relation is a correspondence between two sets A and B such that each element
More informationMultiplication of Polynomials
Summary 391 Chapter 5 SUMMARY Section 5.1 A polynomial in x is defined by a finite sum of terms of the form ax n, where a is a real number and n is a whole number. a is the coefficient of the term. n is
More informationChapter 4: Interpolation and Approximation. October 28, 2005
Chapter 4: Interpolation and Approximation October 28, 2005 Outline 1 2.4 Linear Interpolation 2 4.1 Lagrange Interpolation 3 4.2 Newton Interpolation and Divided Differences 4 4.3 Interpolation Error
More informationNumerical solutions of nonlinear systems of equations
Numerical solutions of nonlinear systems of equations Tsung-Ming Huang Department of Mathematics National Taiwan Normal University, Taiwan E-mail: min@math.ntnu.edu.tw August 28, 2011 Outline 1 Fixed points
More informationMath 10b Ch. 8 Reading 1: Introduction to Taylor Polynomials
Math 10b Ch. 8 Reading 1: Introduction to Taylor Polynomials Introduction: In applications, it often turns out that one cannot solve the differential equations or antiderivatives that show up in the real
More informationCHALLENGE! (0) = 5. Construct a polynomial with the following behavior at x = 0:
TAYLOR SERIES Construct a polynomial with the following behavior at x = 0: CHALLENGE! P( x) = a + ax+ ax + ax + ax 2 3 4 0 1 2 3 4 P(0) = 1 P (0) = 2 P (0) = 3 P (0) = 4 P (4) (0) = 5 Sounds hard right?
More informationTwo hours. To be provided by Examinations Office: Mathematical Formula Tables. THE UNIVERSITY OF MANCHESTER. 29 May :45 11:45
Two hours MATH20602 To be provided by Examinations Office: Mathematical Formula Tables. THE UNIVERSITY OF MANCHESTER NUMERICAL ANALYSIS 1 29 May 2015 9:45 11:45 Answer THREE of the FOUR questions. If more
More informationCaculus 221. Possible questions for Exam II. March 19, 2002
Caculus 221 Possible questions for Exam II March 19, 2002 These notes cover the recent material in a style more like the lecture than the book. The proofs in the book are in section 1-11. At the end there
More informationLeast squares: the big idea
Notes for 2016-02-22 Least squares: the big idea Least squares problems are a special sort of minimization problem. Suppose A R m n where m > n. In general, we cannot solve the overdetermined system Ax
More informationChapter 2. Polynomial and Rational Functions. 2.5 Zeros of Polynomial Functions
Chapter 2 Polynomial and Rational Functions 2.5 Zeros of Polynomial Functions 1 / 33 23 Chapter 2 Homework 2.5 p335 6, 8, 10, 12, 16, 20, 24, 28, 32, 34, 38, 42, 46, 50, 52 2 / 33 23 3 / 33 23 Objectives:
More informationInterpolation and the Lagrange Polynomial
Interpolation and the Lagrange Polynomial MATH 375 J. Robert Buchanan Department of Mathematics Fall 2013 Introduction We often choose polynomials to approximate other classes of functions. Theorem (Weierstrass
More information(0, 0), (1, ), (2, ), (3, ), (4, ), (5, ), (6, ).
1 Interpolation: The method of constructing new data points within the range of a finite set of known data points That is if (x i, y i ), i = 1, N are known, with y i the dependent variable and x i [x
More informationPart I 5. Part II 2. Part III 8. Part IV 10. Part V 5 TOTAL 30
Page 1 of 10 Name/SID SOLUTION UNIVERSITY OF CALIFORNIA, COLLEGE OF ENGINEERING E77: INTRODUCTION TO COMPUTER PROGRAMMINGFOR SCIENTISTS AND ENGINEERS Professor Raja Sengupta Spring 2007 2nd Midterm Exam
More informationOCR A2 Level Mathematics Core Mathematics Scheme of Work
OCR A Level Mathematics Core Mathematics Scheme of Work Examination in June of Year 13 The Solomen press worksheets are an excellent resource and incorporated into the SOW NUMERICAL METHODS (6 ) (Solomen
More informationTaylor and Maclaurin Series. Approximating functions using Polynomials.
Taylor and Maclaurin Series Approximating functions using Polynomials. Approximating f x = e x near x = 0 In order to approximate the function f x = e x near x = 0, we can use the tangent line (The Linear
More informationAlgebra II: Strand 5. Power, Polynomial, and Rational Functions; Topic 3. Rational Functions; Task 5.3.1
TASK 5.3.: RATIONAL FUNCTIONS AND THEIR RECIPROCALS Solutions Rational functions appear frequently in business, science, engineering, and medical applications. This activity explores some aspects of rational
More informationCalculus (Math 1A) Lecture 6
Calculus (Math 1A) Lecture 6 Vivek Shende September 5, 2017 Hello and welcome to class! Hello and welcome to class! Last time Hello and welcome to class! Last time We introduced limits, and discussed slopes
More informationApplied Mathematics 205. Unit V: Eigenvalue Problems. Lecturer: Dr. David Knezevic
Applied Mathematics 205 Unit V: Eigenvalue Problems Lecturer: Dr. David Knezevic Unit V: Eigenvalue Problems Chapter V.2: Fundamentals 2 / 31 Eigenvalues and Eigenvectors Eigenvalues and eigenvectors of
More informationEDEXCEL NATIONAL CERTIFICATE UNIT 4 MATHEMATICS FOR TECHNICIANS OUTCOME 1
Learning outcomes EDEXCEL NATIONAL CERTIFICATE UNIT 4 MATHEMATICS FOR TECHNICIANS OUTCOME 1 TUTORIAL 3 - FACTORISATION AND QUADRATICS On completion of this unit a learner should: 1 Know how to use algebraic
More informationx x implies that f x f x.
Section 3.3 Intervals of Increase and Decrease and Extreme Values Let f be a function whose domain includes an interval I. We say that f is increasing on I if for every two numbers x 1, x 2 in I, x x implies
More informationDRAFT - Math 102 Lecture Note - Dr. Said Algarni
Math02 - Term72 - Guides and Exercises - DRAFT 7 Techniques of Integration A summery for the most important integrals that we have learned so far: 7. Integration by Parts The Product Rule states that if
More informationCS227-Scientific Computing. Lecture 4: A Crash Course in Linear Algebra
CS227-Scientific Computing Lecture 4: A Crash Course in Linear Algebra Linear Transformation of Variables A common phenomenon: Two sets of quantities linearly related: y = 3x + x 2 4x 3 y 2 = 2.7x 2 x
More informationCh 7 Summary - POLYNOMIAL FUNCTIONS
Ch 7 Summary - POLYNOMIAL FUNCTIONS 1. An open-top box is to be made by cutting congruent squares of side length x from the corners of a 8.5- by 11-inch sheet of cardboard and bending up the sides. a)
More informationINTERPOLATION Background Polynomial Approximation Problem:
INTERPOLATION Background Polynomial Approximation Problem: given f(x) C[a, b], find P n (x) = a 0 + a 1 x + a 2 x 2 + + a n x n with P n (x) close to f(x) for x [a, b]. Motivations: f(x) might be difficult
More informationExam in TMA4215 December 7th 2012
Norwegian University of Science and Technology Department of Mathematical Sciences Page of 9 Contact during the exam: Elena Celledoni, tlf. 7359354, cell phone 48238584 Exam in TMA425 December 7th 22 Allowed
More informationA Library of Functions
LibraryofFunctions.nb 1 A Library of Functions Any study of calculus must start with the study of functions. Functions are fundamental to mathematics. In its everyday use the word function conveys to us
More informationSimplifying Rational Expressions and Functions
Department of Mathematics Grossmont College October 15, 2012 Recall: The Number Types Definition The set of whole numbers, ={0, 1, 2, 3, 4,...} is the set of natural numbers unioned with zero, written
More informationMATLAB Examples 2 (covering Statistics Lectures 3 and 4)
MATLAB Examples 2 (covering Statistics Lectures 3 and 4) Contents Example 1: Fit a linearized regression model Example 2: Fit a parametric nonlinear model Example 3: Another optimization example Example
More informationIncreasing and decreasing intervals *
OpenStax-CNX module: m15474 1 Increasing and decreasing intervals * Sunil Kumar Singh This work is produced by OpenStax-CNX and licensed under the Creative Commons Attribution License 2.0 A function is
More informationTaylor and Maclaurin Series. Approximating functions using Polynomials.
Taylor and Maclaurin Series Approximating functions using Polynomials. Approximating f x = e x near x = 0 In order to approximate the function f x = e x near x = 0, we can use the tangent line (The Linear
More informationCandidates are expected to have available a calculator. Only division by (x + a) or (x a) will be required.
Revision Checklist Unit C2: Core Mathematics 2 Unit description Algebra and functions; coordinate geometry in the (x, y) plane; sequences and series; trigonometry; exponentials and logarithms; differentiation;
More informationUNC Charlotte Super Competition Level 3 Test March 4, 2019 Test with Solutions for Sponsors
. Find the minimum value of the function f (x) x 2 + (A) 6 (B) 3 6 (C) 4 Solution. We have f (x) x 2 + + x 2 + (D) 3 4, which is equivalent to x 0. x 2 + (E) x 2 +, x R. x 2 + 2 (x 2 + ) 2. How many solutions
More information2. If the discriminant of a quadratic equation is zero, then there (A) are 2 imaginary roots (B) is 1 rational root
Academic Algebra II 1 st Semester Exam Mr. Pleacher Name I. Multiple Choice 1. Which is the solution of x 1 3x + 7? (A) x -4 (B) x 4 (C) x -4 (D) x 4. If the discriminant of a quadratic equation is zero,
More informationCONTENTS COLLEGE ALGEBRA: DR.YOU
1 CONTENTS CONTENTS Textbook UNIT 1 LECTURE 1-1 REVIEW A. p. LECTURE 1- RADICALS A.10 p.9 LECTURE 1- COMPLEX NUMBERS A.7 p.17 LECTURE 1-4 BASIC FACTORS A. p.4 LECTURE 1-5. SOLVING THE EQUATIONS A.6 p.
More informationChapter Six. Polynomials. Properties of Exponents Algebraic Expressions Addition, Subtraction, and Multiplication Factoring Solving by Factoring
Chapter Six Polynomials Properties of Exponents Algebraic Expressions Addition, Subtraction, and Multiplication Factoring Solving by Factoring Properties of Exponents The properties below form the basis
More informationoutline Nonlinear transformation Error measures Noisy targets Preambles to the theory
Error and Noise outline Nonlinear transformation Error measures Noisy targets Preambles to the theory Linear is limited Data Hypothesis Linear in what? Linear regression implements Linear classification
More informationCore Mathematics C1. You must have: Mathematical Formulae and Statistical Tables (Pink) Calculators may NOT be used in this examination.
Write your name here Surname Other names Pearson Edexcel International Advanced Level Centre Number Core Mathematics C1 Advanced Subsidiary Candidate Number Monday 13 January 2014 Morning Time: 1 hour
More informationUnit 6: Absolute Value
Algebra 1 NAME: Unit 6: Absolute Value Note Packet Date Topic/Assignment HW Page 6-A Introduction to Absolute Value Functions 6-B Reflections of Absolute Value Functions 6-C Solve Absolute Value Equations
More informationMath 131. Increasing/Decreasing Functions and First Derivative Test Larson Section 3.3
Math 131. Increasing/Decreasing Functions and First Derivative Test Larson Section 3.3 Increasing and Decreasing Functions. A function f is increasing on an interval if for any two numbers x 1 and x 2
More informationOver Determined Algebraic Systems: Curve Fitting to Data
Over Determined Algebraic Systems: Curve Fitting to Data Introduction. In this section we investigate algebraic systems that have more equations than unknowns. In general, these will not have a solution
More informationMidterm solutions. (50 points) 2 (10 points) 3 (10 points) 4 (10 points) 5 (10 points)
Midterm solutions Advanced Linear Algebra (Math 340) Instructor: Jarod Alper April 26, 2017 Name: } {{ } Read all of the following information before starting the exam: You may not consult any outside
More informationSolution of Algebric & Transcendental Equations
Page15 Solution of Algebric & Transcendental Equations Contents: o Introduction o Evaluation of Polynomials by Horner s Method o Methods of solving non linear equations o Bracketing Methods o Bisection
More informationFrom Completing the Squares and Orthogonal Projection to Finite Element Methods
From Completing the Squares and Orthogonal Projection to Finite Element Methods Mo MU Background In scientific computing, it is important to start with an appropriate model in order to design effective
More informationThe function graphed below is continuous everywhere. The function graphed below is NOT continuous everywhere, it is discontinuous at x 2 and
Section 1.4 Continuity A function is a continuous at a point if its graph has no gaps, holes, breaks or jumps at that point. If a function is not continuous at a point, then we say it is discontinuous
More informationAlgebra II Standard Term 4 Review packet Test will be 60 Minutes 50 Questions
Algebra II Standard Term Review packet 2017 NAME Test will be 0 Minutes 0 Questions DIRECTIONS: Solve each problem, choose the correct answer, and then fill in the corresponding oval on your answer document.
More informationPolynomial Functions
Polynomial Functions NOTE: Some problems in this file are used with permission from the engageny.org website of the New York State Department of Education. Various files. Internet. Available from https://www.engageny.org/ccss-library.
More informationCollecting Like Terms
MPM1D Unit 2: Algebra Lesson 5 Learning goal: how to simplify algebraic expressions by collecting like terms. Date: Collecting Like Terms WARM-UP Example 1: Simplify each expression using exponent laws.
More informationBridge to Algebra II Standards for Mathematical Practice
Bridge to Algebra II Standards for Mathematical Practice The Standards for Mathematical Practices are to be interwoven and should be addressed throughout the year in as many different units and tasks as
More informationSkills Practice Skills Practice for Lesson 10.1
Skills Practice Skills Practice for Lesson.1 Name Date Higher Order Polynomials and Factoring Roots of Polynomial Equations Problem Set Solve each polynomial equation using factoring. Then check your solution(s).
More information5. Polynomial Functions and Equations
5. Polynomial Functions and Equations 1. Polynomial equations and roots. Solving polynomial equations in the chemical context 3. Solving equations of multiple unknowns 5.1. Polynomial equations and roots
More informationb n x n + b n 1 x n b 1 x + b 0
Math Partial Fractions Stewart 7.4 Integrating basic rational functions. For a function f(x), we have examined several algebraic methods for finding its indefinite integral (antiderivative) F (x) = f(x)
More informationPLC Papers. Created For:
PLC Papers Created For: Algebra and proof 2 Grade 8 Objective: Use algebra to construct proofs Question 1 a) If n is a positive integer explain why the expression 2n + 1 is always an odd number. b) Use
More information