Numerical Methods. Lecture Notes #08 Discrete Least Square Approximation
|
|
- Lucas Ramsey
- 6 years ago
- Views:
Transcription
1 Numerical Methods Discrete Least Square Approximation Pavel Ludvík, March 30, 2016 Department of Mathematics and Descriptive Geometry VŠB-TUO lud0016/ 1 / 23
2 Introduction Introduction: Matching a Few Parameters to a Lot of Data. Sometimes we get a lot of data, many observations, and want to fit it to a simple model data interpolation approximation / 23
3 Introduction Why a Low Dimensional Model? Low dimensional models (e.g. low degree polynomials) are easy to work with, and are quite well behaved (high degree polynomials can be quite oscillatory). 3 / 23
4 Introduction Why a Low Dimensional Model? Low dimensional models (e.g. low degree polynomials) are easy to work with, and are quite well behaved (high degree polynomials can be quite oscillatory). All measurements are noisy, to some degree. Often, we want to use a large number of measurements in order to " average out" random noise. 3 / 23
5 Introduction Why a Low Dimensional Model? Low dimensional models (e.g. low degree polynomials) are easy to work with, and are quite well behaved (high degree polynomials can be quite oscillatory). All measurements are noisy, to some degree. Often, we want to use a large number of measurements in order to " average out" random noise. Approximation Theory looks at two problems: [1] Given a data set, find the best fit for a model (i.e. in a class of functions, find the one that best represents the data.) 3 / 23
6 Introduction Why a Low Dimensional Model? Low dimensional models (e.g. low degree polynomials) are easy to work with, and are quite well behaved (high degree polynomials can be quite oscillatory). All measurements are noisy, to some degree. Often, we want to use a large number of measurements in order to " average out" random noise. Approximation Theory looks at two problems: [1] Given a data set, find the best fit for a model (i.e. in a class of functions, find the one that best represents the data.) [2] Find a simpler model approximating a given function. 3 / 23
7 Introduction Interpolation: A Bad Idea? We can probably agree that trying to interpolate this data set: 4 / 23
8 Introduction Interpolation: A Bad Idea? We can probably agree that trying to interpolate this data set: data interpolation approximation / 23
9 Introduction Interpolation: A Bad Idea? We can probably agree that trying to interpolate this data set: data interpolation approximation with a 9th degree polynomial is not the best idea in the world... So what do we do? 4 / 23
10 Introduction Defining Best Fit the Residual. We are going to relax the requirement that the approximating function must pass through all the data points. Now we need a measurement of how well our approximation fits the data. A definition of best fit. 5 / 23
11 Introduction Defining Best Fit the Residual. We are going to relax the requirement that the approximating function must pass through all the data points. Now we need a measurement of how well our approximation fits the data. A definition of best fit. If f (x i ) are the measured function values, and a(x i ) are the values of our approximating functions, we can define a function, r(x i ) = f (x i ) a(x i ) which measures the deviation (residual) at x i. Notice that r = {r(x 0 ), r(x 1 ),..., r(x n )} T is a vector. Notation: From now on, f i = f (x i ), a i = a(x i ), and r i = r(x i ). Further, f = {f0, f 1,..., f n } T, ã = {a 0, a 1,..., a n } T, and r = {r 0, r 1,..., r n } T. 5 / 23
12 Introduction What is the Size of the Residual There are many possible reasonable choices, e.g. The abs-sum of the deviations: E 1 = r i E 1 = r 1 The sum-of-squares of the deviations: E 2 = n r i 2 E 2 = r 2 The largest of the deviations: E = max 0 i n r i E = r In most cases, the sum-of-the-squares version is the easiest to work with. (From now on we will focus on this choice... ) 6 / 23
13 Discrete Least Squares Approximation We have chosen the sum-of-squares measurement for errors. Lets find the constant that best fits the data, minimize E(C) = (f i C) 2. If C is a minimizer, then E (C ) = 0 (since derivative at a max/min is zero). E (C) = 2(f i C) = 2 f i + 2(n + 1)C, E (C) = 2(n + 1) 7 / 23
14 Discrete Least Squares Approximation We have chosen the sum-of-squares measurement for errors. Lets find the constant that best fits the data, minimize E(C) = (f i C) 2. If C is a minimizer, then E (C ) = 0 (since derivative at a max/min is zero). E (C) = 2(f i C) = 2 f i + 2(n + 1)C, E (C) = 2(n + 1) hence C = 1 n + 1 f i, it is a min since E (C ) = 2(n + 1) > 0, is the constant that best fits the data. (Note: C is the average.) 7 / 23
15 Discrete Least Squares: Linear Approximation The form of Least Squares you are most likely to see: Find the Linear Function, p 1 (x) = a 1 + a 1 x, that best fits the data. The error E(a 0, a 1 ) we need to minimize is: E(a 0, a 1 ) = [(a 0 + a 1 x i ) f i ] 2. 8 / 23
16 Discrete Least Squares: Linear Approximation The form of Least Squares you are most likely to see: Find the Linear Function, p 1 (x) = a 1 + a 1 x, that best fits the data. The error E(a 0, a 1 ) we need to minimize is: E(a 0, a 1 ) = [(a 0 + a 1 x i ) f i ] 2. The first partial derivatives with respect to a 0 and a 1 better be zero at the minimum: E(a 0, a 1 ) = 2 [(a 0 + a 1 x i ) f i ] = 0 a 0 a 1 E(a 0, a 1 ) = 2 x i [(a 0 + a 1 x i ) f i ] = 0. Now, we work on these expressions to get the Normal Equations... 8 / 23
17 Linear Approximation: The Normal Equations p 1 (x) [(a 0 + a 1 x i ) f i ] = 0 x i [(a 0 + a 1 x i ) f i ] = 0. 9 / 23
18 Linear Approximation: The Normal Equations p 1 (x) a 0 (n + 1) + a 1 a 0 x i + a 1 x i = x 2 i = f i x i f i Since everything except a 0 and a 1 is known, this is a 2-by-2 system of equations. 9 / 23
19 Linear Approximation: The Normal Equations p 1 (x) a 0 (n + 1) + a 1 a 0 x i + a 1 x i = x 2 i = f i x i f i Since everything except a 0 and a 1 is known, this is a 2-by-2 system of equations. [ (n + 1) n x ] [ ] [ n i n x a0 n i x i 2 = f ] i a n 1 x if i 9 / 23
20 Quadratic Model, p 2 (x) For the quadratic polynomial p 2 (x) = a 0 + a 1 x + a 2 x 2, the error is given by E(a 0, a 1, a 2 ) = [a 0 + a 1 x i + a 2 xi 2 f i ] 2 At the minimum (best model) we must have E(a 0, a 1, a 2 ) = 2 [(a 0 + a 1 x i + a 2 xi 2 ) f i ] = 0 a 0 a 1 E(a 0, a 1, a 2 ) = 2 a 2 E(a 0, a 1, a 2 ) = 2 x i [(a 0 + a 1 x i + a 2 x 2 i ) f i ] = 0 x 2 i [(a 0 + a 1 x i + a 2 x 2 i ) f i ] = 0 10 / 23
21 Quadratic Model: The Normal Equations Similarly for the quadratic polynomial p 2 (x) = a 0 + a 1 x + a 2 x 2, the normal equations are: a 0 (n + 1) + a 1 x i + a 2 xi 2 = f i Note: a 0 x i + a 1 a 0 x 2 i + a 1 x 2 i + a 2 x 3 i + a 2 x 3 i = x 4 i = x i f i x 2 i f i p 2 (x) Even though the model is quadratic, the resulting (normal) equations are linear The model is linear in its parameters, a 0, a 1 and a / 23
22 The Normal Equations As Matrix Equations We have: a 0 (n + 1) + a 1 a 0 x i + a 1 a 0 x 2 i + a 1 x i + a 2 x 2 i + a 2 x 3 i + a 2 x 2 i = x 3 i = x 4 i = f i x i f i x 2 i f i 12 / 23
23 The Normal Equations As Matrix Equations We rewrite the Normal Equations as: (n + 1) n x n i x 2 i n x n i x i 2 a n 0 n x i 3 f i a n x i 2 n x i 3 1 = n n x i 4 x if i n a 2 x i 2 f i It is not immediately obvious, but this expression can be written in the form A T Aã = A T f. Where matrix A is very easy to write in terms of x i. 12 / 23
24 The Polynomial Equations in Matrix Form We can express the m th degree polynomial, p m (x), evaluated at the points x i : a 0 + a 1 x i + a 2 x 2 i + + a m x m i = f i, i = 0,..., n p m (x) as a product of an (n + 1)-by-(m + 1) matrix, A and the (m + 1)-by-1 vector ã and the result is the (n + 1)-by-1 vector f, usually n >> m: 1 x 0 x0 2 x m 0 1 x 1 x1 2 x m a 0 f x 2 x2 2 x2 m a 1 f 1 1 x 3 x3 2 x3 m a 2 = f x n xn 2 xn m a m f m 13 / 23
25 Building a Solvable System from Aã = f We cannot immediately solve the linear system Aã = f when A is a rectangular matrix (n + 1)-by-(m + 1), m n. We can generate a solvable system by multiplying both the left- and right-hand-side by A T, i.e. A T Aã = A T f Now, the matrix A T A is a square (m + 1)-by-(m + 1) matrix, and A T f an (m + 1)-by-1 vector. Let s take a closer look at A T A, and A T f / 23
26 Computing A T A 1 x x0 2 x m 0 x 0 x 1 x 2 x 3 x n 1 x 1 x1 2 x m 1 x0 2 x1 2 x2 2 x3 2 xn 2 1 x 2 x2 2 x m 2 1 x 3 x3 2 x m x0 m x1 m x2 m x3 m xn m x n xn 2 xn m n + 1 = 15 / 23
27 Computing A T A 1 x x0 2 x m 0 x 0 x 1 x 2 x 3 x n 1 x 1 x1 2 x m 1 x0 2 x1 2 x2 2 x3 2 xn 2 1 x 2 x2 2 x m 2 1 x 3 x3 2 x m x0 m x1 m x2 m x3 m xn m x n xn 2 xn m n + 1 n x m i = 16 / 23
28 Computing A T A 1 x x0 2 x m 0 x 0 x 1 x 2 x 3 x n 1 x 1 x1 2 x m 1 x0 2 x1 2 x2 2 x3 2 xn 2 1 x 2 x2 2 x m 2 1 x 3 x3 2 x m x0 m x1 m x2 m x3 m xn m x n xn 2 xn m n + 1 n x m i = n x i m 17 / 23
29 Computing A T A 1 x x0 2 x m 0 x 0 x 1 x 2 x 3 x n 1 x 1 x1 2 x m 1 x0 2 x1 2 x2 2 x3 2 xn 2 1 x 2 x2 2 x m 2 1 x 3 x3 2 x m x0 m x1 m x2 m x3 m xn m x n xn 2 xn m n + 1 n x m i = n x i m n x i 2m 18 / 23
30 Computing A T A 1 x x0 2 x m 0 x 0 x 1 x 2 x 3 x n 1 x 1 x1 2 x m 1 x0 2 x1 2 x2 2 x3 2 xn 2 1 x 2 x2 2 x m 2 1 x 3 x3 2 x m x0 m x1 m x2 m x3 m xn m x n xn 2 xn m n + 1 n x 1 i n x m i n = x i 1 n x i 2 n x m+1 i n x i m n x m+1 i n x i 2m 19 / 23
31 Computing A T f f 0 x 0 x 1 x 2 x 3 x n f 1 x0 2 x1 2 x2 2 x3 2 xn 2 f 2 = x0 m x1 m x2 m x3 m xn m f n Thus, we have recovered the Normal Equations... n f i n x if i n x i 2 f i. n x i m f i 20 / 23
32 A Simple, Powerful Approach Discrete Least Squares: A Simple, Powerful Method Given the data set ( x, f), where x = {x 0, x 1,..., x n } T and f = {f0, f 1,..., f n } T, we can quickly find the best polynomial fit for any specified polynomial degree! Notation: Let x j be the vector {x j 0, x j 1,..., x j n} T. Example To compute the best fitting polynomial of degree 3, p 3 (x) = a 0 + a 1 x + a 2 x 2 + a 3 x 3, define:.... A = 1 x x 2 x 3, and compute.... ã = (A T A) 1 (A T f) (not necessarily like this.) 21 / 23
33 A Simple, Powerful Approach But... I do not want to fit a polynomial!!! Fitting an exponential model g(x) = be cx to the given data d, is quite straight-forward. 22 / 23
34 A Simple, Powerful Approach But... I do not want to fit a polynomial!!! Fitting an exponential model g(x) = be cx to the given data d, is quite straight-forward. First, re-cast the problem as a set of linear equations. We have: be cx i = d i, i = 0,..., n compute the natural logarithm on both sides: ln b+ a 0 + cx i = ln d i a 1 x i =f i 22 / 23
35 A Simple, Powerful Approach But... I do not want to fit a polynomial!!! Fitting an exponential model g(x) = be cx to the given data d, is quite straight-forward. First, re-cast the problem as a set of linear equations. We have: be cx i = d i, i = 0,..., n compute the natural logarithm on both sides: ln b+ a 0 + cx i = ln d i a 1 x i =f i Now, we can apply a polynomial least squares fit to the problem and once we have (a 0, a 1 ), b = e a 0 and c = a 1. Note This does not give the least squares fit to the original problem!!! (It gives us a pretty good estimate.) 22 / 23
36 A Simple, Powerful Approach But... That is not a True Least Squares Fit! Note This does not give the least squares fit to the original problem!!! (It gives us a pretty good estimate.) In order to find the true least squares fit we need to know how to find roots and/or minima/maxima of non-linear systems of equations. Feel free to look at Burden-Faires Chapter / 23
Jim Lambers MAT 419/519 Summer Session Lecture 13 Notes
Jim Lambers MAT 419/519 Summer Session 2011-12 Lecture 13 Notes These notes correspond to Section 4.1 in the text. Least Squares Fit One of the most fundamental problems in science and engineering is data
More informationInterpolating Accuracy without underlying f (x)
Example: Tabulated Data The following table x 1.0 1.3 1.6 1.9 2.2 f (x) 0.7651977 0.6200860 0.4554022 0.2818186 0.1103623 lists values of a function f at various points. The approximations to f (1.5) obtained
More informationINTEGRATION OF RATIONAL FUNCTIONS BY PARTIAL FRACTIONS
INTEGRATION OF RATIONAL FUNCTIONS BY PARTIAL FRACTIONS. Introduction It is possible to integrate any rational function, constructed as the ratio of polynomials by epressing it as a sum of simpler fractions
More information7x 5 x 2 x + 2. = 7x 5. (x + 1)(x 2). 4 x
Advanced Integration Techniques: Partial Fractions The method of partial fractions can occasionally make it possible to find the integral of a quotient of rational functions. Partial fractions gives us
More information3 Polynomial and Rational Functions
3 Polynomial and Rational Functions 3.1 Polynomial Functions and their Graphs So far, we have learned how to graph polynomials of degree 0, 1, and. Degree 0 polynomial functions are things like f(x) =,
More informationAPPENDIX : PARTIAL FRACTIONS
APPENDIX : PARTIAL FRACTIONS Appendix : Partial Fractions Given the expression x 2 and asked to find its integral, x + you can use work from Section. to give x 2 =ln( x 2) ln( x + )+c x + = ln k x 2 x+
More informationNewton s Method and Linear Approximations
Newton s Method and Linear Approximations Curves are tricky. Lines aren t. Newton s Method and Linear Approximations Newton s Method for finding roots Goal: Where is f (x) = 0? f (x) = x 7 + 3x 3 + 7x
More information(x + 1)(x 2) = 4. x
dvanced Integration Techniques: Partial Fractions The method of partial fractions can occasionally make it possible to find the integral of a quotient of rational functions. Partial fractions gives us
More information3 Algebraic Methods. we can differentiate both sides implicitly to obtain a differential equation involving x and y:
3 Algebraic Methods b The first appearance of the equation E Mc 2 in Einstein s handwritten notes. So far, the only general class of differential equations that we know how to solve are directly integrable
More informationTropical Polynomials
1 Tropical Arithmetic Tropical Polynomials Los Angeles Math Circle, May 15, 2016 Bryant Mathews, Azusa Pacific University In tropical arithmetic, we define new addition and multiplication operations on
More informationx is also called the abscissa y is also called the ordinate "If you can create a t-table, you can graph anything!"
Senior Math Section 6-1 Notes Rectangular Coordinates and Lines Label the following 1. quadrant 1 2. quadrant 2 3. quadrant 3 4. quadrant 4 5. origin 6. x-axis 7. y-axis 8. Ordered Pair (x, y) at (2, 1)
More informationHow might we evaluate this? Suppose that, by some good luck, we knew that. x 2 5. x 2 dx 5
8.4 1 8.4 Partial Fractions Consider the following integral. 13 2x (1) x 2 x 2 dx How might we evaluate this? Suppose that, by some good luck, we knew that 13 2x (2) x 2 x 2 = 3 x 2 5 x + 1 We could then
More informationNewton s Method and Linear Approximations
Newton s Method and Linear Approximations Newton s Method for finding roots Goal: Where is f (x) =0? f (x) =x 7 +3x 3 +7x 2 1 2-1 -0.5 0.5-2 Newton s Method for finding roots Goal: Where is f (x) =0? f
More informationFunctions of Several Variables: Limits and Continuity
Functions of Several Variables: Limits and Continuity Philippe B. Laval KSU Today Philippe B. Laval (KSU) Limits and Continuity Today 1 / 24 Introduction We extend the notion of its studied in Calculus
More informationPARTIAL FRACTIONS AND POLYNOMIAL LONG DIVISION. The basic aim of this note is to describe how to break rational functions into pieces.
PARTIAL FRACTIONS AND POLYNOMIAL LONG DIVISION NOAH WHITE The basic aim of this note is to describe how to break rational functions into pieces. For example 2x + 3 = + x 3 x +. The point is that we don
More informationMSM120 1M1 First year mathematics for civil engineers Revision notes 3
MSM0 M First year mathematics for civil engineers Revision notes Professor Robert. Wilson utumn 00 Functions Definition of a function: it is a rule which, given a value of the independent variable (often
More informationDIFFERENTIATION AND INTEGRATION PART 1. Mr C s IB Standard Notes
DIFFERENTIATION AND INTEGRATION PART 1 Mr C s IB Standard Notes In this PDF you can find the following: 1. Notation 2. Keywords Make sure you read through everything and the try examples for yourself before
More informationSYDE 112, LECTURE 7: Integration by Parts
SYDE 112, LECTURE 7: Integration by Parts 1 Integration By Parts Consider trying to take the integral of xe x dx. We could try to find a substitution but would quickly grow frustrated there is no substitution
More informationA Library of Functions
LibraryofFunctions.nb 1 A Library of Functions Any study of calculus must start with the study of functions. Functions are fundamental to mathematics. In its everyday use the word function conveys to us
More informationNewton s Method and Linear Approximations 10/19/2011
Newton s Method and Linear Approximations 10/19/2011 Curves are tricky. Lines aren t. Newton s Method and Linear Approximations 10/19/2011 Newton s Method Goal: Where is f (x) =0? f (x) =x 7 +3x 3 +7x
More information1.4 Techniques of Integration
.4 Techniques of Integration Recall the following strategy for evaluating definite integrals, which arose from the Fundamental Theorem of Calculus (see Section.3). To calculate b a f(x) dx. Find a function
More informationMULTIPLYING TRINOMIALS
Name: Date: 1 Math 2 Variable Manipulation Part 4 Polynomials B MULTIPLYING TRINOMIALS Multiplying trinomials is the same process as multiplying binomials except for there are more terms to multiply than
More informationa factors The exponential 0 is a special case. If b is any nonzero real number, then
0.1 Exponents The expression x a is an exponential expression with base x and exponent a. If the exponent a is a positive integer, then the expression is simply notation that counts how many times the
More informationSolving Quadratic & Higher Degree Equations
Chapter 9 Solving Quadratic & Higher Degree Equations Sec 1. Zero Product Property Back in the third grade students were taught when they multiplied a number by zero, the product would be zero. In algebra,
More informationCURVE FITTING LEAST SQUARE LINE. Consider the class of linear function of the form. = Ax+ B...(1)
CURVE FITTIG LEAST SQUARE LIE Consider the class of linear function of the form y = f( x) = B...() In previous chapter we saw how to construct a polynomial that passes through a set of points. If all numerical
More informationLinear Least-Squares Data Fitting
CHAPTER 6 Linear Least-Squares Data Fitting 61 Introduction Recall that in chapter 3 we were discussing linear systems of equations, written in shorthand in the form Ax = b In chapter 3, we just considered
More informationMIT Final Exam Solutions, Spring 2017
MIT 8.6 Final Exam Solutions, Spring 7 Problem : For some real matrix A, the following vectors form a basis for its column space and null space: C(A) = span,, N(A) = span,,. (a) What is the size m n of
More informationAP Calculus Chapter 9: Infinite Series
AP Calculus Chapter 9: Infinite Series 9. Sequences a, a 2, a 3, a 4, a 5,... Sequence: A function whose domain is the set of positive integers n = 2 3 4 a n = a a 2 a 3 a 4 terms of the sequence Begin
More informationThis Week. Professor Christopher Hoffman Math 124
This Week Sections 2.1-2.3,2.5,2.6 First homework due Tuesday night at 11:30 p.m. Average and instantaneous velocity worksheet Tuesday available at http://www.math.washington.edu/ m124/ (under week 2)
More informationA first order divided difference
A first order divided difference For a given function f (x) and two distinct points x 0 and x 1, define f [x 0, x 1 ] = f (x 1) f (x 0 ) x 1 x 0 This is called the first order divided difference of f (x).
More informationExploring and Generalizing Transformations of Functions
Exploring and Generalizing Transformations of Functions In Algebra 1 and Algebra 2, you have studied transformations of functions. Today, you will revisit and generalize that knowledge. Goals: The goals
More informationIntegration of Rational Functions by Partial Fractions
Integration of Rational Functions by Partial Fractions Part 2: Integrating Rational Functions Rational Functions Recall that a rational function is the quotient of two polynomials. x + 3 x + 2 x + 2 x
More informationPartial Fractions. June 27, In this section, we will learn to integrate another class of functions: the rational functions.
Partial Fractions June 7, 04 In this section, we will learn to integrate another class of functions: the rational functions. Definition. A rational function is a fraction of two polynomials. For example,
More informationSolving Quadratic & Higher Degree Equations
Chapter 9 Solving Quadratic & Higher Degree Equations Sec 1. Zero Product Property Back in the third grade students were taught when they multiplied a number by zero, the product would be zero. In algebra,
More informationFault Tolerant Computing CS 530DL
Fault Tolerant Computing CS 530DL Additional Lecture Notes Modeling Yashwant K. Malaiya Colorado State University March 8, 2017 1 Quantitative models Derived from first principles: Arguments are actual
More informationUNC Charlotte Super Competition Level 3 Test March 4, 2019 Test with Solutions for Sponsors
. Find the minimum value of the function f (x) x 2 + (A) 6 (B) 3 6 (C) 4 Solution. We have f (x) x 2 + + x 2 + (D) 3 4, which is equivalent to x 0. x 2 + (E) x 2 +, x R. x 2 + 2 (x 2 + ) 2. How many solutions
More information8 + 6) x 2 ) y = h(x)
. a. Horizontal shift 6 left and vertical shift up. Notice B' is ( 6, ) and B is (0, 0). b. h(x) = 0.5(x + 6) + (Enter in a grapher to check.) c. Use the graph. Notice A' to see h(x) crosses the x-axis
More informationUNC Charlotte 2004 Algebra with solutions
with solutions March 8, 2004 1. Let z denote the real number solution to of the digits of z? (A) 13 (B) 14 (C) 15 (D) 16 (E) 17 3 + x 1 = 5. What is the sum Solution: E. Square both sides twice to get
More informationCHAPTER 2 POLYNOMIALS KEY POINTS
CHAPTER POLYNOMIALS KEY POINTS 1. Polynomials of degrees 1, and 3 are called linear, quadratic and cubic polynomials respectively.. A quadratic polynomial in x with real coefficient is of the form a x
More informationApproximation, Taylor Polynomials, and Derivatives
Approximation, Taylor Polynomials, and Derivatives Derivatives for functions f : R n R will be central to much of Econ 501A, 501B, and 520 and also to most of what you ll do as professional economists.
More informationCLASS NOTES Computational Methods for Engineering Applications I Spring 2015
CLASS NOTES Computational Methods for Engineering Applications I Spring 2015 Petros Koumoutsakos Gerardo Tauriello (Last update: July 27, 2015) IMPORTANT DISCLAIMERS 1. REFERENCES: Much of the material
More informationCurve Fitting. Objectives
Curve Fitting Objectives Understanding the difference between regression and interpolation. Knowing how to fit curve of discrete with least-squares regression. Knowing how to compute and understand the
More informationMatrix Theory and Differential Equations Homework 2 Solutions, due 9/7/6
Matrix Theory and Differential Equations Homework Solutions, due 9/7/6 Question 1 Consider the differential equation = x y +. Plot the slope field for the differential equation. In particular plot all
More informationPermutations and Polynomials Sarah Kitchen February 7, 2006
Permutations and Polynomials Sarah Kitchen February 7, 2006 Suppose you are given the equations x + y + z = a and 1 x + 1 y + 1 z = 1 a, and are asked to prove that one of x,y, and z is equal to a. We
More informationInterpolation APPLIED PROBLEMS. Reading Between the Lines FLY ROCKET FLY, FLY ROCKET FLY WHAT IS INTERPOLATION? Figure Interpolation of discrete data.
WHAT IS INTERPOLATION? Given (x 0,y 0 ), (x,y ), (x n,y n ), find the value of y at a value of x that is not given. Interpolation Reading Between the Lines Figure Interpolation of discrete data. FLY ROCKET
More informationPractice Calculus Test without Trig
Practice Calculus Test without Trig The problems here are similar to those on the practice test Slight changes have been made 1 What is the domain of the function f (x) = 3x 1? Express the answer in interval
More informationTenth Maths Polynomials
Tenth Maths Polynomials Polynomials are algebraic expressions constructed using constants and variables. Coefficients operate on variables, which can be raised to various powers of non-negative integer
More informationTaylor polynomials. 1. Introduction. 2. Linear approximation.
ucsc supplementary notes ams/econ 11a Taylor polynomials c 01 Yonatan Katznelson 1. Introduction The most elementary functions are polynomials because they involve only the most basic arithmetic operations
More informationSolution: f( 1) = 3 1)
Gateway Questions How to Evaluate Functions at a Value Using the Rules Identify the independent variable in the rule of function. Replace the independent variable with big parenthesis. Plug in the input
More information1 Functions, Graphs and Limits
1 Functions, Graphs and Limits 1.1 The Cartesian Plane In this course we will be dealing a lot with the Cartesian plane (also called the xy-plane), so this section should serve as a review of it and its
More information6x 2 8x + 5 ) = 12x 8
Example. If f(x) = x 3 4x + 5x + 1, then f (x) = 6x 8x + 5 Observation: f (x) is also a differentiable function... d dx ( f (x) ) = d dx ( 6x 8x + 5 ) = 1x 8 The derivative of f (x) is called the second
More informationDecoding Reed-Muller codes over product sets
Rutgers University May 30, 2016 Overview Error-correcting codes 1 Error-correcting codes Motivation 2 Reed-Solomon codes Reed-Muller codes 3 Error-correcting codes Motivation Goal: Send a message Don t
More informationMath 10b Ch. 8 Reading 1: Introduction to Taylor Polynomials
Math 10b Ch. 8 Reading 1: Introduction to Taylor Polynomials Introduction: In applications, it often turns out that one cannot solve the differential equations or antiderivatives that show up in the real
More informationChapter 4 Finite Fields
Chapter 4 Finite Fields Introduction will now introduce finite fields of increasing importance in cryptography AES, Elliptic Curve, IDEA, Public Key concern operations on numbers what constitutes a number
More informationMATH 121: EXTRA PRACTICE FOR TEST 2. Disclaimer: Any material covered in class and/or assigned for homework is a fair game for the exam.
MATH 121: EXTRA PRACTICE FOR TEST 2 Disclaimer: Any material covered in class and/or assigned for homework is a fair game for the exam. 1 Linear Functions 1. Consider the functions f(x) = 3x + 5 and g(x)
More informationLinear DifferentiaL Equation
Linear DifferentiaL Equation Massoud Malek The set F of all complex-valued functions is known to be a vector space of infinite dimension. Solutions to any linear differential equations, form a subspace
More informationSection 8.3 Partial Fraction Decomposition
Section 8.6 Lecture Notes Page 1 of 10 Section 8.3 Partial Fraction Decomposition Partial fraction decomposition involves decomposing a rational function, or reversing the process of combining two or more
More information3 Inequalities Absolute Values Inequalities and Intervals... 18
Contents 1 Real Numbers, Exponents, and Radicals 1.1 Rationalizing the Denominator................................... 1. Factoring Polynomials........................................ 1. Algebraic and Fractional
More informationMODEL ANSWERS TO HWK #10
MODEL ANSWERS TO HWK #10 1. (i) As x + 4 has degree one, either it divides x 3 6x + 7 or these two polynomials are coprime. But if x + 4 divides x 3 6x + 7 then x = 4 is a root of x 3 6x + 7, which it
More informationComputational Methods. Least Squares Approximation/Optimization
Computational Methods Least Squares Approximation/Optimization Manfred Huber 2011 1 Least Squares Least squares methods are aimed at finding approximate solutions when no precise solution exists Find the
More informationLimits at Infinity. Horizontal Asymptotes. Definition (Limits at Infinity) Horizontal Asymptotes
Limits at Infinity If a function f has a domain that is unbounded, that is, one of the endpoints of its domain is ±, we can determine the long term behavior of the function using a it at infinity. Definition
More informationAnalysis II: Basic knowledge of real analysis: Part V, Power Series, Differentiation, and Taylor Series
.... Analysis II: Basic knowledge of real analysis: Part V, Power Series, Differentiation, and Taylor Series Kenichi Maruno Department of Mathematics, The University of Texas - Pan American March 4, 20
More informationSince the logs have the same base, I can set the arguments equal and solve: x 2 30 = x x 2 x 30 = 0
LOGARITHMIC EQUATIONS (LOGS) 1 Type 1: The first type of logarithmic equation has two logs, each having the same base, set equal to each other, and you solve by setting the insides (the "arguments") equal
More informationNewton-Raphson Type Methods
Int. J. Open Problems Compt. Math., Vol. 5, No. 2, June 2012 ISSN 1998-6262; Copyright c ICSRS Publication, 2012 www.i-csrs.org Newton-Raphson Type Methods Mircea I. Cîrnu Department of Mathematics, Faculty
More informationComputing Derivatives With Formulas Some More (pages 14-15), Solutions
Computing Derivatives With Formulas Some More pages 14-15), Solutions This worksheet focuses on computing derivatives using the shortcut formulas, including the power rule, product rule, quotient rule,
More informationCALCULUS AB SUMMER ASSIGNMENT
CALCULUS AB SUMMER ASSIGNMENT Dear Prospective Calculus Students, Welcome to AP Calculus. This is a rigorous, yet rewarding, math course. Most of the students who have taken Calculus in the past are amazed
More informationName: Partners: PreCalculus. Review 5 Version A
Name: Partners: PreCalculus Date: Review 5 Version A [A] Circle whether each statement is true or false. 1. 3 log 3 5x = 5x 2. log 2 16 x+3 = 4x + 3 3. ln x 6 + ln x 5 = ln x 30 4. If ln x = 4, then e
More informationPARTIAL FRACTIONS AND POLYNOMIAL LONG DIVISION. The basic aim of this note is to describe how to break rational functions into pieces.
PARTIAL FRACTIONS AND POLYNOMIAL LONG DIVISION NOAH WHITE The basic aim of this note is to describe how to break rational functions into pieces. For example 2x + 3 1 = 1 + 1 x 1 3 x + 1. The point is that
More information2 2xdx. Craigmount High School Mathematics Department
Π 5 3 xdx 5 cosx 4 6 3 8 Help Your Child With Higher Maths Introduction We ve designed this booklet so that you can use it with your child throughout the session, as he/she moves through the Higher course,
More informationGreat Theoretical Ideas in Computer Science
15-251 Great Theoretical Ideas in Computer Science Polynomials, Lagrange, and Error-correction Lecture 23 (November 10, 2009) P(X) = X 3 X 2 + + X 1 + Definition: Recall: Fields A field F is a set together
More informationParametric Equations
Parametric Equations By: OpenStaxCollege Consider the path a moon follows as it orbits a planet, which simultaneously rotates around the sun, as seen in [link]. At any moment, the moon is located at a
More informationAlgebra II with Trig 3 rd Nine Weeks Pacing Guide Grade 11
2017-2018 Grade 11 Week 1 (1/8-1/12) 6-1, 6-2, 6-3 First Semester Report Cards go home January 10 th Week 2 (1/15-1/19) 6-4, 6-5 24. [A-REI.12T] Solve simple rational and radical equations in one variable,
More informationHigh School Math Contest
High School Math Contest University of South Carolina February th, 017 Problem 1. If (x y) = 11 and (x + y) = 169, what is xy? (a) 11 (b) 1 (c) 1 (d) (e) 8 Solution: Note that xy = (x + y) (x y) = 169
More informationExponential and. Logarithmic Functions. Exponential Functions. Logarithmic Functions
Chapter Five Exponential and Logarithmic Functions Exponential Functions Logarithmic Functions Properties of Logarithms Exponential Equations Exponential Situations Logarithmic Equations Exponential Functions
More information(0, 0), (1, ), (2, ), (3, ), (4, ), (5, ), (6, ).
1 Interpolation: The method of constructing new data points within the range of a finite set of known data points That is if (x i, y i ), i = 1, N are known, with y i the dependent variable and x i [x
More informationCalculus (Math 1A) Lecture 4
Calculus (Math 1A) Lecture 4 Vivek Shende August 31, 2017 Hello and welcome to class! Last time We discussed shifting, stretching, and composition. Today We finish discussing composition, then discuss
More informationCalculus (Math 1A) Lecture 4
Calculus (Math 1A) Lecture 4 Vivek Shende August 30, 2017 Hello and welcome to class! Hello and welcome to class! Last time Hello and welcome to class! Last time We discussed shifting, stretching, and
More informationINTERNET MAT 117 Review Problems. (1) Let us consider the circle with equation. (b) Find the center and the radius of the circle given above.
INTERNET MAT 117 Review Problems (1) Let us consider the circle with equation x 2 + y 2 + 2x + 3y + 3 4 = 0. (a) Find the standard form of the equation of the circle given above. (b) Find the center and
More informationAlgebra & Trig Review
Algebra & Trig Review 1 Algebra & Trig Review This review was originally written for my Calculus I class, but it should be accessible to anyone needing a review in some basic algebra and trig topics. The
More informationΠ xdx cos 2 x
Π 5 3 xdx 5 4 6 3 8 cos x Help Your Child with Higher Maths Introduction We ve designed this booklet so that you can use it with your child throughout the session, as he/she moves through the Higher course,
More informationEDEXCEL NATIONAL CERTIFICATE UNIT 4 MATHEMATICS FOR TECHNICIANS OUTCOME 1
Learning outcomes EDEXCEL NATIONAL CERTIFICATE UNIT 4 MATHEMATICS FOR TECHNICIANS OUTCOME 1 TUTORIAL 3 - FACTORISATION AND QUADRATICS On completion of this unit a learner should: 1 Know how to use algebraic
More informationConceptual Explanations: Radicals
Conceptual Eplanations: Radicals The concept of a radical (or root) is a familiar one, and was reviewed in the conceptual eplanation of logarithms in the previous chapter. In this chapter, we are going
More informationSolution of Algebric & Transcendental Equations
Page15 Solution of Algebric & Transcendental Equations Contents: o Introduction o Evaluation of Polynomials by Horner s Method o Methods of solving non linear equations o Bracketing Methods o Bisection
More informationNumerical Analysis Solution of Algebraic Equation (non-linear equation) 1- Trial and Error. 2- Fixed point
Numerical Analysis Solution of Algebraic Equation (non-linear equation) 1- Trial and Error In this method we assume initial value of x, and substitute in the equation. Then modify x and continue till we
More informationRadicals: To simplify means that 1) no radicand has a perfect square factor and 2) there is no radical in the denominator (rationalize).
Summer Review Packet for Students Entering Prealculus Radicals: To simplify means that 1) no radicand has a perfect square factor and ) there is no radical in the denominator (rationalize). Recall the
More informationCS 542G: Robustifying Newton, Constraints, Nonlinear Least Squares
CS 542G: Robustifying Newton, Constraints, Nonlinear Least Squares Robert Bridson October 29, 2008 1 Hessian Problems in Newton Last time we fixed one of plain Newton s problems by introducing line search
More informationWelcome to Math Video Lessons. Stanley Ocken. Department of Mathematics The City College of New York Fall 2013
Welcome to Math 19500 Video Lessons Prof. Department of Mathematics The City College of New York Fall 013 An important feature of the following Beamer slide presentations is that you, the reader, move
More informationQueens College, CUNY, Department of Computer Science Numerical Methods CSCI 361 / 761 Spring 2018 Instructor: Dr. Sateesh Mane.
Queens College, CUNY, Department of Computer Science Numerical Methods CSCI 361 / 761 Spring 2018 Instructor: Dr. Sateesh Mane c Sateesh R. Mane 2018 3 Lecture 3 3.1 General remarks March 4, 2018 This
More informationChapter 14: Basics of Functions
Math 91 Final Exam Study Guide Name Chapter 14: Basics of Functions Find the domain and range. 1) {(5,1), (5,-4), (6,7), (3,4), (-9,-6)} Find the indicated function value. 2) Find f(3) when f(x) = x2 +
More information4.9 APPROXIMATING DEFINITE INTEGRALS
4.9 Approximating Definite Integrals Contemporary Calculus 4.9 APPROXIMATING DEFINITE INTEGRALS The Fundamental Theorem of Calculus tells how to calculate the exact value of a definite integral IF the
More informationNewton's forward interpolation formula
Newton's Interpolation Formulae Interpolation is the process of approximating a given function, whose values are known at N + 1 tabular points, by a suitable polynomial, P N (x) of degree N which takes
More informationINTERPOLATION. and y i = cos x i, i = 0, 1, 2 This gives us the three points. Now find a quadratic polynomial. p(x) = a 0 + a 1 x + a 2 x 2.
INTERPOLATION Interpolation is a process of finding a formula (often a polynomial) whose graph will pass through a given set of points (x, y). As an example, consider defining and x 0 = 0, x 1 = π/4, x
More information8.7 MacLaurin Polynomials
8.7 maclaurin polynomials 67 8.7 MacLaurin Polynomials In this chapter you have learned to find antiderivatives of a wide variety of elementary functions, but many more such functions fail to have an antiderivative
More informationx n -2.5 Definition A list is a list of objects, where multiplicity is allowed, and order matters. For example, as lists
Vectors, Linear Combinations, and Matrix-Vector Mulitiplication In this section, we introduce vectors, linear combinations, and matrix-vector multiplication The rest of the class will involve vectors,
More informationINTERNET MAT 117. Solution for the Review Problems. (1) Let us consider the circle with equation. x 2 + 2x + y 2 + 3y = 3 4. (x + 1) 2 + (y + 3 2
INTERNET MAT 117 Solution for the Review Problems (1) Let us consider the circle with equation x 2 + y 2 + 2x + 3y + 3 4 = 0. (a) Find the standard form of the equation of the circle given above. (i) Group
More informationTaylor Series and Numerical Approximations
Taylor Series and Numerical Approximations Hilary Weller h.weller@reading.ac.uk August 7, 05 An introduction to the concept of a Taylor series and how these are used in numerical analysis to find numerical
More informationExamples: Solving nth Order Equations
Atoms L. Euler s Theorem The Atom List First Order. Solve 2y + 5y = 0. Examples: Solving nth Order Equations Second Order. Solve y + 2y + y = 0, y + 3y + 2y = 0 and y + 2y + 5y = 0. Third Order. Solve
More informationExample 1 Which of these functions are polynomials in x? In the case(s) where f is a polynomial,
1. Polynomials A polynomial in x is a function of the form p(x) = a 0 + a 1 x + a 2 x 2 +... a n x n (a n 0, n a non-negative integer) where a 0, a 1, a 2,..., a n are constants. We say that this polynomial
More information8.4 Partial Fractions
8.4 1 8.4 Partial Fractions Consider the following integral. (1) 13 2x x 2 x 2 dx How might we evaluate this? Suppose that, by some good luck, we knew that (2) 13 2x x 2 x 2 = 3 x 2 5 x+1 We could then
More informationChapter 11. Taylor Series. Josef Leydold Mathematical Methods WS 2018/19 11 Taylor Series 1 / 27
Chapter 11 Taylor Series Josef Leydold Mathematical Methods WS 2018/19 11 Taylor Series 1 / 27 First-Order Approximation We want to approximate function f by some simple function. Best possible approximation
More information