Mathematical modelling Chapter 2 Nonlinear models and geometric models
|
|
- Lenard Lyons
- 5 years ago
- Views:
Transcription
1 Mathematical modelling Chapter 2 Nonlinear models and geometric models Faculty of Computer and Information Science University of Ljubljana 2018/ Nonlinear models Given is a sample of points {(x 1, y 1 ),..., (x m, y m )}, x i R n, y i R. The mathematical model is nonlinear if the function y = F (x, a 1,..., a p ) is a nonlinear function of the parameters a i. Each data point gives a nonlinear equation for the parameters a 1,..., a p. y i = F (x i, a 1,..., a p ), i = 1,..., m Examples of nonlinear models: 1. Exponential decay F (x, a, k) = ae kx ali rast F (x, a, k) = a(1 e kx ), k > 0 2. Gaussian model: F (x, a, b, c) = ae ( x c b ) 2 a 3. Logistic model: F (x, a, b, c) = (1+be kx ), k > 0
2 Given the data points {(x 1, y 1 ),..., (x m, y m )}, x i R n, y i R we obtain a system of nonlinear equations for the parameters a i : f i (a 1,..., a p ) = y i F (x i, a 1,..., a p ) = 0, i = i,..., m. Solutions are zeroes of a nonlinear vector function f : R p R m f (a 1,..., a p ) = (f 1 (a 1,..., a p ),..., f m (a 1..., a p )). Solving a system of nonlinear equations is a tough problem (even for n = m = 1)... One possible strategy is to approximate these by zeroes of suitable linear approximations. Example of a nonlinear model: In the area around a radiotelescope the use of microwave owens is forbidden, since the radiation interferes with the telescope. We are looking for the location (a, b) of a microwave owen that is causing problems. The radiation intensity decreases with the distance from the source r according to u(r) = α 1 + r. Measured values of the signal at three locations are z(0, 0) = 0.27, z(1, 1) = 0.36 in z(0, 2) = 0.3. This gives the following system of equations for the parameters α, a, b: α 1 + = 0.27 a 2 + b 2 α 1 + = 0.36 (1 a) 2 + (1 b) 2 α 1 + = 0.3 a 2 + (2 b) 2
3 3.1 Vector functions of a vector variable Let f be a function from D R n to R m, x 1 f maps a vector x =. f : x 1. x n x n D to a vector f (x) = f 1 (x) f 1 (x 1,..., x n ). =. f m (x) f m (x 1,..., x n ) f 1 (x). f m (x) Examples: 1. A linear vector function f : R n R m is given by f : x Ax + b, where A is a matrix of order m n and b R m. 2. A nonlinear vector function f : R 3 R 2 could, for example, be given by f : x y z [ x 2 + y 2 + z 2 ] 1. x + y + z
4 The derivative of a vector function f is given by the Jacobian matrix: f 1 f 1 x 1 x n J = Df =..... f m f m x 1 x n If m = 1, n = 1, f is a function from D R to R and Df (x) = f (x). For m = 1 and n general f is a function of n variables and Df (x) = gradf (x). gradf 1 For n and m general Df (x) =.. gradf m Examples 1. If f : R n R m is the linear function x Ax + b, then Df (x) = A. 2. If f : R 3 R 2 is given by x f : y z [ x 2 + y 2 + z 2 ] 1 x + y + z then Df (x) = [ 2x 2y ] 2z 1 1 1
5 The linear approximation of f at the point a is the linear function that has the same value and the same derivative as f at a: n = 1, m = 1: L a (x) = f (a) + Df (a)(x a). L a (x) = f (a) + f (a)(x a) is the linear approximation of a function of one variable (which you know from Calculus), its graph y = L a (x) is the tangent to the graph y = f (x) at the point a, n = 2, m = 1, i.e. f (x, y) is a function of two variables: L (a,b) (x, y) = f (a, b) + gradf (a, b) [ ] x a, y b the graph z = L (a,b) (x, y) is the tangent plane to the surface z = f (x, y) at the point (a, b). Example: The linear approximation to the function x [ f : y x 2 + y 2 + z 2 ] 1 x + y + z z at a = is the linear function = L a (x, y, z) = [ ] [ ] x 1 y + 1 z 1 [ ] [ 2 + 2(x 1) 2(y + 1) + 2(z 1) = 1 + (x 1) + (y + 1) + (z 2) ] [ ] x 4 y + 0 z
6 Geometric picture: Given a vector function f : R 3 R 2, every point (x 0, y 0, z 0 ) lies in the intersection of level surfaces f 1 (x, y, z) = c 1 in f 2 (x, y, z) = c 2, where c 1 = f 1 (x 0, y 0, z 0 ) and c 2 = f 2 (x 0, y 0, z 0 ). The intersection of two surfaces in R 3 determines an implicit curve in R 3. If they are nonzero, the vectors gradf 1 (x 0, y 0, z 0 ) and gradf 2 (x 0, y 0, z 0 ) are normal vectors of the two level surfaces, and gradf 1 (x 0, y 0, z 0 ) gradf 2 (x 0, y 0, z 0 ) is tangential to the implicit curve. For the function f : x y z [ x 2 + y 2 + z 2 ] 1 x + y + z the implicit curve through (1, 1, 1) is given by x 2 + y 2 + z 2 1 = 2 in x + y + z = 1, and the tangent vector is gradf 1 (1, 1, 1) gradf 2 (1, 1, 1) = =
7 3.2 Solving systems of nonlinear equations f : D R m, D R n We are looking for solutions of f 1 (x) f (x) =. = f m (x) f 1 (x 1,..., x n ). f m (x 1,..., x n ) = 0. 0 In many cases an analytic solution does not even exist. A number of numerical methods for approximate solutions is available. We will look at one, based on linear approximations. n = 1, m = 1: solving an equation f (x) = 0, x R. Newton s or tangent method: We construct a recurssive sequence with x 0 initial term x k+1 solution of L xk (x) = f (x k ) + f (x k )(x x k ) = 0, so x k+1 = x k f (x k) f (x k )
8 The sequence x i converges to a solution α, f (α) = 0, if: 1. f (x) 0 for all x I, where I is an interval [α r, α + r] for some r (α x 0 ), 2. f (x) is continuous for all x I, 3. x 0 is close enough to the solution α. Under these assumptions the convergence is quadratic: if ε i = x i α then ε i+1 Mε 2 i, where M is a constant bounded by f (x) /f (x) on I. m = n > 1: Newton s method generalizes to systems of n nonlinear equations in n unknowns: x 0 initial approximation, x k+1 solution of L xk (x) = f (x k ) + Df (x k )(x x k ) = 0, so x k+1 = x k Df (x k ) 1 f (x k ). In practice the linear system for x k+1 is solved at each step. Df (x k )x k+1 = Df (x k )x k f (x k ) The sequence converges to a solution α if for some r > 0 the matrix Df (x) is nonsingular for all x, x α < r, and x 0 α < r.
9 Application to optimization: Newton optimization method Let F : R n R, we are looking for the minimum (or maximum) of F. The first step is to find the critical points, i.e. solution of f = gradf = F x1. F xn = 0. This is a system of n equations for n variables, the Jacobian of the vector function f is the Hessian of F : F x1 x 1... F x1 x n Df (x) = H(x) = F xn x 1... F xn x n If the sequence of iterates x 0, x k+1 = x k H 1 (x k )gradf (x k ) converges, the limit is a critical point of F, i.e. a candidate for the minimum (or maximum). m > n > 0: We have an overdetermined system f (x) = 0 of m nonlinear equations for n unknowns. The system f (x) = 0 generally does not have a solution. We are looking for a best fit to a solution, that is, for α such that the distance of f (α) from 0 is the smallest possible: f (α) 2 = min{ f (x) 2 }. The Gauss-Newton method is a generalization of the Newton method where instead of the inverse of the Jacobian its MP inverse is used at each step: x 0 initial approximation x k+1 = x k Df (x k ) + f (x k ), where Df (x k ) + is the MP inverse of Df (x k ). If the matrix (Df (x k ) T Df (x k )) is nonsingular at each step k then x k+1 = x k (Df (x k ) T Df (x k )) 1 Df (x k ) T f (x k ).
10 At each step x k+1 is the least squares approximation to the solution of the overdetermined linear system L xk (x) = 0, that is, L xk (x k+1 ) 2 = min{ L xk (x) 2, x R n }. Convergence is not guaranteed, but: if the sequence x k converges, the limit x = lim k x k is a local (but not nocessarily global) minimum of f (x) 2. It follows that the Gauss-Newton method is an algorithm for the local minimum of f (x) 2.
1. Method 1: bisection. The bisection methods starts from two points a 0 and b 0 such that
Chapter 4 Nonlinear equations 4.1 Root finding Consider the problem of solving any nonlinear relation g(x) = h(x) in the real variable x. We rephrase this problem as one of finding the zero (root) of a
More informationMath 473: Practice Problems for Test 1, Fall 2011, SOLUTIONS
Math 473: Practice Problems for Test 1, Fall 011, SOLUTIONS Show your work: 1. (a) Compute the Taylor polynomials P n (x) for f(x) = sin x and x 0 = 0. Solution: Compute f(x) = sin x, f (x) = cos x, f
More informationCOURSE Iterative methods for solving linear systems
COURSE 0 4.3. Iterative methods for solving linear systems Because of round-off errors, direct methods become less efficient than iterative methods for large systems (>00 000 variables). An iterative scheme
More information10.34: Numerical Methods Applied to Chemical Engineering. Lecture 7: Solutions of nonlinear equations Newton-Raphson method
10.34: Numerical Methods Applied to Chemical Engineering Lecture 7: Solutions of nonlinear equations Newton-Raphson method 1 Recap Singular value decomposition Iterative solutions to linear equations 2
More informationTaylor and Maclaurin Series. Approximating functions using Polynomials.
Taylor and Maclaurin Series Approximating functions using Polynomials. Approximating f x = e x near x = 0 In order to approximate the function f x = e x near x = 0, we can use the tangent line (The Linear
More information8.7 Taylor s Inequality Math 2300 Section 005 Calculus II. f(x) = ln(1 + x) f(0) = 0
8.7 Taylor s Inequality Math 00 Section 005 Calculus II Name: ANSWER KEY Taylor s Inequality: If f (n+) is continuous and f (n+) < M between the center a and some point x, then f(x) T n (x) M x a n+ (n
More informationTaylor and Maclaurin Series. Approximating functions using Polynomials.
Taylor and Maclaurin Series Approximating functions using Polynomials. Approximating f x = e x near x = 0 In order to approximate the function f x = e x near x = 0, we can use the tangent line (The Linear
More informationSYSTEMS OF NONLINEAR EQUATIONS
SYSTEMS OF NONLINEAR EQUATIONS Widely used in the mathematical modeling of real world phenomena. We introduce some numerical methods for their solution. For better intuition, we examine systems of two
More informationLecture 4 - The Gradient Method Objective: find an optimal solution of the problem
Lecture 4 - The Gradient Method Objective: find an optimal solution of the problem min{f (x) : x R n }. The iterative algorithms that we will consider are of the form x k+1 = x k + t k d k, k = 0, 1,...
More informationLecture 4 - The Gradient Method Objective: find an optimal solution of the problem
Lecture 4 - The Gradient Method Objective: find an optimal solution of the problem min{f (x) : x R n }. The iterative algorithms that we will consider are of the form x k+1 = x k + t k d k, k = 0, 1,...
More informationPrecalculus Exponential, Logistic, and Logarithmic Functions Chapter 3 Section 1 Exponential and Logistic Functions
Precalculus Exponential, Logistic, and Logarithmic Functions Chapter 3 Section 1 Exponential and Logistic Functions Essential Question: How and why are exponential and logistic functions used to model
More informationNumerical Analysis: Solving Nonlinear Equations
Numerical Analysis: Solving Nonlinear Equations Mirko Navara http://cmp.felk.cvut.cz/ navara/ Center for Machine Perception, Department of Cybernetics, FEE, CTU Karlovo náměstí, building G, office 104a
More informationUnit 3: HW3.5 Sum and Product
Unit 3: HW3.5 Sum and Product Without solving, find the sum and product of the roots of each equation. 1. x 2 8x + 7 = 0 2. 2x + 5 = x 2 3. -7x + 4 = -3x 2 4. -10x 2 = 5x - 2 5. 5x 2 2x 3 4 6. 1 3 x2 3x
More informationAlgebra and functions; coordinate geometry in the (x, y) plane; sequences and series; differentiation; integration; vectors.
Revision Checklist Unit C4: Core Mathematics 4 Unit description Assessment information Algebra and functions; coordinate geometry in the (x, y) plane; sequences and series; differentiation; integration;
More informationAP Calculus Testbank (Chapter 9) (Mr. Surowski)
AP Calculus Testbank (Chapter 9) (Mr. Surowski) Part I. Multiple-Choice Questions n 1 1. The series will converge, provided that n 1+p + n + 1 (A) p > 1 (B) p > 2 (C) p >.5 (D) p 0 2. The series
More informationComputational Methods. Least Squares Approximation/Optimization
Computational Methods Least Squares Approximation/Optimization Manfred Huber 2011 1 Least Squares Least squares methods are aimed at finding approximate solutions when no precise solution exists Find the
More informationC3 Revision Questions. (using questions from January 2006, January 2007, January 2008 and January 2009)
C3 Revision Questions (using questions from January 2006, January 2007, January 2008 and January 2009) 1 2 1. f(x) = 1 3 x 2 + 3, x 2. 2 ( x 2) (a) 2 x x 1 Show that f(x) =, x 2. 2 ( x 2) (4) (b) Show
More informationChapter 3: Root Finding. September 26, 2005
Chapter 3: Root Finding September 26, 2005 Outline 1 Root Finding 2 3.1 The Bisection Method 3 3.2 Newton s Method: Derivation and Examples 4 3.3 How To Stop Newton s Method 5 3.4 Application: Division
More informationNonlinear Optimization: What s important?
Nonlinear Optimization: What s important? Julian Hall 10th May 2012 Convexity: convex problems A local minimizer is a global minimizer A solution of f (x) = 0 (stationary point) is a minimizer A global
More information1 Numerical optimization
Contents 1 Numerical optimization 5 1.1 Optimization of single-variable functions............ 5 1.1.1 Golden Section Search................... 6 1.1. Fibonacci Search...................... 8 1. Algorithms
More informationNumerical Methods for Differential Equations Mathematical and Computational Tools
Numerical Methods for Differential Equations Mathematical and Computational Tools Gustaf Söderlind Numerical Analysis, Lund University Contents V4.16 Part 1. Vector norms, matrix norms and logarithmic
More informationnonrobust estimation The n measurement vectors taken together give the vector X R N. The unknown parameter vector is P R M.
Introduction to nonlinear LS estimation R. I. Hartley and A. Zisserman: Multiple View Geometry in Computer Vision. Cambridge University Press, 2ed., 2004. After Chapter 5 and Appendix 6. We will use x
More informationNon-linear least squares
Non-linear least squares Concept of non-linear least squares We have extensively studied linear least squares or linear regression. We see that there is a unique regression line that can be determined
More informationMaria Cameron. f(x) = 1 n
Maria Cameron 1. Local algorithms for solving nonlinear equations Here we discuss local methods for nonlinear equations r(x) =. These methods are Newton, inexact Newton and quasi-newton. We will show that
More informationWeek 1: need to know. November 14, / 20
Week 1: need to know How to find domains and ranges, operations on functions (addition, subtraction, multiplication, division, composition), behaviors of functions (even/odd/ increasing/decreasing), library
More informationTvestlanka Karagyozova University of Connecticut
September, 005 CALCULUS REVIEW Tvestlanka Karagyozova University of Connecticut. FUNCTIONS.. Definition: A function f is a rule that associates each value of one variable with one and only one value of
More informationHigher Portfolio Quadratics and Polynomials
Higher Portfolio Quadratics and Polynomials Higher 5. Quadratics and Polynomials Section A - Revision Section This section will help you revise previous learning which is required in this topic R1 I have
More informationx 2 x n r n J(x + t(x x ))(x x )dt. For warming-up we start with methods for solving a single equation of one variable.
Maria Cameron 1. Fixed point methods for solving nonlinear equations We address the problem of solving an equation of the form (1) r(x) = 0, where F (x) : R n R n is a vector-function. Eq. (1) can be written
More informationOptimization. Yuh-Jye Lee. March 21, Data Science and Machine Intelligence Lab National Chiao Tung University 1 / 29
Optimization Yuh-Jye Lee Data Science and Machine Intelligence Lab National Chiao Tung University March 21, 2017 1 / 29 You Have Learned (Unconstrained) Optimization in Your High School Let f (x) = ax
More informationConstrained optimization. Unconstrained optimization. One-dimensional. Multi-dimensional. Newton with equality constraints. Active-set method.
Optimization Unconstrained optimization One-dimensional Multi-dimensional Newton s method Basic Newton Gauss- Newton Quasi- Newton Descent methods Gradient descent Conjugate gradient Constrained optimization
More informationOptimization. Escuela de Ingeniería Informática de Oviedo. (Dpto. de Matemáticas-UniOvi) Numerical Computation Optimization 1 / 30
Optimization Escuela de Ingeniería Informática de Oviedo (Dpto. de Matemáticas-UniOvi) Numerical Computation Optimization 1 / 30 Unconstrained optimization Outline 1 Unconstrained optimization 2 Constrained
More informationMath 4329: Numerical Analysis Chapter 03: Newton s Method. Natasha S. Sharma, PhD
Mathematical question we are interested in numerically answering How to find the x-intercepts of a function f (x)? These x-intercepts are called the roots of the equation f (x) = 0. Notation: denote the
More informationCS 542G: Robustifying Newton, Constraints, Nonlinear Least Squares
CS 542G: Robustifying Newton, Constraints, Nonlinear Least Squares Robert Bridson October 29, 2008 1 Hessian Problems in Newton Last time we fixed one of plain Newton s problems by introducing line search
More informationNonlinearity Root-finding Bisection Fixed Point Iteration Newton s Method Secant Method Conclusion. Nonlinear Systems
Nonlinear Systems CS 205A: Mathematical Methods for Robotics, Vision, and Graphics Doug James (and Justin Solomon) CS 205A: Mathematical Methods Nonlinear Systems 1 / 27 Part III: Nonlinear Problems Not
More informationNumerical Methods Lecture 3
Numerical Methods Lecture 3 Nonlinear Equations by Pavel Ludvík Introduction Definition (Root or zero of a function) A root (or a zero) of a function f is a solution of an equation f (x) = 0. We learn
More informationC3 papers June 2007 to 2008
physicsandmathstutor.com June 007 C3 papers June 007 to 008 1. Find the exact solutions to the equations (a) ln x + ln 3 = ln 6, (b) e x + 3e x = 4. *N6109A04* physicsandmathstutor.com June 007 x + 3 9+
More informationSolving nonlinear equations (See online notes and lecture notes for full details) 1.3: Newton s Method
Solving nonlinear equations (See online notes and lecture notes for full details) 1.3: Newton s Method MA385 Numerical Analysis September 2018 (1/16) Sir Isaac Newton, 1643-1727, England. Easily one of
More informationSeparable Differential Equations
Separable Differential Equations MATH 6 Calculus I J. Robert Buchanan Department of Mathematics Fall 207 Background We have previously solved differential equations of the forms: y (t) = k y(t) (exponential
More informationDISCRIMINANT EXAM QUESTIONS
DISCRIMINANT EXAM QUESTIONS Question 1 (**) Show by using the discriminant that the graph of the curve with equation y = x 4x + 10, does not cross the x axis. proof Question (**) Show that the quadratic
More informationNonlinear Equations. Not guaranteed to have any real solutions, but generally do for astrophysical problems.
Nonlinear Equations Often (most of the time??) the relevant system of equations is not linear in the unknowns. Then, cannot decompose as Ax = b. Oh well. Instead write as: (1) f(x) = 0 function of one
More informationMotivation: We have already seen an example of a system of nonlinear equations when we studied Gaussian integration (p.8 of integration notes)
AMSC/CMSC 460 Computational Methods, Fall 2007 UNIT 5: Nonlinear Equations Dianne P. O Leary c 2001, 2002, 2007 Solving Nonlinear Equations and Optimization Problems Read Chapter 8. Skip Section 8.1.1.
More informationI can translate between a number line graph, an inequality, and interval notation.
Unit 1: Absolute Value 2 I can translate between a number line graph, an inequality, and interval notation. 2 2 I can translate between absolute value expressions and English statements about numbers on
More informationMath Camp II. Calculus. Yiqing Xu. August 27, 2014 MIT
Math Camp II Calculus Yiqing Xu MIT August 27, 2014 1 Sequence and Limit 2 Derivatives 3 OLS Asymptotics 4 Integrals Sequence Definition A sequence {y n } = {y 1, y 2, y 3,..., y n } is an ordered set
More informationTest 3 Review. y f(a) = f (a)(x a) y = f (a)(x a) + f(a) L(x) = f (a)(x a) + f(a)
MATH 2250 Calculus I Eric Perkerson Test 3 Review Sections Covered: 3.11, 4.1 4.6. Topics Covered: Linearization, Extreme Values, The Mean Value Theorem, Consequences of the Mean Value Theorem, Concavity
More information1. Which one of the following points is a singular point of. f(x) = (x 1) 2/3? f(x) = 3x 3 4x 2 5x + 6? (C)
Math 1120 Calculus Test 3 November 4, 1 Name In the first 10 problems, each part counts 5 points (total 50 points) and the final three problems count 20 points each Multiple choice section Circle the correct
More informationNonlinearity Root-finding Bisection Fixed Point Iteration Newton s Method Secant Method Conclusion. Nonlinear Systems
Nonlinear Systems CS 205A: Mathematical Methods for Robotics, Vision, and Graphics Justin Solomon CS 205A: Mathematical Methods Nonlinear Systems 1 / 24 Part III: Nonlinear Problems Not all numerical problems
More informationMath and Numerical Methods Review
Math and Numerical Methods Review Michael Caracotsios, Ph.D. Clinical Associate Professor Chemical Engineering Department University of Illinois at Chicago Introduction In the study of chemical engineering
More information1 Numerical optimization
Contents Numerical optimization 5. Optimization of single-variable functions.............................. 5.. Golden Section Search..................................... 6.. Fibonacci Search........................................
More informationMATH 1372, SECTION 33, MIDTERM 3 REVIEW ANSWERS
MATH 1372, SECTION 33, MIDTERM 3 REVIEW ANSWERS 1. We have one theorem whose conclusion says an alternating series converges. We have another theorem whose conclusion says an alternating series diverges.
More informationChapter 4. Solution of Non-linear Equation. Module No. 1. Newton s Method to Solve Transcendental Equation
Numerical Analysis by Dr. Anita Pal Assistant Professor Department of Mathematics National Institute of Technology Durgapur Durgapur-713209 email: anita.buie@gmail.com 1 . Chapter 4 Solution of Non-linear
More informationCourse Summary Math 211
Course Summary Math 211 table of contents I. Functions of several variables. II. R n. III. Derivatives. IV. Taylor s Theorem. V. Differential Geometry. VI. Applications. 1. Best affine approximations.
More informationMA 8019: Numerical Analysis I Solution of Nonlinear Equations
MA 8019: Numerical Analysis I Solution of Nonlinear Equations Suh-Yuh Yang ( 楊肅煜 ) Department of Mathematics, National Central University Jhongli District, Taoyuan City 32001, Taiwan syyang@math.ncu.edu.tw
More informationNumerical solution of Least Squares Problems 1/32
Numerical solution of Least Squares Problems 1/32 Linear Least Squares Problems Suppose that we have a matrix A of the size m n and the vector b of the size m 1. The linear least square problem is to find
More informationALGEBRAIC GEOMETRY HOMEWORK 3
ALGEBRAIC GEOMETRY HOMEWORK 3 (1) Consider the curve Y 2 = X 2 (X + 1). (a) Sketch the curve. (b) Determine the singular point P on C. (c) For all lines through P, determine the intersection multiplicity
More informationNONLINEAR DC ANALYSIS
ECE 552 Numerical Circuit Analysis Chapter Six NONLINEAR DC ANALYSIS OR: Solution of Nonlinear Algebraic Equations I. Hajj 2017 Nonlinear Algebraic Equations A system of linear equations Ax = b has a
More informationOne Dimensional Dynamical Systems
16 CHAPTER 2 One Dimensional Dynamical Systems We begin by analyzing some dynamical systems with one-dimensional phase spaces, and in particular their bifurcations. All equations in this Chapter are scalar
More informationMath 132 Mean Value Theorem Stewart 3.2
Math 132 Mean Value Theorem Stewart 3.2 Vanishing derivatives. We will prove some basic theorems which relate the derivative of a function with the values of the function, culminating in the Uniqueness
More informationNumerical Algorithms as Dynamical Systems
A Study on Numerical Algorithms as Dynamical Systems Moody Chu North Carolina State University What This Study Is About? To recast many numerical algorithms as special dynamical systems, whence to derive
More informationConstrained Optimization
1 / 22 Constrained Optimization ME598/494 Lecture Max Yi Ren Department of Mechanical Engineering, Arizona State University March 30, 2015 2 / 22 1. Equality constraints only 1.1 Reduced gradient 1.2 Lagrange
More information10.2 ITERATIVE METHODS FOR SOLVING LINEAR SYSTEMS. The Jacobi Method
54 CHAPTER 10 NUMERICAL METHODS 10. ITERATIVE METHODS FOR SOLVING LINEAR SYSTEMS As a numerical technique, Gaussian elimination is rather unusual because it is direct. That is, a solution is obtained after
More information3.3.1 Linear functions yet again and dot product In 2D, a homogenous linear scalar function takes the general form:
3.3 Gradient Vector and Jacobian Matri 3 3.3 Gradient Vector and Jacobian Matri Overview: Differentiable functions have a local linear approimation. Near a given point, local changes are determined by
More informationDM559 Linear and Integer Programming. Lecture 2 Systems of Linear Equations. Marco Chiarandini
DM559 Linear and Integer Programming Lecture Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark Outline 1. Outline 1. 3 A Motivating Example You are organizing
More informationTHE SECANT METHOD. q(x) = a 0 + a 1 x. with
THE SECANT METHOD Newton s method was based on using the line tangent to the curve of y = f (x), with the point of tangency (x 0, f (x 0 )). When x 0 α, the graph of the tangent line is approximately the
More informationMA 125 CALCULUS I FALL 2006 December 08, 2006 FINAL EXAM. Name (Print last name first):... Instructor:... Section:... PART I
CALCULUS I, FINAL EXAM 1 MA 125 CALCULUS I FALL 2006 December 08, 2006 FINAL EXAM Name (Print last name first):............................................. Student ID Number:...........................
More informationSection 4.2. Types of Differentiation
42 Types of Differentiation 1 Section 42 Types of Differentiation Note In this section we define differentiation of various structures with respect to a scalar, a vector, and a matrix Definition Let vector
More informationCurriculum Map: Mathematics
Curriculum Map: Mathematics Course: Calculus Grade(s): 11/12 Unit 1: Prerequisites for Calculus This initial chapter, A Prerequisites for Calculus, is just that-a review chapter. This chapter will provide
More informationCreated by T. Madas. Candidates may use any calculator allowed by the regulations of this examination.
IYGB GCE Mathematics MP Advanced Level Practice Paper M Difficulty Rating:.8750/1.176 Time: hours Candidates may use any calculator allowed by the regulations of this examination. Information for Candidates
More informationFixed Perimeter Rectangles
Rectangles You have a flexible fence of length L = 13 meters. You want to use all of this fence to enclose a rectangular plot of land of at least 8 square meters in area. 1. Determine a function for the
More informationChapter 11. Taylor Series. Josef Leydold Mathematical Methods WS 2018/19 11 Taylor Series 1 / 27
Chapter 11 Taylor Series Josef Leydold Mathematical Methods WS 2018/19 11 Taylor Series 1 / 27 First-Order Approximation We want to approximate function f by some simple function. Best possible approximation
More informationx x2 2 + x3 3 x4 3. Use the divided-difference method to find a polynomial of least degree that fits the values shown: (b)
Numerical Methods - PROBLEMS. The Taylor series, about the origin, for log( + x) is x x2 2 + x3 3 x4 4 + Find an upper bound on the magnitude of the truncation error on the interval x.5 when log( + x)
More informationChapter 4. Several-variable calculus. 4.1 Derivatives of Functions of Several Variables Functions of Several Variables
Chapter 4 Several-variable calculus 4.1 Derivatives of Functions of Several Variables 4.1.1 Functions of Several Variables ² A function f of n variables (x 1,x 2,...,x n ) in R n is an entity that operates
More informationCore 3 (A2) Practice Examination Questions
Core 3 (A) Practice Examination Questions Trigonometry Mr A Slack Trigonometric Identities and Equations I know what secant; cosecant and cotangent graphs look like and can identify appropriate restricted
More information1 Newton s Method. Suppose we want to solve: x R. At x = x, f (x) can be approximated by:
Newton s Method Suppose we want to solve: (P:) min f (x) At x = x, f (x) can be approximated by: n x R. f (x) h(x) := f ( x)+ f ( x) T (x x)+ (x x) t H ( x)(x x), 2 which is the quadratic Taylor expansion
More information14. Nonlinear equations
L. Vandenberghe ECE133A (Winter 2018) 14. Nonlinear equations Newton method for nonlinear equations damped Newton method for unconstrained minimization Newton method for nonlinear least squares 14-1 Set
More informationAIMS Exercise Set # 1
AIMS Exercise Set #. Determine the form of the single precision floating point arithmetic used in the computers at AIMS. What is the largest number that can be accurately represented? What is the smallest
More informationAP Calculus 2004 AB FRQ Solutions
AP Calculus 4 AB FRQ Solutions Louis A. Talman, Ph. D. Emeritus Professor of Mathematics Metropolitan State University of Denver July, 7 Problem. Part a The function F (t) = 8 + 4 sin(t/) gives the rate,
More informationAnalytic Geometry and Calculus I Exam 1 Practice Problems Solutions 2/19/7
Analytic Geometry and Calculus I Exam 1 Practice Problems Solutions /19/7 Question 1 Write the following as an integer: log 4 (9)+log (5) We have: log 4 (9)+log (5) = ( log 4 (9)) ( log (5)) = 5 ( log
More informationReview for the Final Exam
Math 171 Review for the Final Exam 1 Find the limits (4 points each) (a) lim 4x 2 3; x x (b) lim ( x 2 x x 1 )x ; (c) lim( 1 1 ); x 1 ln x x 1 sin (x 2) (d) lim x 2 x 2 4 Solutions (a) The limit lim 4x
More informationMATH 100 and MATH 180 Learning Objectives Session 2010W Term 1 (Sep Dec 2010)
Course Prerequisites MATH 100 and MATH 180 Learning Objectives Session 2010W Term 1 (Sep Dec 2010) As a prerequisite to this course, students are required to have a reasonable mastery of precalculus mathematics
More informationBook 4. June 2013 June 2014 June Name :
Book 4 June 2013 June 2014 June 2015 Name : June 2013 1. Given that 4 3 2 2 ax bx c 2 2 3x 2x 5x 4 dxe x 4 x 4, x 2 find the values of the constants a, b, c, d and e. 2. Given that f(x) = ln x, x > 0 sketch
More informationChapter 3 Differentiation Rules
Chapter 3 Differentiation Rules Derivative constant function if c is any real number, then Example: The Power Rule: If n is a positive integer, then Example: Extended Power Rule: If r is any real number,
More informationSOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS BISECTION METHOD
BISECTION METHOD If a function f(x) is continuous between a and b, and f(a) and f(b) are of opposite signs, then there exists at least one root between a and b. It is shown graphically as, Let f a be negative
More information11.10a Taylor and Maclaurin Series
11.10a 1 11.10a Taylor and Maclaurin Series Let y = f(x) be a differentiable function at x = a. In first semester calculus we saw that (1) f(x) f(a)+f (a)(x a), for all x near a The right-hand side of
More informationChapter 6. Nonlinear Equations. 6.1 The Problem of Nonlinear Root-finding. 6.2 Rate of Convergence
Chapter 6 Nonlinear Equations 6. The Problem of Nonlinear Root-finding In this module we consider the problem of using numerical techniques to find the roots of nonlinear equations, f () =. Initially we
More informationPART I Lecture Notes on Numerical Solution of Root Finding Problems MATH 435
PART I Lecture Notes on Numerical Solution of Root Finding Problems MATH 435 Professor Biswa Nath Datta Department of Mathematical Sciences Northern Illinois University DeKalb, IL. 60115 USA E mail: dattab@math.niu.edu
More informationMath 273a: Optimization Basic concepts
Math 273a: Optimization Basic concepts Instructor: Wotao Yin Department of Mathematics, UCLA Spring 2015 slides based on Chong-Zak, 4th Ed. Goals of this lecture The general form of optimization: minimize
More informationMATH 1902: Mathematics for the Physical Sciences I
MATH 1902: Mathematics for the Physical Sciences I Dr Dana Mackey School of Mathematical Sciences Room A305 A Email: Dana.Mackey@dit.ie Dana Mackey (DIT) MATH 1902 1 / 46 Module content/assessment Functions
More informationCALCULUS EXAM II Spring 2003
CALCULUS EXAM II Spring 2003 Name: Instructions: WRITE ALL WORK AND ALL ANSWERS ON THIS EXAM PAPER. For all questions, I reserve the right to apply the 'no work means no credit' policy, so make sure you
More informationNumerical Methods. Roots of Equations
Roots of Equations by Norhayati Rosli & Nadirah Mohd Nasir Faculty of Industrial Sciences & Technology norhayati@ump.edu.my, nadirah@ump.edu.my Description AIMS This chapter is aimed to compute the root(s)
More informationDaily Lessons and Assessments for AP* Calculus AB, A Complete Course Page 119 Mark Sparks 2012
Unit # Understanding the Derivative Homework Packet f ( h) f ( Find lim for each of the functions below. Then, find the equation of the tangent line to h 0 h the graph of f( at the given value of. 1. f
More informationOptimization: Nonlinear Optimization without Constraints. Nonlinear Optimization without Constraints 1 / 23
Optimization: Nonlinear Optimization without Constraints Nonlinear Optimization without Constraints 1 / 23 Nonlinear optimization without constraints Unconstrained minimization min x f(x) where f(x) is
More informationTopic Outline AP CALCULUS AB:
Topic Outline AP CALCULUS AB: Unit 1: Basic tools and introduction to the derivative A. Limits and properties of limits Importance and novelty of limits Traditional definitions of the limit Graphical and
More informationMath 5630: Iterative Methods for Systems of Equations Hung Phan, UMass Lowell March 22, 2018
1 Linear Systems Math 5630: Iterative Methods for Systems of Equations Hung Phan, UMass Lowell March, 018 Consider the system 4x y + z = 7 4x 8y + z = 1 x + y + 5z = 15. We then obtain x = 1 4 (7 + y z)
More informationCalculus Example Exam Solutions
Calculus Example Exam Solutions. Limits (8 points, 6 each) Evaluate the following limits: p x 2 (a) lim x 4 We compute as follows: lim p x 2 x 4 p p x 2 x +2 x 4 p x +2 x 4 (x 4)( p x + 2) p x +2 = p 4+2
More informationMath 273 (51) - Final
Name: Id #: Math 273 (5) - Final Autumn Quarter 26 Thursday, December 8, 26-6: to 8: Instructions: Prob. Points Score possible 25 2 25 3 25 TOTAL 75 Read each problem carefully. Write legibly. Show all
More information18.01 EXERCISES. Unit 3. Integration. 3A. Differentials, indefinite integration. 3A-1 Compute the differentials df(x) of the following functions.
8. EXERCISES Unit 3. Integration 3A. Differentials, indefinite integration 3A- Compute the differentials df(x) of the following functions. a) d(x 7 + sin ) b) d x c) d(x 8x + 6) d) d(e 3x sin x) e) Express
More informationChapter 2: Differentiation
Chapter 2: Differentiation Winter 2016 Department of Mathematics Hong Kong Baptist University 1 / 75 2.1 Tangent Lines and Their Slopes This section deals with the problem of finding a straight line L
More informationGaussian interval quadrature rule for exponential weights
Gaussian interval quadrature rule for exponential weights Aleksandar S. Cvetković, a, Gradimir V. Milovanović b a Department of Mathematics, Faculty of Mechanical Engineering, University of Belgrade, Kraljice
More informationLearning Objectives for Math 165
Learning Objectives for Math 165 Chapter 2 Limits Section 2.1: Average Rate of Change. State the definition of average rate of change Describe what the rate of change does and does not tell us in a given
More informationCreated by T. Madas. Candidates may use any calculator allowed by the regulations of this examination.
IYGB GCE Mathematics MP Advanced Level Practice Paper N Difficulty Rating: 3.550/.68 Time: hours Candidates may use any calculator allowed by the regulations of this eamination. Information for Candidates
More information