Topic 4b. Open Methods for Root Finding

Similar documents
Lecture 8 Optimization

Math Review and Lessons in Calculus

(One Dimension) Problem: for a function f(x), find x 0 such that f(x 0 ) = 0. f(x)

Example: When describing where a function is increasing, decreasing or constant we use the x- axis values.

This is only a list of questions use a separate sheet to work out the problems. 1. (1.2 and 1.4) Use the given graph to answer each question.

Numerical Methods. Root Finding

SOLVING EQUATIONS OF ONE VARIABLE

Differential Equaitons Equations

CISE-301: Numerical Methods Topic 1:

Asymptote. 2 Problems 2 Methods

Increasing and Decreasing Functions and the First Derivative Test. Increasing and Decreasing Functions. Video

AP Calculus Notes: Unit 1 Limits & Continuity. Syllabus Objective: 1.1 The student will calculate limits using the basic limit theorems.

Chapter 2 Section 3. Partial Derivatives

Sec 3.1. lim and lim e 0. Exponential Functions. f x 9, write the equation of the graph that results from: A. Limit Rules

Differentiation. The main problem of differential calculus deals with finding the slope of the tangent line at a point on a curve.

Lab on Taylor Polynomials. This Lab is accompanied by an Answer Sheet that you are to complete and turn in to your instructor.

Topic 8c Multi Variable Optimization

New Functions from Old Functions

Section 3.4: Concavity and the second Derivative Test. Find any points of inflection of the graph of a function.

Answer Key-Math 11- Optional Review Homework For Exam 2

9.3 Graphing Functions by Plotting Points, The Domain and Range of Functions

The concept of limit

Ma 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 6

RATIONAL FUNCTIONS. Finding Asymptotes..347 The Domain Finding Intercepts Graphing Rational Functions

8.4 Inverse Functions

Numerical Methods - Lecture 2. Numerical Methods. Lecture 2. Analysis of errors in numerical methods

3. Several Random Variables

2.3 Rectangular Components in Three-Dimensional Force Systems

Roberto s Notes on Differential Calculus Chapter 8: Graphical analysis Section 1. Extreme points

m = Average Rate of Change (Secant Slope) Example:

Solutions of Equations in One Variable. Newton s Method

روش نصف کردن. Bisection Method Basis of Bisection Method

AP Calculus AB Summer Assignment

8. THEOREM If the partial derivatives f x. and f y exist near (a, b) and are continuous at (a, b), then f is differentiable at (a, b).

Root Finding and Optimization

and ( x, y) in a domain D R a unique real number denoted x y and b) = x y = {(, ) + 36} that is all points inside and on

INTRODUCTORY MATHEMATICAL ANALYSIS

Queens College, CUNY, Department of Computer Science Numerical Methods CSCI 361 / 761 Spring 2018 Instructor: Dr. Sateesh Mane.

is the intuition: the derivative tells us the change in output y (from f(b)) in response to a change of input x at x = b.

Math 2412 Activity 1(Due by EOC Sep. 17)

whose domain D is a set of n-tuples in is defined. The range of f is the set of all values f x1,..., x n

Mathematical Preliminaries. Developed for the Members of Azera Global By: Joseph D. Fournier B.Sc.E.E., M.Sc.E.E.

A Function of Two Random Variables

by Martin Mendez, UASLP Copyright 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display.

( x) f = where P and Q are polynomials.

CLASS NOTES Computational Methods for Engineering Applications I Spring 2015

Triple Integrals in Cartesian Coordinates. Triple Integrals in Cylindrical Coordinates. Triple Integrals in Spherical Coordinates

Nonlinear Equations. Chapter The Bisection Method

6.1 The function can be set up for fixed-point iteration by solving it for x

Numerical Analysis Fall. Roots: Open Methods

Periodic Structures in FDTD

Objectives. By the time the student is finished with this section of the workbook, he/she should be able

Special types of Riemann sums

Exact Differential Equations. The general solution of the equation is f x, y C. If f has continuous second partials, then M y 2 f

Limits and the derivative function. Limits and the derivative function

Chapter 2 Limits and Continuity. Section 2.1 Rates of Change and Limits (pp ) Section Quick Review 2.1

Section 1.2 Domain and Range

Finding roots. Lecture 4

Practical and Efficient Evaluation of Inverse Functions

9.1 The Square Root Function

18-660: Numerical Methods for Engineering Design and Optimization

F, {z} Isothermal Flash Tank

Today. Introduction to optimization Definition and motivation 1-dimensional methods. Multi-dimensional methods. General strategies, value-only methods

4.7. Newton s Method. Procedure for Newton s Method HISTORICAL BIOGRAPHY

Chapter 4. Solution of a Single Nonlinear Algebraic Equation

Differentiation. introduction to limits

Basic mathematics of economic models. 3. Maximization

Numerical Optimization

4.1 & 4.2 Student Notes Using the First and Second Derivatives. for all x in D, where D is the domain of f. The number f()

Exact and Approximate Numbers:

HSML Honors or AP Calculus Course Preparedness Test

Finding Roots of Equations

SOLVING QUADRATICS. Copyright - Kramzil Pty Ltd trading as Academic Teacher Resources

Chapter 6. Nonlinear Equations. 6.1 The Problem of Nonlinear Root-finding. 6.2 Rate of Convergence

Math 231 Final Exam Review

Relating axial motion of optical elements to focal shift

We would now like to turn our attention to a specific family of functions, the one to one functions.

Continuity and Differentiability

4.3 Mean-Value Theorem and Monotonicity

Slopes and Rates of Change

y2 = 0. Show that u = e2xsin(2y) satisfies Laplace's equation.

FP1 PAST EXAM QUESTIONS ON NUMERICAL METHODS: NEWTON-RAPHSON ONLY

Calculus with business applications, Lehigh U, Lecture 05 notes Summer

Differential Equations

Two conventions for coordinate systems. Left-Hand vs Right-Hand. x z. Which is which?

MAT 1800 FINAL EXAM HOMEWORK

Limits and Their Properties

Basic properties of limits

Numerical solutions of nonlinear systems of equations

A NOVEL METHOD OF INTERPOLATION AND EXTRAPOLATION OF FUNCTIONS BY A LINEAR INITIAL VALUE PROBLEM

Relating axial motion of optical elements to focal shift

The Chain Rule. This is a generalization of the (general) power rule which we have already met in the form: then f (x) = r [g(x)] r 1 g (x).

Rolle s Theorem and the Mean Value Theorem. Rolle s Theorem

MHF 4U Unit 7: Combining Functions May 29, Review Solutions

Mat 267 Engineering Calculus III Updated on 9/19/2010

Numerical Solution of f(x) = 0

4.3 - How Derivatives Affect the Shape of a Graph

z-axis SUBMITTED BY: Ms. Harjeet Kaur Associate Professor Department of Mathematics PGGCG 11, Chandigarh y-axis x-axis

3.1: 1, 3, 5, 9, 10, 12, 14, 18

Modern Control Systems (ECEG-4601) Instructor: Andinet Negash. Chapter 1 Lecture 3: State Space, II

Transcription:

Course Instructor Dr. Ramond C. Rump Oice: A 337 Phone: (915) 747 6958 E Mail: rcrump@utep.edu Topic 4b Open Methods or Root Finding EE 4386/5301 Computational Methods in EE Outline Open Methods or Root Finding Newton Raphson Method Secant Method Multiple Roots 2 1

Newton Raphson Method 3 We Start with An Function 4 2

We Make an Initial Guess or the Position o the Root 1 1 5 Evaluate the Function at 1 1 1 6 3

Calculate the Equation o the Line Tangential to the Point on () 1 1 1 m1 1 1 1 7 Calculate Where the Line Crosses the Ais 1 2 1 2 1 1 1 2 1 1 0 1 8 4

Evaluate the Function at 2 2 2 1 9 Calculate the Equation o the Line Tangential to the Point on () 2 2 1 2 m2 2 2 2 10 5

Calculate Where the Line Crosses the Ais 2 3 2 1 3 2 2 2 3 2 2 0 2 11 Evaluate the Function at 3 3 3 2 1 12 6

And so on 5 4 3 2 1 Converged in ive iterations. 13 Algorithm 1. Derive analtical epressions or () and (), or ()/ (). 2. Determine a good initial guess i. 3. Iterate until converged 1. Calculate i. i i i 2. Calculate new estimate or root i+1. i 1 i i 3. I i < tolerance, Done! 14 7

Poor or Unstable Convergence 15 Notes on Newton Raphson Method Does not require bounds. Requires a good initial guess. Requires () and () to be analtical. Converges etremel ast or unctions that are near linear. Algorithm vulnerable to instabilit Can converge to the wrong root i multiple roots eist. Newton Raphson s Method Newton s Method NRM is or root inding, whereas NM is or optimization. 16 8

Eample #1 Let () = sin. What is the root o () in the proimit o = 4? Step 1 Derive analtical epression or ()/ () sin sin sin tan d sin cos d This means our update equation is i 1 i i i tan i Step 2 MATLAB code r = 4; tol = 1e-6; d = in; Converges to 3.1416 while abs(d) > tol ater 4 iterations. d = tan(r); r = r - d; end Slide 17 Secant Method 18 9

We Start with Some Function 19 We Make Two Initial Guesses or the Position o the Root, 1 and 2 1 2 20 10

Evaluate the Function at 1 and 2 1 2 1 2 21 Calculate the Equation o the Line Connecting ( 1, 1 ) and ( 2, 2 ) rise slope m run 2 1 2 1 2 1 1 2 m 2 2 2 1 2 2 2 1 22 11

Calculate Where the Line Crosses the Ais 2 1 2 2 2 1 2 1 0 2 r 2 2 1 r 2 2 2 1 2 1 1 2 1 2 r 2 2 2 1 2 1 23 Evaluate the Function at the New Point r 1 2 r r 1 2 24 12

Adjust Points to 1 and 2 1 2 1 2 2 2 r r 1 2 2 1 25 Calculate Where the New Line Crosses the Ais 1 2 2 1 r 2 2 2 1 2 1 26 13

Evaluate the Function at the New Point r 1 2 r r 2 1 27 Adjust Points to 1 and 2 1 2 2 1 28 14

And so on 1 2 2 1 29 Algorithm 1. Determine two good initial guesses: 1 and 2. 2. Evaluate the unction at 1. 1 1 3. Iterate until converged 1. Evaluate unction at 2. 2. Calculate. 2 2 1 3. Make new irst point the old second point. 4. Calculate new 2. 2 2 2 2 2 1 and 1 2 1 2 5. I < tolerance, Done! 30 15

Notes on Secant Method Does not require bounds. Does not require () or () to be analtical Requires two good initial guesses Full numerical version o Newton s method Same weaknesses as Newton Raphson method Algorithm vulnerable to instabilit Can converge to the wrong root 31 Eample #1 Let () = sin. What is the root o () in the proimit o = 4? 1. Determine two good initial guesses: 1 =4.0 and 2 =3.9. 2. Evaluate the unction at 1. 1 1 3. Iterate until converged a. Evaluate unction at 2. 2 2 b. Calculate. 2 2 1 2 1 % DASHBOARD unc = @sin; 1 = 4.0; 2 = 3.9; tol = 1e-6; % IMPLEMENT SECANT METHOD 1 = unc(1); d = in; while abs(d) > tol 2 = unc(2); d = (2-1)*2/(2-1); 1 = 2; 1 = 2; 2 = 2 - d; end r = 2; c. Make new irst point the old second point. 1 2 and 1 2 d. Calculate new 2. 2 2 e. I < tolerance, Done! Converges to 3.1416 ater 5 iterations. Slide 32 16

Multiple Roots 33 Problem with Multiple Roots Our update equation or both Newton Raphson method and secant method involve ()/ (). When we have multiple roots, both () and () can go to zero at the root. This causes a divide b zero problem. single root 0 undeined 0 double root triple root Slide 34 17

A Useul Propert We can deine an auiliar unction u() that will have the same roots as () but who s derivative u () will not go to zero at the roots. u u This is the same auiliar unction we used or bracketing methods. Slide 35 The Fi I () has multiple roots, perorm root inding on the auiliar unction u() instead. u i u i i1 i i1 i i We can write our new update equation completel in terms o () and its derivatives as ollows. i i i1 i 2 i i i i Slide 36 18