BOUNDARY VALUE PROBLEMS

Size: px
Start display at page:

Download "BOUNDARY VALUE PROBLEMS"

Transcription

1 BOUNDARY VALUE PROBLEMS School of Mathematics Semester

2 OUTLINE 1 REVIEW 2 BOUNDARY VALUE PROBLEMS 3 NEWTONS SHOOTING METHOD 4 SUMMARY

3 OUTLINE 1 REVIEW 2 BOUNDARY VALUE PROBLEMS 3 NEWTONS SHOOTING METHOD 4 SUMMARY

4 OUTLINE 1 REVIEW 2 BOUNDARY VALUE PROBLEMS 3 NEWTONS SHOOTING METHOD 4 SUMMARY

5 OUTLINE 1 REVIEW 2 BOUNDARY VALUE PROBLEMS 3 NEWTONS SHOOTING METHOD 4 SUMMARY

6 INTIAL VALUE PROBLEMS FOR ODES So far we have have encountered initial value problems We can start at one end and march to the other We have seen different methods of differing order We will select a method based upon: Accuracy the order of errors in the method Expense how time consuming a method is Stability yet to talk about this!!

7 INTIAL VALUE PROBLEMS FOR ODES So far we have have encountered initial value problems We can start at one end and march to the other We have seen different methods of differing order We will select a method based upon: Accuracy the order of errors in the method Expense how time consuming a method is Stability yet to talk about this!!

8 OUTLINE Review 1 REVIEW 2 BOUNDARY VALUE PROBLEMS 3 NEWTONS SHOOTING METHOD 4 SUMMARY

9 BOUNDARY CONTITIONS All ODEs and PDEs require boundary conditions in order that a solution may exist In initial value problems, the boundary conditions are all on one side This is not always the case, for instance take the following problem: d 2 y dx 2 + κdy dx + xy = 0 with the boundary conditions y(0) = 0 and y(1) = 1. then we have conditions at both ends!

10 BOUNDARY CONTITIONS All ODEs and PDEs require boundary conditions in order that a solution may exist In initial value problems, the boundary conditions are all on one side This is not always the case, for instance take the following problem: d 2 y dx 2 + κdy dx + xy = 0 with the boundary conditions y(0) = 0 and y(1) = 1. then we have conditions at both ends!

11 BOUNDARY CONTITIONS All ODEs and PDEs require boundary conditions in order that a solution may exist In initial value problems, the boundary conditions are all on one side This is not always the case, for instance take the following problem: d 2 y dx 2 + κdy dx + xy = 0 with the boundary conditions y(0) = 0 and y(1) = 1. then we have conditions at both ends!

12 REDUCE THE PROBLEM TO AN ODE We can rewrite the problem above as a system of first order ODEs: Y 1 = y(x); Y 2 = dy dx ; dy 1 dx = Y 2; dy 2 dx = κy 2 xy 1. and the boundary conditions are: Y 1 (x = 0) = 0 and Y 1 (x = 1) = 0.

13 WHAT NEXT? Review In order to solve the problem by marching through x we need to assign a value to Y 2 (x = 0) How to choose a value of Y 2 our choice must satisfy the boundary condition y 1 (x) x

14 WHAT NEXT? Review In order to solve the problem by marching through x we need to assign a value to Y 2 (x = 0) How to choose a value of Y 2 our choice must satisfy the boundary condition y 1 (x) x

15 OUTLINE Review 1 REVIEW 2 BOUNDARY VALUE PROBLEMS 3 NEWTONS SHOOTING METHOD 4 SUMMARY

16 TAKING A GUESS Review Start by making a guess, g, to Y 2 (0) so that Y(0) = ( Y1 (0) Y 2 (0) ) = ( 0. g Next, solve using your favourite method, to get Y(1) = ( Y1 (1) Y 2 (1) ) = ( β1 then by comparing the value β 1 to our boundary condition, we can see how good the guess was β 2 ) )

17 UP A BIT... DOWN A BIT... In order to make our guess better, we want to know whether we have shot above or below Let us look at the value φ(g) = Y 1 (1; g) 1, then the guess is right when φ = 0. This now looks like a root finding problem which leads us to

18 UP A BIT... DOWN A BIT... In order to make our guess better, we want to know whether we have shot above or below Let us look at the value φ(g) = Y 1 (1; g) 1, then the guess is right when φ = 0. This now looks like a root finding problem which leads us to

19 OUTLINE Review 1 REVIEW 2 BOUNDARY VALUE PROBLEMS 3 NEWTONS SHOOTING METHOD 4 SUMMARY

20 CORRECTING THE GUESS Suppose we have taken a guess ĝ, then seek a correction dg such that φ(ĝ + dg) = 0 Then take a Taylor expansion around φ(ĝ) to obtain φ(ĝ + dg) = φ(ĝ) + dg dφ dg (ĝ) + O(dg2 ) So equating this to zero and rearranging we find our correction is dg = φ(ĝ) φ (ĝ)

21 REMINDER... Review Newton s root finding algorithm has quadratic convergence The formula is: x n+1 = x n f(x)/f (x) f(x) x Start with a guess x 0 = 0.8 In order to generate the green line, we need the gradient of f at x 0 = 0.8 The new guess is x 1 =

22 REMINDER... Review Newton s root finding algorithm has quadratic convergence The formula is: x n+1 = x n f(x)/f (x) f(x) x Start with a guess x 0 = 0.8 In order to generate the green line, we need the gradient of f at x 0 = 0.8 The new guess is x 1 =

23 OUTLINE Review 1 REVIEW 2 BOUNDARY VALUE PROBLEMS 3 NEWTONS SHOOTING METHOD 4 SUMMARY

24 SECANT METHOD Review Our formula to generate new guesses is: How do we find φ (g n )? We could estimate it by to give the Secant Method g n+1 = g n φ(g n) φ (g n ) φ (g n ) = φ(g n) φ(g n 1 ) g n g n 1 g n+1 = g n φ(g n)(g n g n 1 ) φ(g n ) φ(g n 1 )

25 SECANT METHOD Review Our formula to generate new guesses is: How do we find φ (g n )? We could estimate it by to give the Secant Method g n+1 = g n φ(g n) φ (g n ) φ (g n ) = φ(g n) φ(g n 1 ) g n g n 1 g n+1 = g n φ(g n)(g n g n 1 ) φ(g n ) φ(g n 1 )

26 OUTLINE Review 1 REVIEW 2 BOUNDARY VALUE PROBLEMS 3 NEWTONS SHOOTING METHOD 4 SUMMARY

27 INITIAL VALUE PROBLEM FOR g Consider again dy 1 dx =Y 2 dy 2 dx = κy 2 xy 1 with Y(0) = (0, g) T Then we can write φ (g n ) = Y 1 g (1; g n) This suggests we should differentiate the original equations with respect to g

28 INITIAL VALUE PROBLEM FOR g Consider again dy 1 dx =Y 2 dy 2 dx = κy 2 xy 1 with Y(0) = (0, g) T Then we can write φ (g n ) = Y 1 g (1; g n) This suggests we should differentiate the original equations with respect to g

29 INITIAL VALUE PROBLEM FOR g Then the initial value problem for φ is given by { } ( d Y = dx g ( Y 0 g = x=0 1 κ Y 2 Y 2 g g x Y 1 g ). ), Then we may recover φ since φ (g n ) = Y 1 g (1; g n) and use newton s formula to generate new guesses

30 INITIAL VALUE PROBLEM FOR g Then the initial value problem for φ is given by { } ( d Y = dx g ( Y 0 g = x=0 1 κ Y 2 Y 2 g g x Y 1 g ). ), Then we may recover φ since φ (g n ) = Y 1 g (1; g n) and use newton s formula to generate new guesses

31 THE NEWTON-AUGMENTED SYSTEM Simultaneously solve for Y and φ, setting Y 1 = y, Y 2 = y, Y 3 = y/ g and Y 4 = y / g Resulting system looks something like dy dx = Y 2 κy 2 xy 1 Y 4 κy 4 xy 3, Y(x = 0) = 0 g 0 1.

32 SUMMARY Boundary value problems are commonplace in CFD and mathematics in general Newton s Shooting method is one of the most common methods for solving these types of problem Newton s method is quadratic, so should converge in 5-15 iterations Start worrying if it doesn t!

33 SUMMARY Boundary value problems are commonplace in CFD and mathematics in general Newton s Shooting method is one of the most common methods for solving these types of problem Newton s method is quadratic, so should converge in 5-15 iterations Start worrying if it doesn t!

Computation Fluid Dynamics

Computation Fluid Dynamics Computation Fluid Dynamics CFD I Jitesh Gajjar Maths Dept Manchester University Computation Fluid Dynamics p.1/189 Garbage In, Garbage Out We will begin with a discussion of errors. Useful to understand

More information

Jim Lambers MAT 460/560 Fall Semester Practice Final Exam

Jim Lambers MAT 460/560 Fall Semester Practice Final Exam Jim Lambers MAT 460/560 Fall Semester 2009-10 Practice Final Exam 1. Let f(x) = sin 2x + cos 2x. (a) Write down the 2nd Taylor polynomial P 2 (x) of f(x) centered around x 0 = 0. (b) Write down the corresponding

More information

ECE 680 Modern Automatic Control. Gradient and Newton s Methods A Review

ECE 680 Modern Automatic Control. Gradient and Newton s Methods A Review ECE 680Modern Automatic Control p. 1/1 ECE 680 Modern Automatic Control Gradient and Newton s Methods A Review Stan Żak October 25, 2011 ECE 680Modern Automatic Control p. 2/1 Review of the Gradient Properties

More information

Numerical differentiation

Numerical differentiation Numerical differentiation Paul Seidel 1801 Lecture Notes Fall 011 Suppose that we have a function f(x) which is not given by a formula but as a result of some measurement or simulation (computer experiment)

More information

Review Higher Order methods Multistep methods Summary HIGHER ORDER METHODS. P.V. Johnson. School of Mathematics. Semester

Review Higher Order methods Multistep methods Summary HIGHER ORDER METHODS. P.V. Johnson. School of Mathematics. Semester HIGHER ORDER METHODS School of Mathematics Semester 1 2008 OUTLINE 1 REVIEW 2 HIGHER ORDER METHODS 3 MULTISTEP METHODS 4 SUMMARY OUTLINE 1 REVIEW 2 HIGHER ORDER METHODS 3 MULTISTEP METHODS 4 SUMMARY OUTLINE

More information

Math 253 Homework due Wednesday, March 9 SOLUTIONS

Math 253 Homework due Wednesday, March 9 SOLUTIONS Math 53 Homework due Wednesday, March 9 SOLUTIONS 1. Do Section 8.8, problems 11,, 15, 17 (these problems have to do with Taylor s Inequality, and they are very similar to what we did on the last homework.

More information

Numerical Methods I Solving Nonlinear Equations

Numerical Methods I Solving Nonlinear Equations Numerical Methods I Solving Nonlinear Equations Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 MATH-GA 2011.003 / CSCI-GA 2945.003, Fall 2014 October 16th, 2014 A. Donev (Courant Institute)

More information

MA22S3 Summary Sheet: Ordinary Differential Equations

MA22S3 Summary Sheet: Ordinary Differential Equations MA22S3 Summary Sheet: Ordinary Differential Equations December 14, 2017 Kreyszig s textbook is a suitable guide for this part of the module. Contents 1 Terminology 1 2 First order separable 2 2.1 Separable

More information

Maths III - Numerical Methods

Maths III - Numerical Methods Maths III - Numerical Methods Matt Probert matt.probert@york.ac.uk 4 Solving Differential Equations 4.1 Introduction Many physical problems can be expressed as differential s, but solving them is not always

More information

ROOT FINDING REVIEW MICHELLE FENG

ROOT FINDING REVIEW MICHELLE FENG ROOT FINDING REVIEW MICHELLE FENG 1.1. Bisection Method. 1. Root Finding Methods (1) Very naive approach based on the Intermediate Value Theorem (2) You need to be looking in an interval with only one

More information

Numerical Methods. Root Finding

Numerical Methods. Root Finding Numerical Methods Solving Non Linear 1-Dimensional Equations Root Finding Given a real valued function f of one variable (say ), the idea is to find an such that: f() 0 1 Root Finding Eamples Find real

More information

Midterm Review. Igor Yanovsky (Math 151A TA)

Midterm Review. Igor Yanovsky (Math 151A TA) Midterm Review Igor Yanovsky (Math 5A TA) Root-Finding Methods Rootfinding methods are designed to find a zero of a function f, that is, to find a value of x such that f(x) =0 Bisection Method To apply

More information

Math 240 Calculus III

Math 240 Calculus III Calculus III Summer 2015, Session II Monday, August 3, 2015 Agenda 1. 2. Introduction The reduction of technique, which applies to second- linear differential equations, allows us to go beyond equations

More information

6x 2 8x + 5 ) = 12x 8

6x 2 8x + 5 ) = 12x 8 Example. If f(x) = x 3 4x + 5x + 1, then f (x) = 6x 8x + 5 Observation: f (x) is also a differentiable function... d dx ( f (x) ) = d dx ( 6x 8x + 5 ) = 1x 8 The derivative of f (x) is called the second

More information

An Overly Simplified and Brief Review of Differential Equation Solution Methods. 1. Some Common Exact Solution Methods for Differential Equations

An Overly Simplified and Brief Review of Differential Equation Solution Methods. 1. Some Common Exact Solution Methods for Differential Equations An Overly Simplified and Brief Review of Differential Equation Solution Methods We will be dealing with initial or boundary value problems. A typical initial value problem has the form y y 0 y(0) 1 A typical

More information

PDE: The Method of Characteristics Page 1

PDE: The Method of Characteristics Page 1 PDE: The Method of Characteristics Page y u x (x, y) + x u y (x, y) =, () u(, y) = cos y 2. Solution The partial differential equation given can be rewritten as follows: u(x, y) y, x =, (2) where = / x,

More information

Scientific Computing: An Introductory Survey

Scientific Computing: An Introductory Survey Scientific Computing: An Introductory Survey Chapter 5 Nonlinear Equations Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002. Reproduction

More information

Numerical Methods in Physics and Astrophysics

Numerical Methods in Physics and Astrophysics Kostas Kokkotas 2 October 20, 2014 2 http://www.tat.physik.uni-tuebingen.de/ kokkotas Kostas Kokkotas 3 TOPICS 1. Solving nonlinear equations 2. Solving linear systems of equations 3. Interpolation, approximation

More information

Numerical Methods in Physics and Astrophysics

Numerical Methods in Physics and Astrophysics Kostas Kokkotas 2 October 17, 2017 2 http://www.tat.physik.uni-tuebingen.de/ kokkotas Kostas Kokkotas 3 TOPICS 1. Solving nonlinear equations 2. Solving linear systems of equations 3. Interpolation, approximation

More information

Lecture 16: Relaxation methods

Lecture 16: Relaxation methods Lecture 16: Relaxation methods Clever technique which begins with a first guess of the trajectory across the entire interval Break the interval into M small steps: x 1 =0, x 2,..x M =L Form a grid of points,

More information

USHA RAMA COLLEGE OF ENGINEERING & TECHNOLOGY

USHA RAMA COLLEGE OF ENGINEERING & TECHNOLOGY Code No: R007/R0 Set No. I B.Tech I Semester Supplementary Examinations, Feb/Mar 04 MATHEMATICAL METHODS ( Common to Civil Engineering, Electrical & Electronics Engineering, Computer Science & Engineering,

More information

Non-linear least squares

Non-linear least squares Non-linear least squares Concept of non-linear least squares We have extensively studied linear least squares or linear regression. We see that there is a unique regression line that can be determined

More information

Chapter 11 ORDINARY DIFFERENTIAL EQUATIONS

Chapter 11 ORDINARY DIFFERENTIAL EQUATIONS Chapter 11 ORDINARY DIFFERENTIAL EQUATIONS The general form of a first order differential equations is = f(x, y) with initial condition y(a) = y a We seek the solution y = y(x) for x > a This is shown

More information

Lecture 39: Root Finding via Newton s Method

Lecture 39: Root Finding via Newton s Method Lecture 39: Root Finding via Newton s Method We have studied two braceting methods for finding zeros of a function, bisection and regula falsi. These methods have certain virtues (most importantly, they

More information

MATH 4211/6211 Optimization Basics of Optimization Problems

MATH 4211/6211 Optimization Basics of Optimization Problems MATH 4211/6211 Optimization Basics of Optimization Problems Xiaojing Ye Department of Mathematics & Statistics Georgia State University Xiaojing Ye, Math & Stat, Georgia State University 0 A standard minimization

More information

CLASS NOTES Models, Algorithms and Data: Introduction to computing 2018

CLASS NOTES Models, Algorithms and Data: Introduction to computing 2018 CLASS NOTES Models, Algorithms and Data: Introduction to computing 2018 Petros Koumoutsakos, Jens Honore Walther (Last update: April 16, 2018) IMPORTANT DISCLAIMERS 1. REFERENCES: Much of the material

More information

Numerical analysis meets number theory: using rootfinding methods to calculate inverses mod p n

Numerical analysis meets number theory: using rootfinding methods to calculate inverses mod p n Numerical analysis meets number theory: using rootfinding methods to calculate inverses mod p n This article is dedicated to the memory of George Mackiw June 7, 2004 Introduction In this article we explore

More information

Newton-Raphson. Relies on the Taylor expansion f(x + δ) = f(x) + δ f (x) + ½ δ 2 f (x) +..

Newton-Raphson. Relies on the Taylor expansion f(x + δ) = f(x) + δ f (x) + ½ δ 2 f (x) +.. 2008 Lecture 7 starts here Newton-Raphson When the derivative of f(x) is known, and when f(x) is well behaved, the celebrated (and ancient) Newton- Raphson method gives the fastest convergence of all (

More information

(6.2) -The Shooting Method for Nonlinear Problems

(6.2) -The Shooting Method for Nonlinear Problems (6.2) -The Shooting Method for Nonlinear Problems Consider the boundary value problems (BVPs) for the second order differential equation of the form (*) y f x,y,y, a x b, y a and y b. When f x,y,y is linear

More information

ES 111 Mathematical Methods in the Earth Sciences Lecture Outline 15 - Tues 20th Nov 2018 First and Higher Order Differential Equations

ES 111 Mathematical Methods in the Earth Sciences Lecture Outline 15 - Tues 20th Nov 2018 First and Higher Order Differential Equations ES 111 Mathematical Methods in the Earth Sciences Lecture Outline 15 - Tues 20th Nov 2018 First and Higher Order Differential Equations Integrating Factor Here is a powerful technique which will work (only!)

More information

Lecture 1, August 21, 2017

Lecture 1, August 21, 2017 Engineering Mathematics 1 Fall 2017 Lecture 1, August 21, 2017 What is a differential equation? A differential equation is an equation relating a function (known sometimes as the unknown) to some of its

More information

Linear Multistep Methods I: Adams and BDF Methods

Linear Multistep Methods I: Adams and BDF Methods Linear Multistep Methods I: Adams and BDF Methods Varun Shankar January 1, 016 1 Introduction In our review of 5610 material, we have discussed polynomial interpolation and its application to generating

More information

FIXED POINT ITERATION

FIXED POINT ITERATION FIXED POINT ITERATION The idea of the fixed point iteration methods is to first reformulate a equation to an equivalent fixed point problem: f (x) = 0 x = g(x) and then to use the iteration: with an initial

More information

Fourth Order RK-Method

Fourth Order RK-Method Fourth Order RK-Method The most commonly used method is Runge-Kutta fourth order method. The fourth order RK-method is y i+1 = y i + 1 6 (k 1 + 2k 2 + 2k 3 + k 4 ), Ordinary Differential Equations (ODE)

More information

MATH 353 LECTURE NOTES: WEEK 1 FIRST ORDER ODES

MATH 353 LECTURE NOTES: WEEK 1 FIRST ORDER ODES MATH 353 LECTURE NOTES: WEEK 1 FIRST ORDER ODES J. WONG (FALL 2017) What did we cover this week? Basic definitions: DEs, linear operators, homogeneous (linear) ODEs. Solution techniques for some classes

More information

NATIONAL UNIVERSITY OF SINGAPORE PC5215 NUMERICAL RECIPES WITH APPLICATIONS. (Semester I: AY ) Time Allowed: 2 Hours

NATIONAL UNIVERSITY OF SINGAPORE PC5215 NUMERICAL RECIPES WITH APPLICATIONS. (Semester I: AY ) Time Allowed: 2 Hours NATIONAL UNIVERSITY OF SINGAPORE PC55 NUMERICAL RECIPES WITH APPLICATIONS (Semester I: AY 0-) Time Allowed: Hours INSTRUCTIONS TO CANDIDATES. This examination paper contains FIVE questions and comprises

More information

3 Algebraic Methods. we can differentiate both sides implicitly to obtain a differential equation involving x and y:

3 Algebraic Methods. we can differentiate both sides implicitly to obtain a differential equation involving x and y: 3 Algebraic Methods b The first appearance of the equation E Mc 2 in Einstein s handwritten notes. So far, the only general class of differential equations that we know how to solve are directly integrable

More information

Introduction to gradient descent

Introduction to gradient descent 6-1: Introduction to gradient descent Prof. J.C. Kao, UCLA Introduction to gradient descent Derivation and intuitions Hessian 6-2: Introduction to gradient descent Prof. J.C. Kao, UCLA Introduction Our

More information

Numerical Optimization Algorithms

Numerical Optimization Algorithms Numerical Optimization Algorithms 1. Overview. Calculus of Variations 3. Linearized Supersonic Flow 4. Steepest Descent 5. Smoothed Steepest Descent Overview 1 Two Main Categories of Optimization Algorithms

More information

SYSTEMS OF NONLINEAR EQUATIONS

SYSTEMS OF NONLINEAR EQUATIONS SYSTEMS OF NONLINEAR EQUATIONS Widely used in the mathematical modeling of real world phenomena. We introduce some numerical methods for their solution. For better intuition, we examine systems of two

More information

Advanced Techniques for Mobile Robotics Least Squares. Wolfram Burgard, Cyrill Stachniss, Kai Arras, Maren Bennewitz

Advanced Techniques for Mobile Robotics Least Squares. Wolfram Burgard, Cyrill Stachniss, Kai Arras, Maren Bennewitz Advanced Techniques for Mobile Robotics Least Squares Wolfram Burgard, Cyrill Stachniss, Kai Arras, Maren Bennewitz Problem Given a system described by a set of n observation functions {f i (x)} i=1:n

More information

! 1.1 Definitions and Terminology

! 1.1 Definitions and Terminology ! 1.1 Definitions and Terminology 1. Introduction: At times, mathematics aims to describe a physical phenomenon (take the population of bacteria in a petri dish for example). We want to find a function

More information

Analysis Methods in Atmospheric and Oceanic Science

Analysis Methods in Atmospheric and Oceanic Science Analysis Methods in Atmospheric and Oceanic Science AOSC 652 Week 7, Day 1 13 Oct 2014 1 Student projects: 20% of the final grade: you will receive a numerical score for the project and final grade will

More information

Analysis Methods in Atmospheric and Oceanic Science

Analysis Methods in Atmospheric and Oceanic Science Analysis Methods in Atmospheric and Oceanic Science 1 AOSC 652 Week 7, Day 1 10 Oct 2016 Student projects: 20% of the final grade: you will receive a numerical score for the project and final grade will

More information

Applied Mathematics 205. Unit I: Data Fitting. Lecturer: Dr. David Knezevic

Applied Mathematics 205. Unit I: Data Fitting. Lecturer: Dr. David Knezevic Applied Mathematics 205 Unit I: Data Fitting Lecturer: Dr. David Knezevic Unit I: Data Fitting Chapter I.4: Nonlinear Least Squares 2 / 25 Nonlinear Least Squares So far we have looked at finding a best

More information

Introduction to Partial Differential Equations

Introduction to Partial Differential Equations Introduction to Partial Differential Equations Philippe B. Laval KSU Current Semester Philippe B. Laval (KSU) Key Concepts Current Semester 1 / 25 Introduction The purpose of this section is to define

More information

Outline. Scientific Computing: An Introductory Survey. Nonlinear Equations. Nonlinear Equations. Examples: Nonlinear Equations

Outline. Scientific Computing: An Introductory Survey. Nonlinear Equations. Nonlinear Equations. Examples: Nonlinear Equations Methods for Systems of Methods for Systems of Outline Scientific Computing: An Introductory Survey Chapter 5 1 Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign

More information

Math 240 Calculus III

Math 240 Calculus III DE Higher Order Calculus III Summer 2015, Session II Tuesday, July 28, 2015 Agenda DE 1. of order n An example 2. constant-coefficient linear Introduction DE We now turn our attention to solving linear

More information

2.2 Separable Equations

2.2 Separable Equations 2.2 Separable Equations Definition A first-order differential equation that can be written in the form Is said to be separable. Note: the variables of a separable equation can be written as Examples Solve

More information

Lecture 5: Random numbers and Monte Carlo (Numerical Recipes, Chapter 7) Motivations for generating random numbers

Lecture 5: Random numbers and Monte Carlo (Numerical Recipes, Chapter 7) Motivations for generating random numbers Lecture 5: Random numbers and Monte Carlo (Numerical Recipes, Chapter 7) Motivations for generating random numbers To sample a function in a statistically controlled manner (i.e. for Monte Carlo integration)

More information

6x 2 8x + 5 ) = 12x 8. f (x) ) = d (12x 8) = 12

6x 2 8x + 5 ) = 12x 8. f (x) ) = d (12x 8) = 12 AMS/ECON 11A Class Notes 11/6/17 UCSC *) Higher order derivatives Example. If f = x 3 x + 5x + 1, then f = 6x 8x + 5 Observation: f is also a differentiable function... d f ) = d 6x 8x + 5 ) = 1x 8 dx

More information

MTH210 DIFFERENTIAL EQUATIONS. Dr. Gizem SEYHAN ÖZTEPE

MTH210 DIFFERENTIAL EQUATIONS. Dr. Gizem SEYHAN ÖZTEPE MTH210 DIFFERENTIAL EQUATIONS Dr. Gizem SEYHAN ÖZTEPE 1 References Logan, J. David. A first course in differential equations. Springer, 2015. Zill, Dennis G. A first course in differential equations with

More information

CHAPTER 7. An Introduction to Numerical Methods for. Linear and Nonlinear ODE s

CHAPTER 7. An Introduction to Numerical Methods for. Linear and Nonlinear ODE s A SERIES OF CLASS NOTES FOR 2005-2006 TO INTRODUCE LINEAR AND NONLINEAR PROBLEMS TO ENGINEERS, SCIENTISTS, AND APPLIED MATHEMATICIANS DE CLASS NOTES 1 A COLLECTION OF HANDOUTS ON FIRST ORDER ORDINARY DIFFERENTIAL

More information

y 2y = 4 x, Name Form Solution method

y 2y = 4 x, Name Form Solution method An Introduction to Higher-Order Differential Equations Up to this point in the class, we have only specifically studied solution techniques for first-order differential equations, i.e. equations whose

More information

REVIEW OF DIFFERENTIAL CALCULUS

REVIEW OF DIFFERENTIAL CALCULUS REVIEW OF DIFFERENTIAL CALCULUS DONU ARAPURA 1. Limits and continuity To simplify the statements, we will often stick to two variables, but everything holds with any number of variables. Let f(x, y) be

More information

Introduction to ODE's (0A) Young Won Lim 3/9/15

Introduction to ODE's (0A) Young Won Lim 3/9/15 Introduction to ODE's (0A) Copyright (c) 2011-2014 Young W. Lim. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2

More information

Gradient Based Optimization Methods

Gradient Based Optimization Methods Gradient Based Optimization Methods Antony Jameson, Department of Aeronautics and Astronautics Stanford University, Stanford, CA 94305-4035 1 Introduction Consider the minimization of a function J(x) where

More information

Ordinary Differential Equations

Ordinary Differential Equations Ordinary Differential Equations Part 4 Massimo Ricotti ricotti@astro.umd.edu University of Maryland Ordinary Differential Equations p. 1/23 Two-point Boundary Value Problems NRiC 17. BCs specified at two

More information

Chapter 9: Differential Analysis

Chapter 9: Differential Analysis 9-1 Introduction 9-2 Conservation of Mass 9-3 The Stream Function 9-4 Conservation of Linear Momentum 9-5 Navier Stokes Equation 9-6 Differential Analysis Problems Recall 9-1 Introduction (1) Chap 5: Control

More information

Root Finding (and Optimisation)

Root Finding (and Optimisation) Root Finding (and Optimisation) M.Sc. in Mathematical Modelling & Scientific Computing, Practical Numerical Analysis Michaelmas Term 2018, Lecture 4 Root Finding The idea of root finding is simple we want

More information

Workshop on Theoretical Ecology and Global Change March 2009

Workshop on Theoretical Ecology and Global Change March 2009 2022-3 Workshop on Theoretical Ecology and Global Change 2-18 March 2009 Stability Analysis of Food Webs: An Introduction to Local Stability of Dynamical Systems S. Allesina National Center for Ecological

More information

Optimization. Totally not complete this is...don't use it yet...

Optimization. Totally not complete this is...don't use it yet... Optimization Totally not complete this is...don't use it yet... Bisection? Doing a root method is akin to doing a optimization method, but bi-section would not be an effective method - can detect sign

More information

Report due date. Please note: report has to be handed in by Monday, May 16 noon.

Report due date. Please note: report has to be handed in by Monday, May 16 noon. Lecture 23 18.86 Report due date Please note: report has to be handed in by Monday, May 16 noon. Course evaluation: Please submit your feedback (you should have gotten an email) From the weak form to finite

More information

MATH 350: Introduction to Computational Mathematics

MATH 350: Introduction to Computational Mathematics MATH 350: Introduction to Computational Mathematics Chapter IV: Locating Roots of Equations Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Spring 2011 fasshauer@iit.edu

More information

Do not turn over until you are told to do so by the Invigilator.

Do not turn over until you are told to do so by the Invigilator. UNIVERSITY OF EAST ANGLIA School of Mathematics Main Series UG Examination 216 17 INTRODUCTION TO NUMERICAL ANALYSIS MTHE612B Time allowed: 3 Hours Attempt QUESTIONS 1 and 2, and THREE other questions.

More information

Lecture 2. Introduction to Differential Equations. Roman Kitsela. October 1, Roman Kitsela Lecture 2 October 1, / 25

Lecture 2. Introduction to Differential Equations. Roman Kitsela. October 1, Roman Kitsela Lecture 2 October 1, / 25 Lecture 2 Introduction to Differential Equations Roman Kitsela October 1, 2018 Roman Kitsela Lecture 2 October 1, 2018 1 / 25 Quick announcements URL for the class website: http://www.math.ucsd.edu/~rkitsela/20d/

More information

Chapter 4: Numerical Methods for Common Mathematical Problems

Chapter 4: Numerical Methods for Common Mathematical Problems 1 Capter 4: Numerical Metods for Common Matematical Problems Interpolation Problem: Suppose we ave data defined at a discrete set of points (x i, y i ), i = 0, 1,..., N. Often it is useful to ave a smoot

More information

DIFFERENTIAL EQUATIONS

DIFFERENTIAL EQUATIONS DIFFERENTIAL EQUATIONS Basic Terminology A differential equation is an equation that contains an unknown function together with one or more of its derivatives. 1 Examples: 1. y = 2x + cos x 2. dy dt =

More information

Lecture 9 Approximations of Laplace s Equation, Finite Element Method. Mathématiques appliquées (MATH0504-1) B. Dewals, C.

Lecture 9 Approximations of Laplace s Equation, Finite Element Method. Mathématiques appliquées (MATH0504-1) B. Dewals, C. Lecture 9 Approximations of Laplace s Equation, Finite Element Method Mathématiques appliquées (MATH54-1) B. Dewals, C. Geuzaine V1.2 23/11/218 1 Learning objectives of this lecture Apply the finite difference

More information

DIFFERENTIAL EQUATIONS

DIFFERENTIAL EQUATIONS DIFFERENTIAL EQUATIONS 1. Basic Terminology A differential equation is an equation that contains an unknown function together with one or more of its derivatives. 1 Examples: 1. y = 2x + cos x 2. dy dt

More information

Quasi-Newton Methods

Quasi-Newton Methods Newton s Method Pros and Cons Quasi-Newton Methods MA 348 Kurt Bryan Newton s method has some very nice properties: It s extremely fast, at least once it gets near the minimum, and with the simple modifications

More information

x 2 x n r n J(x + t(x x ))(x x )dt. For warming-up we start with methods for solving a single equation of one variable.

x 2 x n r n J(x + t(x x ))(x x )dt. For warming-up we start with methods for solving a single equation of one variable. Maria Cameron 1. Fixed point methods for solving nonlinear equations We address the problem of solving an equation of the form (1) r(x) = 0, where F (x) : R n R n is a vector-function. Eq. (1) can be written

More information

Second Order ODEs. CSCC51H- Numerical Approx, Int and ODEs p.130/177

Second Order ODEs. CSCC51H- Numerical Approx, Int and ODEs p.130/177 Second Order ODEs Often physical or biological systems are best described by second or higher-order ODEs. That is, second or higher order derivatives appear in the mathematical model of the system. For

More information

DELFT UNIVERSITY OF TECHNOLOGY Faculty of Electrical Engineering, Mathematics and Computer Science

DELFT UNIVERSITY OF TECHNOLOGY Faculty of Electrical Engineering, Mathematics and Computer Science DELFT UNIVERSITY OF TECHNOLOGY Faculty of Electrical Engineering, Mathematics and Computer Science ANSWERS OF THE TEST NUMERICAL METHODS FOR DIFFERENTIAL EQUATIONS (WI097 TU) Thursday January 014, 18:0-1:0

More information

Chapter 9: Differential Analysis of Fluid Flow

Chapter 9: Differential Analysis of Fluid Flow of Fluid Flow Objectives 1. Understand how the differential equations of mass and momentum conservation are derived. 2. Calculate the stream function and pressure field, and plot streamlines for a known

More information

Applied Calculus. Review Problems for the Final Exam

Applied Calculus. Review Problems for the Final Exam Math135 Study Guide 1 Math 131/135/194, Fall 2004 Applied Calculus Daniel Kaplan, Macalester College Review Problems for the Final Exam Problem 1../DE/102b.tex Problem 3../DE/107.tex Consider the pair

More information

1 Lecture 24: Linearization

1 Lecture 24: Linearization 1 Lecture 24: Linearization 1.1 Outline The linearization of a function at a point a. Linear approximation of the change in f. Error, absolute error. Examples 1.2 Linearization Functions can be complicated.

More information

1. Nonlinear Equations. This lecture note excerpted parts from Michael Heath and Max Gunzburger. f(x) = 0

1. Nonlinear Equations. This lecture note excerpted parts from Michael Heath and Max Gunzburger. f(x) = 0 Numerical Analysis 1 1. Nonlinear Equations This lecture note excerpted parts from Michael Heath and Max Gunzburger. Given function f, we seek value x for which where f : D R n R n is nonlinear. f(x) =

More information

DIFFERENTIAL EQUATIONS

DIFFERENTIAL EQUATIONS DIFFERENTIAL EQUATIONS 1. Basic Terminology A differential equation is an equation that contains an unknown function together with one or more of its derivatives. 1 Examples: 1. y = 2x + cos x 2. dy dt

More information

Problem Set 1 solutions

Problem Set 1 solutions University of Alabama Department of Physics and Astronomy PH 301 / LeClair Fall 2018 Problem Set 1 solutions 1. If a(t), b(t), and c(t) are functions of t, verify the following results: ( d [a (b c)] =

More information

First Order ODEs, Part I

First Order ODEs, Part I Craig J. Sutton craig.j.sutton@dartmouth.edu Department of Mathematics Dartmouth College Math 23 Differential Equations Winter 2013 Outline 1 2 in General 3 The Definition & Technique Example Test for

More information

MATH 350: Introduction to Computational Mathematics

MATH 350: Introduction to Computational Mathematics MATH 350: Introduction to Computational Mathematics Chapter IV: Locating Roots of Equations Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Spring 2011 fasshauer@iit.edu

More information

Ordinary Differential Equations

Ordinary Differential Equations Ordinary Differential Equations (MA102 Mathematics II) Shyamashree Upadhyay IIT Guwahati Shyamashree Upadhyay ( IIT Guwahati ) Ordinary Differential Equations 1 / 1 Books Shyamashree Upadhyay ( IIT Guwahati

More information

UNIVERSITY OF SOUTHAMPTON. A foreign language dictionary (paper version) is permitted provided it contains no notes, additions or annotations.

UNIVERSITY OF SOUTHAMPTON. A foreign language dictionary (paper version) is permitted provided it contains no notes, additions or annotations. UNIVERSITY OF SOUTHAMPTON MATH055W SEMESTER EXAMINATION 03/4 MATHEMATICS FOR ELECTRONIC & ELECTRICAL ENGINEERING Duration: 0 min Solutions Only University approved calculators may be used. A foreign language

More information

MATH 319, WEEK 2: Initial Value Problems, Existence/Uniqueness, First-Order Linear DEs

MATH 319, WEEK 2: Initial Value Problems, Existence/Uniqueness, First-Order Linear DEs MATH 319, WEEK 2: Initial Value Problems, Existence/Uniqueness, First-Order Linear DEs 1 Initial-Value Problems We have seen that differential equations can, in general, given rise to multiple solutions.

More information

1. Method 1: bisection. The bisection methods starts from two points a 0 and b 0 such that

1. Method 1: bisection. The bisection methods starts from two points a 0 and b 0 such that Chapter 4 Nonlinear equations 4.1 Root finding Consider the problem of solving any nonlinear relation g(x) = h(x) in the real variable x. We rephrase this problem as one of finding the zero (root) of a

More information

Convergence Rates on Root Finding

Convergence Rates on Root Finding Convergence Rates on Root Finding Com S 477/577 Oct 5, 004 A sequence x i R converges to ξ if for each ǫ > 0, there exists an integer Nǫ) such that x l ξ > ǫ for all l Nǫ). The Cauchy convergence criterion

More information

CS 323: Numerical Analysis and Computing

CS 323: Numerical Analysis and Computing CS 323: Numerical Analysis and Computing MIDTERM #2 Instructions: This is an open notes exam, i.e., you are allowed to consult any textbook, your class notes, homeworks, or any of the handouts from us.

More information

Problem. Set up the definite integral that gives the area of the region. y 1 = x 2 6x, y 2 = 0. dx = ( 2x 2 + 6x) dx.

Problem. Set up the definite integral that gives the area of the region. y 1 = x 2 6x, y 2 = 0. dx = ( 2x 2 + 6x) dx. Wednesday, September 3, 5 Page Problem Problem. Set up the definite integral that gives the area of the region y x 6x, y Solution. The graphs intersect at x and x 6 and y is the uppermost function. So

More information

Math and Numerical Methods Review

Math and Numerical Methods Review Math and Numerical Methods Review Michael Caracotsios, Ph.D. Clinical Associate Professor Chemical Engineering Department University of Illinois at Chicago Introduction In the study of chemical engineering

More information

The Shooting Method for Boundary Value Problems

The Shooting Method for Boundary Value Problems 1 The Shooting Method for Boundary Value Problems Consider a boundary value problem of the form y = f(x, y, y ), a x b, y(a) = α, y(b) = β. (1.1) One natural way to approach this problem is to study the

More information

Lecture Notes to Accompany. Scientific Computing An Introductory Survey. by Michael T. Heath. Chapter 5. Nonlinear Equations

Lecture Notes to Accompany. Scientific Computing An Introductory Survey. by Michael T. Heath. Chapter 5. Nonlinear Equations Lecture Notes to Accompany Scientific Computing An Introductory Survey Second Edition by Michael T Heath Chapter 5 Nonlinear Equations Copyright c 2001 Reproduction permitted only for noncommercial, educational

More information

1 Newton s Method. Suppose we want to solve: x R. At x = x, f (x) can be approximated by:

1 Newton s Method. Suppose we want to solve: x R. At x = x, f (x) can be approximated by: Newton s Method Suppose we want to solve: (P:) min f (x) At x = x, f (x) can be approximated by: n x R. f (x) h(x) := f ( x)+ f ( x) T (x x)+ (x x) t H ( x)(x x), 2 which is the quadratic Taylor expansion

More information

Numerical solutions of nonlinear systems of equations

Numerical solutions of nonlinear systems of equations Numerical solutions of nonlinear systems of equations Tsung-Ming Huang Department of Mathematics National Taiwan Normal University, Taiwan E-mail: min@math.ntnu.edu.tw August 28, 2011 Outline 1 Fixed points

More information

Exam 3 MATH Calculus I

Exam 3 MATH Calculus I Trinity College December 03, 2015 MATH 131-01 Calculus I By signing below, you attest that you have neither given nor received help of any kind on this exam. Signature: Printed Name: Instructions: Show

More information

Solutions of separable equations often are in an implicit form; that is, not solved for the dependent variable.

Solutions of separable equations often are in an implicit form; that is, not solved for the dependent variable. Section 2.2 Separable DEs Key Terms: Separable DEs; the DE can be rearranged so that all terms containing the independent variable are on one side of the equal sign and all terms containing the dependent

More information

a factors The exponential 0 is a special case. If b is any nonzero real number, then

a factors The exponential 0 is a special case. If b is any nonzero real number, then 0.1 Exponents The expression x a is an exponential expression with base x and exponent a. If the exponent a is a positive integer, then the expression is simply notation that counts how many times the

More information

ENGI Partial Differentiation Page y f x

ENGI Partial Differentiation Page y f x ENGI 344 4 Partial Differentiation Page 4-0 4. Partial Differentiation For functions of one variable, be found unambiguously by differentiation: y f x, the rate of change of the dependent variable can

More information

ASSIGNMENT BOOKLET. Numerical Analysis (MTE-10) (Valid from 1 st July, 2011 to 31 st March, 2012)

ASSIGNMENT BOOKLET. Numerical Analysis (MTE-10) (Valid from 1 st July, 2011 to 31 st March, 2012) ASSIGNMENT BOOKLET MTE-0 Numerical Analysis (MTE-0) (Valid from st July, 0 to st March, 0) It is compulsory to submit the assignment before filling in the exam form. School of Sciences Indira Gandhi National

More information

Transformations and A Universal First Order Taylor Expansion

Transformations and A Universal First Order Taylor Expansion Transformations and A Universal First Order Taylor Expansion MATH 1502 Calculus II Notes September 29, 2008 The first order Taylor approximation for f : R R at x = x 0 is given by P 1 (x) = f (x 0 )(x

More information