Solving Constrained Differential- Algebraic Systems Using Projections. Richard J. Hanson Fred T. Krogh August 16, mathalacarte.

Size: px
Start display at page:

Download "Solving Constrained Differential- Algebraic Systems Using Projections. Richard J. Hanson Fred T. Krogh August 16, mathalacarte."

Transcription

1 Solving Constrained Differential- Algebraic Systems Using Projections Richard J. Hanson Fred T. Krogh August 6, mathalacarte.com

2 Abbreviations and Terms ODE = Ordinary Differential Equations DAE = Differential-Algebraic Equations PDE = Partial Differential Equations BDF = Backward Differentiation Formulas Index of a DAE

3 Abbreviations and Terms DASSL, DASSLX, DASPG, DASPK Names of Fortran 77 software for solving DAE and ODE systems. They all originated with work of Linda Petzold and colleagues.

4 Agenda DAE Problem Statements Noting Constraint Violations Outline of BDF Solution for DAE DAE Problem Statement with Constraints Projection following BDF Step Examples using Projection Method Issues about the software

5 DAE Problem Statement yn F N ( ) = ( ) y t ( ) , a dynamic vector, a vector function: dy F( t, y, y ) = 0, y =, dt y t = y y t = y

6 A Sampling of Applications Modeling dynamic systems Financial Engineering Solving PDE systems

7 Planar Pendulum In rectangular coordinates: ( x y L ) 2 d x x = λx, x =, 2 dt y = λy g 2 + = 0

8 Pendulum as First Order System Define components of a vector and write the model in these symbols: y y y y y = = = = = x y y y λ y y = 2 3 y y = 2 4 yy y = 0 yy+ y + g= ( y ) y2 L 0 + = 0

9 Make a Note: Kinetic energy + Potential energy = Constant, Plus initial conditions: ( 2 2 y ) 3 + y4 + y2g = 0 2 y 0 = L, y 0 = 0, j = 2,3,4,5 ( ) ( ) j

10 Reduction of Index, a source of constraint violation This constraint (the length) is differentiated three or two times to yield an index 0 or index problem: ( 2 2 2) 2 2 y + y L = 0

11 Ancillary Constraints from Index Reduction ( 2 2 2) 2 2 y + y L = yy yy yy yy 0 (An original system equation) = = 0 d ( yy yy ) yl y y gy dt = = 0 d dt ( ) yl + y + y gy = yl 3yg=

12 Dynamic Length of Pendulum?

13 Constrained DAE Problem yn F N ( ) = ( ) y t ( ) , a dynamic vector, a vector function: dy F( t, y, y ) = 0, y =, dt y t = y y t = y Gty (, ) = 0, Mconstraint functions

14 Constraints for Pendulum ( 2 2 2) 2 0, Constraint is a system equation 2 y + y L = yy + yy = 0, Constraint with index and index 0 systems yl + y + y gy = , Constraint with index 0 system ( 2 2) y + y + y g = 0, Total Energy, index and index 0 systems

15 Modifications to DASSL Recall the predictor-corrector steps used to solve index or index 0 systems using DASSL:. Predict yn, y + n+ using interpolation of known values yn i, i = 0,, k 2. Correct by solving ( α β) F t, y, y+ = 0 for y = y n+ n+ 3. We have a candidate that may violate the constraints G( tn+, yn+ ) = 0

16 Moving to the Constraints. We intervene before accepting 2. Solve Gt ( y dy) 0 dy = for n+, n+ 3. Use Newton s method: y n + 4. Accept the projected step, with a possible scaling for size: y = y dy n+ n+ ( ) Cdy G t y C G y = n+, n+, =

17 Some Details of the Newton Step. Compute the minimum length solution of (, ) Cdy = G t y n+ n+ 2. Use a norm define by the accuracy or tuning weights WT = RTOL y + ATOL, i =,, N i i i i 3. Move onto the constraints with a step that N /2 2 /2 minimizes WT du, dy = W du i= i i

18 Comments on the Linear Algebra. We use plane rotations to solve the system: ( ) CW du = G t, y, dy = W du /2 /2 n+ n+ 2. At each step the constraint system is computed, factored and solved. 3. For large sparse problems one could solve the square system A 0 u b = = = T I A v 0 ( ) /2, A CW, b G tn+, yn+

19 Examples, Pendulum Problem The following slides will show that:. Using constraints and the projection method one can achieve acceptable results. 2. Using Index 0 systems gives superior results to those with Index systems. 3. Using all available invariants for the system is necessary, including total energy.

20 Problem Constraints Not Using Total Energy. Index constraints, M=2: ( ) ( ) 2, 2 y y L + G t y = yy 3+ yy Index 0 constraints, M=3: 2 G ( t, y) = y y + y y ( y y2 L ) yl 5 + y3 + y4 gy2

21 Index_ Index_0 Solution

22 Problem Constraints Using Total Energy. Index constraints, M=3: ( y + y2 L ) 2 ˆ G ( t, y) = y y + y y ( y3 + y4) + y2g 2. Index 0 constraints, M=4: ( y + y2 L ) ( t y) Gˆ, y5l + y3 + y4 gy2 yy + yy = 2 2 ( y3 + y4) + y2g 2

23 Index_ Index_0 Solution

24 Software Issues A code, DASSLX, was developed as a modified version of DASSL but with newly added features:. Constraints are allowed and maintained 2. Step-size smoothing is implemented using a method due to G. Söderlind. 3. An extended interface allows for userdefined linear solvers and either reverse or forward communication.

25 Software Issues, Negatives The preferred starting algorithm has been replaced by Petzold. This work is called daspk3.. It is found in later DASPK codes. DASSLX uses the starting algorithm found in the older versions of DASSL. There are occasional convergence failures. The DASSLX code is complex and hard to maintain.

26 Last Slide Questions?

Sensitivity analysis of differential algebraic equations: A comparison of methods on a special problem

Sensitivity analysis of differential algebraic equations: A comparison of methods on a special problem Applied Numerical Mathematics 32 (2000) 161 174 Sensitivity analysis of differential algebraic equations: A comparison of methods on a special problem Shengtai Li a, Linda Petzold a,, Wenjie Zhu b a Department

More information

CS520: numerical ODEs (Ch.2)

CS520: numerical ODEs (Ch.2) .. CS520: numerical ODEs (Ch.2) Uri Ascher Department of Computer Science University of British Columbia ascher@cs.ubc.ca people.cs.ubc.ca/ ascher/520.html Uri Ascher (UBC) CPSC 520: ODEs (Ch. 2) Fall

More information

Linear Multistep Methods I: Adams and BDF Methods

Linear Multistep Methods I: Adams and BDF Methods Linear Multistep Methods I: Adams and BDF Methods Varun Shankar January 1, 016 1 Introduction In our review of 5610 material, we have discussed polynomial interpolation and its application to generating

More information

CHAPTER 10: Numerical Methods for DAEs

CHAPTER 10: Numerical Methods for DAEs CHAPTER 10: Numerical Methods for DAEs Numerical approaches for the solution of DAEs divide roughly into two classes: 1. direct discretization 2. reformulation (index reduction) plus discretization Direct

More information

An initialization subroutine for DAEs solvers: DAEIS

An initialization subroutine for DAEs solvers: DAEIS Computers and Chemical Engineering 25 (2001) 301 311 www.elsevier.com/locate/compchemeng An initialization subroutine for DAEs solvers: DAEIS B. Wu, R.E. White * Department of Chemical Engineering, Uniersity

More information

CHAPTER 5: Linear Multistep Methods

CHAPTER 5: Linear Multistep Methods CHAPTER 5: Linear Multistep Methods Multistep: use information from many steps Higher order possible with fewer function evaluations than with RK. Convenient error estimates. Changing stepsize or order

More information

Differential-Algebraic Equations (DAEs)

Differential-Algebraic Equations (DAEs) Differential-Algebraic Equations (DAEs) L. T. Biegler Chemical Engineering Department Carnegie Mellon University Pittsburgh, PA 15213 biegler@cmu.edu http://dynopt.cheme.cmu.edu Introduction Simple Examples

More information

ODE - Problem ROBER. 0.04y y 2 y y y 2 y y y 2 2

ODE - Problem ROBER. 0.04y y 2 y y y 2 y y y 2 2 ODE - Problem ROBER II-10-1 10 Problem ROBER 10.1 General information The problem consists of a stiff system of 3 non-linear ordinary differential equations. It was proposed by H.H. Robertson in 1966 [Rob66].

More information

1.2 Derivation. d p f = d p f(x(p)) = x fd p x (= f x x p ). (1) Second, g x x p + g p = 0. d p f = f x g 1. The expression f x gx

1.2 Derivation. d p f = d p f(x(p)) = x fd p x (= f x x p ). (1) Second, g x x p + g p = 0. d p f = f x g 1. The expression f x gx PDE-constrained optimization and the adjoint method Andrew M. Bradley November 16, 21 PDE-constrained optimization and the adjoint method for solving these and related problems appear in a wide range of

More information

APPLICATIONS OF FD APPROXIMATIONS FOR SOLVING ORDINARY DIFFERENTIAL EQUATIONS

APPLICATIONS OF FD APPROXIMATIONS FOR SOLVING ORDINARY DIFFERENTIAL EQUATIONS LECTURE 10 APPLICATIONS OF FD APPROXIMATIONS FOR SOLVING ORDINARY DIFFERENTIAL EQUATIONS Ordinary Differential Equations Initial Value Problems For Initial Value problems (IVP s), conditions are specified

More information

Bindel, Fall 2011 Intro to Scientific Computing (CS 3220) Week 12: Monday, Apr 18. HW 7 is posted, and will be due in class on 4/25.

Bindel, Fall 2011 Intro to Scientific Computing (CS 3220) Week 12: Monday, Apr 18. HW 7 is posted, and will be due in class on 4/25. Logistics Week 12: Monday, Apr 18 HW 6 is due at 11:59 tonight. HW 7 is posted, and will be due in class on 4/25. The prelim is graded. An analysis and rubric are on CMS. Problem du jour For implicit methods

More information

Numerical Algorithms for ODEs/DAEs (Transient Analysis)

Numerical Algorithms for ODEs/DAEs (Transient Analysis) Numerical Algorithms for ODEs/DAEs (Transient Analysis) Slide 1 Solving Differential Equation Systems d q ( x(t)) + f (x(t)) + b(t) = 0 dt DAEs: many types of solutions useful DC steady state: state no

More information

c 2004 Society for Industrial and Applied Mathematics

c 2004 Society for Industrial and Applied Mathematics SIAM J. SCI. COMPUT. Vol. 26, No. 2, pp. 359 374 c 24 Society for Industrial and Applied Mathematics A POSTERIORI ERROR ESTIMATION AND GLOBAL ERROR CONTROL FOR ORDINARY DIFFERENTIAL EQUATIONS BY THE ADJOINT

More information

Numerical integration of DAE s

Numerical integration of DAE s Numerical integration of DAE s seminar Sandra Allaart-Bruin sbruin@win.tue.nl seminar p.1 Seminar overview February 18 Arie Verhoeven Introduction to DAE s seminar p.2 Seminar overview February 18 Arie

More information

Numerical Integration of Equations of Motion

Numerical Integration of Equations of Motion GraSMech course 2009-2010 Computer-aided analysis of rigid and flexible multibody systems Numerical Integration of Equations of Motion Prof. Olivier Verlinden (FPMs) Olivier.Verlinden@fpms.ac.be Prof.

More information

2 C. T. KELLEY, C. T. MILLER AND M. D. TOCCI the two, more frequent recomputation of the approximation to the Jacobian of the corrector equation J, wh

2 C. T. KELLEY, C. T. MILLER AND M. D. TOCCI the two, more frequent recomputation of the approximation to the Jacobian of the corrector equation J, wh TERMINATION OF NEWTON/CHORD ITERATIONS AND THE METHOD OF LINES C. T. KELLEY y, C. T. MILLER z, AND M. D. TOCCI y Abstract. Many ordinary dierential equation and dierential algebraic equation codes terminate

More information

Numerical Analysis MTH603. dy dt = = (0) , y n+1. We obtain yn. Therefore. and. Copyright Virtual University of Pakistan 1

Numerical Analysis MTH603. dy dt = = (0) , y n+1. We obtain yn. Therefore. and. Copyright Virtual University of Pakistan 1 Numerical Analysis MTH60 PREDICTOR CORRECTOR METHOD Te metods presented so far are called single-step metods, were we ave seen tat te computation of y at t n+ tat is y n+ requires te knowledge of y n only.

More information

Preliminary Examination in Numerical Analysis

Preliminary Examination in Numerical Analysis Department of Applied Mathematics Preliminary Examination in Numerical Analysis August 7, 06, 0 am pm. Submit solutions to four (and no more) of the following six problems. Show all your work, and justify

More information

Ordinary differential equations - Initial value problems

Ordinary differential equations - Initial value problems Education has produced a vast population able to read but unable to distinguish what is worth reading. G.M. TREVELYAN Chapter 6 Ordinary differential equations - Initial value problems In this chapter

More information

MTH210 DIFFERENTIAL EQUATIONS. Dr. Gizem SEYHAN ÖZTEPE

MTH210 DIFFERENTIAL EQUATIONS. Dr. Gizem SEYHAN ÖZTEPE MTH210 DIFFERENTIAL EQUATIONS Dr. Gizem SEYHAN ÖZTEPE 1 References Logan, J. David. A first course in differential equations. Springer, 2015. Zill, Dennis G. A first course in differential equations with

More information

Solving PDEs with PGI CUDA Fortran Part 4: Initial value problems for ordinary differential equations

Solving PDEs with PGI CUDA Fortran Part 4: Initial value problems for ordinary differential equations Solving PDEs with PGI CUDA Fortran Part 4: Initial value problems for ordinary differential equations Outline ODEs and initial conditions. Explicit and implicit Euler methods. Runge-Kutta methods. Multistep

More information

UNIVERSITY OF MANITOBA

UNIVERSITY OF MANITOBA Question Points Score INSTRUCTIONS TO STUDENTS: This is a 6 hour examination. No extra time will be given. No texts, notes, or other aids are permitted. There are no calculators, cellphones or electronic

More information

The Milne error estimator for stiff problems

The Milne error estimator for stiff problems 13 R. Tshelametse / SAJPAM. Volume 4 (2009) 13-28 The Milne error estimator for stiff problems Ronald Tshelametse Department of Mathematics University of Botswana Private Bag 0022 Gaborone, Botswana. E-mail

More information

Lecture Notes to Accompany. Scientific Computing An Introductory Survey. by Michael T. Heath. Chapter 9

Lecture Notes to Accompany. Scientific Computing An Introductory Survey. by Michael T. Heath. Chapter 9 Lecture Notes to Accompany Scientific Computing An Introductory Survey Second Edition by Michael T. Heath Chapter 9 Initial Value Problems for Ordinary Differential Equations Copyright c 2001. Reproduction

More information

10.34 Numerical Methods Applied to Chemical Engineering. Quiz 2

10.34 Numerical Methods Applied to Chemical Engineering. Quiz 2 10.34 Numerical Methods Applied to Chemical Engineering Quiz 2 This quiz consists of three problems worth 35, 35, and 30 points respectively. There are 4 pages in this quiz (including this cover page).

More information

COSC 3361 Numerical Analysis I Ordinary Differential Equations (II) - Multistep methods

COSC 3361 Numerical Analysis I Ordinary Differential Equations (II) - Multistep methods COSC 336 Numerical Analysis I Ordinary Differential Equations (II) - Multistep methods Fall 2005 Repetition from the last lecture (I) Initial value problems: dy = f ( t, y) dt y ( a) = y 0 a t b Goal:

More information

Lecture 9 Approximations of Laplace s Equation, Finite Element Method. Mathématiques appliquées (MATH0504-1) B. Dewals, C.

Lecture 9 Approximations of Laplace s Equation, Finite Element Method. Mathématiques appliquées (MATH0504-1) B. Dewals, C. Lecture 9 Approximations of Laplace s Equation, Finite Element Method Mathématiques appliquées (MATH54-1) B. Dewals, C. Geuzaine V1.2 23/11/218 1 Learning objectives of this lecture Apply the finite difference

More information

19.2 Mathematical description of the problem. = f(p; _p; q; _q) G(p; q) T ; (II.19.1) g(p; q) + r(t) _p _q. f(p; v. a p ; q; v q ) + G(p; q) T ; a q

19.2 Mathematical description of the problem. = f(p; _p; q; _q) G(p; q) T ; (II.19.1) g(p; q) + r(t) _p _q. f(p; v. a p ; q; v q ) + G(p; q) T ; a q II-9-9 Slider rank 9. General Information This problem was contributed by Bernd Simeon, March 998. The slider crank shows some typical properties of simulation problems in exible multibody systems, i.e.,

More information

Lecture 8: Calculus and Differential Equations

Lecture 8: Calculus and Differential Equations Lecture 8: Calculus and Differential Equations Dr. Mohammed Hawa Electrical Engineering Department University of Jordan EE201: Computer Applications. See Textbook Chapter 9. Numerical Methods MATLAB provides

More information

Lecture 8: Calculus and Differential Equations

Lecture 8: Calculus and Differential Equations Lecture 8: Calculus and Differential Equations Dr. Mohammed Hawa Electrical Engineering Department University of Jordan EE21: Computer Applications. See Textbook Chapter 9. Numerical Methods MATLAB provides

More information

Lecture 5: Single Step Methods

Lecture 5: Single Step Methods Lecture 5: Single Step Methods J.K. Ryan@tudelft.nl WI3097TU Delft Institute of Applied Mathematics Delft University of Technology 1 October 2012 () Single Step Methods 1 October 2012 1 / 44 Outline 1

More information

Modeling and Experimentation: Compound Pendulum

Modeling and Experimentation: Compound Pendulum Modeling and Experimentation: Compound Pendulum Prof. R.G. Longoria Department of Mechanical Engineering The University of Texas at Austin Fall 2014 Overview This lab focuses on developing a mathematical

More information

CS 450 Numerical Analysis. Chapter 9: Initial Value Problems for Ordinary Differential Equations

CS 450 Numerical Analysis. Chapter 9: Initial Value Problems for Ordinary Differential Equations Lecture slides based on the textbook Scientific Computing: An Introductory Survey by Michael T. Heath, copyright c 2018 by the Society for Industrial and Applied Mathematics. http://www.siam.org/books/cl80

More information

Chapter 5 Exercises. (a) Determine the best possible Lipschitz constant for this function over 2 u <. u (t) = log(u(t)), u(0) = 2.

Chapter 5 Exercises. (a) Determine the best possible Lipschitz constant for this function over 2 u <. u (t) = log(u(t)), u(0) = 2. Chapter 5 Exercises From: Finite Difference Methods for Ordinary and Partial Differential Equations by R. J. LeVeque, SIAM, 2007. http://www.amath.washington.edu/ rjl/fdmbook Exercise 5. (Uniqueness for

More information

Efficient numerical methods for the solution of stiff initial-value problems and differential algebraic equations

Efficient numerical methods for the solution of stiff initial-value problems and differential algebraic equations 10.1098/rspa.2003.1130 R EVIEW PAPER Efficient numerical methods for the solution of stiff initial-value problems and differential algebraic equations By J. R. Cash Department of Mathematics, Imperial

More information

Discontinuous Collocation Methods for DAEs in Mechanics

Discontinuous Collocation Methods for DAEs in Mechanics Discontinuous Collocation Methods for DAEs in Mechanics Scott Small Laurent O. Jay The University of Iowa Iowa City, Iowa, USA July 11, 2011 Outline 1 Introduction of the DAEs 2 SPARK and EMPRK Methods

More information

Final Examination. CS 205A: Mathematical Methods for Robotics, Vision, and Graphics (Fall 2013), Stanford University

Final Examination. CS 205A: Mathematical Methods for Robotics, Vision, and Graphics (Fall 2013), Stanford University Final Examination CS 205A: Mathematical Methods for Robotics, Vision, and Graphics (Fall 2013), Stanford University The exam runs for 3 hours. The exam contains eight problems. You must complete the first

More information

Module 6 : Solving Ordinary Differential Equations - Initial Value Problems (ODE-IVPs) Section 1 : Introduction

Module 6 : Solving Ordinary Differential Equations - Initial Value Problems (ODE-IVPs) Section 1 : Introduction Module 6 : Solving Ordinary Differential Equations - Initial Value Problems (ODE-IVPs) Section 1 : Introduction 1 Introduction In this module, we develop solution techniques for numerically solving ordinary

More information

PLANAR KINETICS OF A RIGID BODY FORCE AND ACCELERATION

PLANAR KINETICS OF A RIGID BODY FORCE AND ACCELERATION PLANAR KINETICS OF A RIGID BODY FORCE AND ACCELERATION I. Moment of Inertia: Since a body has a definite size and shape, an applied nonconcurrent force system may cause the body to both translate and rotate.

More information

Introduction to multiscale modeling and simulation. Explicit methods for ODEs : forward Euler. y n+1 = y n + tf(y n ) dy dt = f(y), y(0) = y 0

Introduction to multiscale modeling and simulation. Explicit methods for ODEs : forward Euler. y n+1 = y n + tf(y n ) dy dt = f(y), y(0) = y 0 Introduction to multiscale modeling and simulation Lecture 5 Numerical methods for ODEs, SDEs and PDEs The need for multiscale methods Two generic frameworks for multiscale computation Explicit methods

More information

Identification methodology for stirred and plug-flow reactors

Identification methodology for stirred and plug-flow reactors Identification methodology for stirred and plug-flow reactors A. Bermúdez, J.L. Ferrín, N. Esteban and J.F. Rodríguez-Calo UMI REPSOL-ITMATI joseluis.ferrin@usc.es November 17, 2016 2016 AIChE Annual Meeting

More information

Solving Ordinary Differential Equations

Solving Ordinary Differential Equations Solving Ordinary Differential Equations Sanzheng Qiao Department of Computing and Software McMaster University March, 2014 Outline 1 Initial Value Problem Euler s Method Runge-Kutta Methods Multistep Methods

More information

The Riccati transformation method for linear two point boundary problems

The Riccati transformation method for linear two point boundary problems Chapter The Riccati transformation method for linear two point boundary problems The solution algorithm for two point boundary value problems to be employed here has been derived from different points

More information

The integrating factor method (Sect. 1.1)

The integrating factor method (Sect. 1.1) The integrating factor method (Sect. 1.1) Overview of differential equations. Linear Ordinary Differential Equations. The integrating factor method. Constant coefficients. The Initial Value Problem. Overview

More information

Non-Differentiable Embedding of Lagrangian structures

Non-Differentiable Embedding of Lagrangian structures Non-Differentiable Embedding of Lagrangian structures Isabelle Greff Joint work with J. Cresson Université de Pau et des Pays de l Adour CNAM, Paris, April, 22nd 2010 Position of the problem 1. Example

More information

Matrix Reduction Techniques for Ordinary Differential Equations in Chemical Systems

Matrix Reduction Techniques for Ordinary Differential Equations in Chemical Systems Matrix Reduction Techniques for Ordinary Differential Equations in Chemical Systems Varad Deshmukh University of California, Santa Barbara April 22, 2013 Contents 1 Introduction 3 2 Chemical Models 3 3

More information

INRIA Rocquencourt, Le Chesnay Cedex (France) y Dept. of Mathematics, North Carolina State University, Raleigh NC USA

INRIA Rocquencourt, Le Chesnay Cedex (France) y Dept. of Mathematics, North Carolina State University, Raleigh NC USA Nonlinear Observer Design using Implicit System Descriptions D. von Wissel, R. Nikoukhah, S. L. Campbell y and F. Delebecque INRIA Rocquencourt, 78 Le Chesnay Cedex (France) y Dept. of Mathematics, North

More information

Defect-based a-posteriori error estimation for implicit ODEs and DAEs

Defect-based a-posteriori error estimation for implicit ODEs and DAEs 1 / 24 Defect-based a-posteriori error estimation for implicit ODEs and DAEs W. Auzinger Institute for Analysis and Scientific Computing Vienna University of Technology Workshop on Innovative Integrators

More information

Ordinary Differential Equations: Initial Value problems (IVP)

Ordinary Differential Equations: Initial Value problems (IVP) Chapter Ordinary Differential Equations: Initial Value problems (IVP) Many engineering applications can be modeled as differential equations (DE) In this book, our emphasis is about how to use computer

More information

Chapter 3 Convolution Representation

Chapter 3 Convolution Representation Chapter 3 Convolution Representation DT Unit-Impulse Response Consider the DT SISO system: xn [ ] System yn [ ] xn [ ] = δ[ n] If the input signal is and the system has no energy at n = 0, the output yn

More information

Name of the Student: Unit I (Solution of Equations and Eigenvalue Problems)

Name of the Student: Unit I (Solution of Equations and Eigenvalue Problems) Engineering Mathematics 8 SUBJECT NAME : Numerical Methods SUBJECT CODE : MA6459 MATERIAL NAME : University Questions REGULATION : R3 UPDATED ON : November 7 (Upto N/D 7 Q.P) (Scan the above Q.R code for

More information

Fast-slow systems with chaotic noise

Fast-slow systems with chaotic noise Fast-slow systems with chaotic noise David Kelly Ian Melbourne Courant Institute New York University New York NY www.dtbkelly.com May 12, 215 Averaging and homogenization workshop, Luminy. Fast-slow systems

More information

Scientific Computing: An Introductory Survey

Scientific Computing: An Introductory Survey Scientific Computing: An Introductory Survey Chapter 9 Initial Value Problems for Ordinary Differential Equations Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign

More information

Chapter 3 Second Order Linear Equations

Chapter 3 Second Order Linear Equations Partial Differential Equations (Math 3303) A Ë@ Õæ Aë áöß @. X. @ 2015-2014 ú GA JË@ É Ë@ Chapter 3 Second Order Linear Equations Second-order partial differential equations for an known function u(x,

More information

Three Body Problem using High-Order Runge-Kutta Interpolation

Three Body Problem using High-Order Runge-Kutta Interpolation Three Body Problem using High-Order Runge-Kutta Interpolation Lawrence Mulholland Contents 1 NAG Library Mark 26 Reverse Communication Runge-Kutta Routines 1 1.1 Reverse Communication.....................

More information

Numerical Methods for Large-Scale Nonlinear Equations

Numerical Methods for Large-Scale Nonlinear Equations Slide 1 Numerical Methods for Large-Scale Nonlinear Equations Homer Walker MA 512 April 28, 2005 Inexact Newton and Newton Krylov Methods a. Newton-iterative and inexact Newton methods. Slide 2 i. Formulation

More information

ENGI9496 Lecture Notes State-Space Equation Generation

ENGI9496 Lecture Notes State-Space Equation Generation ENGI9496 Lecture Notes State-Space Equation Generation. State Equations and Variables - Definitions The end goal of model formulation is to simulate a system s behaviour on a computer. A set of coherent

More information

2tdt 1 y = t2 + C y = which implies C = 1 and the solution is y = 1

2tdt 1 y = t2 + C y = which implies C = 1 and the solution is y = 1 Lectures - Week 11 General First Order ODEs & Numerical Methods for IVPs In general, nonlinear problems are much more difficult to solve than linear ones. Unfortunately many phenomena exhibit nonlinear

More information

ECE257 Numerical Methods and Scientific Computing. Ordinary Differential Equations

ECE257 Numerical Methods and Scientific Computing. Ordinary Differential Equations ECE257 Numerical Methods and Scientific Computing Ordinary Differential Equations Today s s class: Stiffness Multistep Methods Stiff Equations Stiffness occurs in a problem where two or more independent

More information

McGill University Department of Mathematics and Statistics. Ph.D. preliminary examination, PART A. PURE AND APPLIED MATHEMATICS Paper BETA

McGill University Department of Mathematics and Statistics. Ph.D. preliminary examination, PART A. PURE AND APPLIED MATHEMATICS Paper BETA McGill University Department of Mathematics and Statistics Ph.D. preliminary examination, PART A PURE AND APPLIED MATHEMATICS Paper BETA 17 August, 2018 1:00 p.m. - 5:00 p.m. INSTRUCTIONS: (i) This paper

More information

Improving the Verification and Validation Process

Improving the Verification and Validation Process Improving the Verification and Validation Process Mike Fagan Rice University Dave Higdon Los Alamos National Laboratory Notes to Audience I will use the much shorter VnV abbreviation, rather than repeat

More information

Jim Lambers MAT 772 Fall Semester Lecture 21 Notes

Jim Lambers MAT 772 Fall Semester Lecture 21 Notes Jim Lambers MAT 772 Fall Semester 21-11 Lecture 21 Notes These notes correspond to Sections 12.6, 12.7 and 12.8 in the text. Multistep Methods All of the numerical methods that we have developed for solving

More information

Research Article Diagonally Implicit Block Backward Differentiation Formulas for Solving Ordinary Differential Equations

Research Article Diagonally Implicit Block Backward Differentiation Formulas for Solving Ordinary Differential Equations International Mathematics and Mathematical Sciences Volume 212, Article ID 767328, 8 pages doi:1.1155/212/767328 Research Article Diagonally Implicit Block Backward Differentiation Formulas for Solving

More information

Ordinary Differential Equations (ODEs)

Ordinary Differential Equations (ODEs) Chapter 13 Ordinary Differential Equations (ODEs) We briefly review how to solve some of the most standard ODEs. 13.1 First Order Equations 13.1.1 Separable Equations A first-order ordinary differential

More information

Nonlinear Optimization for Optimal Control

Nonlinear Optimization for Optimal Control Nonlinear Optimization for Optimal Control Pieter Abbeel UC Berkeley EECS Many slides and figures adapted from Stephen Boyd [optional] Boyd and Vandenberghe, Convex Optimization, Chapters 9 11 [optional]

More information

Ordinary Differential Equations. Monday, October 10, 11

Ordinary Differential Equations. Monday, October 10, 11 Ordinary Differential Equations Monday, October 10, 11 Problems involving ODEs can always be reduced to a set of first order differential equations. For example, By introducing a new variable z, this can

More information

The DAETS Differential-Algebraic Equation Solver

The DAETS Differential-Algebraic Equation Solver The DAETS Differential-Algebraic Equation Solver John Pryce 1 Ned Nedialkov 2 1 Dept of Information Systems, Cranfield U., UK j.d.pryce@ntlworld.com 2 Dept of Computing and Software, McMaster U., Canada

More information

Numerical Methods for the Solution of Differential Equations

Numerical Methods for the Solution of Differential Equations Numerical Methods for the Solution of Differential Equations Markus Grasmair Vienna, winter term 2011 2012 Analytical Solutions of Ordinary Differential Equations 1. Find the general solution of the differential

More information

10.34: Numerical Methods Applied to Chemical Engineering. Lecture 19: Differential Algebraic Equations

10.34: Numerical Methods Applied to Chemical Engineering. Lecture 19: Differential Algebraic Equations 10.34: Numerical Methods Applied to Chemical Engineering Lecture 19: Differential Algebraic Equations 1 Recap Differential algebraic equations Semi-explicit Fully implicit Simulation via backward difference

More information

Optimal control problems with PDE constraints

Optimal control problems with PDE constraints Optimal control problems with PDE constraints Maya Neytcheva CIM, October 2017 General framework Unconstrained optimization problems min f (q) q x R n (real vector) and f : R n R is a smooth function.

More information

MTH 452/552 Homework 3

MTH 452/552 Homework 3 MTH 452/552 Homework 3 Do either 1 or 2. 1. (40 points) [Use of ode113 and ode45] This problem can be solved by a modifying the m-files odesample.m and odesampletest.m available from the author s webpage.

More information

ENO and WENO schemes. Further topics and time Integration

ENO and WENO schemes. Further topics and time Integration ENO and WENO schemes. Further topics and time Integration Tefa Kaisara CASA Seminar 29 November, 2006 Outline 1 Short review ENO/WENO 2 Further topics Subcell resolution Other building blocks 3 Time Integration

More information

100 CHAPTER 4. SYSTEMS AND ADAPTIVE STEP SIZE METHODS APPENDIX

100 CHAPTER 4. SYSTEMS AND ADAPTIVE STEP SIZE METHODS APPENDIX 100 CHAPTER 4. SYSTEMS AND ADAPTIVE STEP SIZE METHODS APPENDIX.1 Norms If we have an approximate solution at a given point and we want to calculate the absolute error, then we simply take the magnitude

More information

Research Computing with Python, Lecture 7, Numerical Integration and Solving Ordinary Differential Equations

Research Computing with Python, Lecture 7, Numerical Integration and Solving Ordinary Differential Equations Research Computing with Python, Lecture 7, Numerical Integration and Solving Ordinary Differential Equations Ramses van Zon SciNet HPC Consortium November 25, 2014 Ramses van Zon (SciNet HPC Consortium)Research

More information

MATH 308 Differential Equations

MATH 308 Differential Equations MATH 308 Differential Equations Summer, 2014, SET 1 JoungDong Kim Set 1: Section 1.1, 1.2, 1.3, 2.1 Chapter 1. Introduction 1. Why do we study Differential Equation? Many of the principles, or laws, underlying

More information

2. First Order Linear Equations and Bernoulli s Differential Equation

2. First Order Linear Equations and Bernoulli s Differential Equation August 19, 2013 2-1 2. First Order Linear Equations and Bernoulli s Differential Equation First Order Linear Equations A differential equation of the form y + p(t)y = g(t) (1) is called a first order scalar

More information

Sensitivity Analysis of Differential-Algebraic Equations and Partial Differential Equations

Sensitivity Analysis of Differential-Algebraic Equations and Partial Differential Equations Sensitivity Analysis of Differential-Algebraic Equations and Partial Differential Equations Linda Petzold Department of Computer Science University of California Santa Barbara, California 93106 Shengtai

More information

Numerical Analysis Preliminary Exam 10 am to 1 pm, August 20, 2018

Numerical Analysis Preliminary Exam 10 am to 1 pm, August 20, 2018 Numerical Analysis Preliminary Exam 1 am to 1 pm, August 2, 218 Instructions. You have three hours to complete this exam. Submit solutions to four (and no more) of the following six problems. Please start

More information

MATHEMATICAL METHODS INTERPOLATION

MATHEMATICAL METHODS INTERPOLATION MATHEMATICAL METHODS INTERPOLATION I YEAR BTech By Mr Y Prabhaker Reddy Asst Professor of Mathematics Guru Nanak Engineering College Ibrahimpatnam, Hyderabad SYLLABUS OF MATHEMATICAL METHODS (as per JNTU

More information

Introduction to Hamiltonian Monte Carlo Method

Introduction to Hamiltonian Monte Carlo Method Introduction to Hamiltonian Monte Carlo Method Mingwei Tang Department of Statistics University of Washington mingwt@uw.edu November 14, 2017 1 Hamiltonian System Notation: q R d : position vector, p R

More information

1 The pendulum equation

1 The pendulum equation Math 270 Honors ODE I Fall, 2008 Class notes # 5 A longer than usual homework assignment is at the end. The pendulum equation We now come to a particularly important example, the equation for an oscillating

More information

Advanced methods for ODEs and DAEs. Lecture 9: Multistep methods/ Differential algebraic equations

Advanced methods for ODEs and DAEs. Lecture 9: Multistep methods/ Differential algebraic equations Advanced methods for ODEs and DAEs Lecture 9: Multistep methods/ Differential algebraic equations Bojana Rosic, 22. Juni 2016 PART I: MULTISTEP METHODS 22. Juni 2016 Bojana Rosić Advanced methods for ODEs

More information

Fourth Order RK-Method

Fourth Order RK-Method Fourth Order RK-Method The most commonly used method is Runge-Kutta fourth order method. The fourth order RK-method is y i+1 = y i + 1 6 (k 1 + 2k 2 + 2k 3 + k 4 ), Ordinary Differential Equations (ODE)

More information

Modelling Physical Phenomena

Modelling Physical Phenomena Modelling Physical Phenomena Limitations and Challenges of the Differential Algebraic Equations Approach Olaf Trygve Berglihn Department of Chemical Engineering 30. June 2010 2 Outline Background Classification

More information

PARTIAL DIFFERENTIAL EQUATIONS

PARTIAL DIFFERENTIAL EQUATIONS MATHEMATICAL METHODS PARTIAL DIFFERENTIAL EQUATIONS I YEAR B.Tech By Mr. Y. Prabhaker Reddy Asst. Professor of Mathematics Guru Nanak Engineering College Ibrahimpatnam, Hyderabad. SYLLABUS OF MATHEMATICAL

More information

Chapter 8. Numerical Solution of Ordinary Differential Equations. Module No. 2. Predictor-Corrector Methods

Chapter 8. Numerical Solution of Ordinary Differential Equations. Module No. 2. Predictor-Corrector Methods Numerical Analysis by Dr. Anita Pal Assistant Professor Department of Matematics National Institute of Tecnology Durgapur Durgapur-7109 email: anita.buie@gmail.com 1 . Capter 8 Numerical Solution of Ordinary

More information

Ordinary Differential Equations

Ordinary Differential Equations Ordinary Differential Equations Swaroop Nandan Bora swaroop@iitg.ernet.in Department of Mathematics Indian Institute of Technology Guwahati Guwahati-781039 Modelling a situation We study a model, a sort

More information

PowerPoints organized by Dr. Michael R. Gustafson II, Duke University

PowerPoints organized by Dr. Michael R. Gustafson II, Duke University Part 6 Chapter 20 Initial-Value Problems PowerPoints organized by Dr. Michael R. Gustafson II, Duke University All images copyright The McGraw-Hill Companies, Inc. Permission required for reproduction

More information

How to simulate in Simulink: DAE, DAE-EKF, MPC & MHE

How to simulate in Simulink: DAE, DAE-EKF, MPC & MHE How to simulate in Simulink: DAE, DAE-EKF, MPC & MHE Tamal Das PhD Candidate IKP, NTNU 24th May 2017 Outline 1 Differential algebraic equations (DAE) 2 Extended Kalman filter (EKF) for DAE 3 Moving horizon

More information

Numerical Methods - Initial Value Problems for ODEs

Numerical Methods - Initial Value Problems for ODEs Numerical Methods - Initial Value Problems for ODEs Y. K. Goh Universiti Tunku Abdul Rahman 2013 Y. K. Goh (UTAR) Numerical Methods - Initial Value Problems for ODEs 2013 1 / 43 Outline 1 Initial Value

More information

Math 2a Prac Lectures on Differential Equations

Math 2a Prac Lectures on Differential Equations Math 2a Prac Lectures on Differential Equations Prof. Dinakar Ramakrishnan 272 Sloan, 253-37 Caltech Office Hours: Fridays 4 5 PM Based on notes taken in class by Stephanie Laga, with a few added comments

More information

ETNA Kent State University

ETNA Kent State University Electronic Transactions on Numerical Analysis. Volume 34, pp. 14-19, 2008. Copyrigt 2008,. ISSN 1068-9613. ETNA A NOTE ON NUMERICALLY CONSISTENT INITIAL VALUES FOR HIGH INDEX DIFFERENTIAL-ALGEBRAIC EQUATIONS

More information

MATH 312 Section 2.4: Exact Differential Equations

MATH 312 Section 2.4: Exact Differential Equations MATH 312 Section 2.4: Exact Differential Equations Prof. Jonathan Duncan Walla Walla College Spring Quarter, 2007 Outline 1 Exact Differential Equations 2 Solving an Exact DE 3 Making a DE Exact 4 Conclusion

More information

Numerical solution of ODEs

Numerical solution of ODEs Numerical solution of ODEs Arne Morten Kvarving Department of Mathematical Sciences Norwegian University of Science and Technology November 5 2007 Problem and solution strategy We want to find an approximation

More information

Chapter 1: Introduction

Chapter 1: Introduction Chapter 1: Introduction Definition: A differential equation is an equation involving the derivative of a function. If the function depends on a single variable, then only ordinary derivatives appear and

More information

Separable Differential Equations

Separable Differential Equations Separable Differential Equations MATH 6 Calculus I J. Robert Buchanan Department of Mathematics Fall 207 Background We have previously solved differential equations of the forms: y (t) = k y(t) (exponential

More information

Lecture Notes for Math 251: ODE and PDE. Lecture 30: 10.1 Two-Point Boundary Value Problems

Lecture Notes for Math 251: ODE and PDE. Lecture 30: 10.1 Two-Point Boundary Value Problems Lecture Notes for Math 251: ODE and PDE. Lecture 30: 10.1 Two-Point Boundary Value Problems Shawn D. Ryan Spring 2012 Last Time: We finished Chapter 9: Nonlinear Differential Equations and Stability. Now

More information

ONE-STEP 4-STAGE HERMITE-BIRKHOFF-TAYLOR DAE SOLVER OF ORDER 12

ONE-STEP 4-STAGE HERMITE-BIRKHOFF-TAYLOR DAE SOLVER OF ORDER 12 CANADIAN APPLIED MATHEMATICS QUARTERLY Volume 16, Number 4, Winter 2008 ONE-STEP 4-STAGE HERMITE-BIRKHOFF-TAYLOR DAE SOLVER OF ORDER 12 TRUONG NGUYEN-BA, HAN HAO, HEMZA YAGOUB AND RÉMI VAILLANCOURT ABSTRACT.

More information

Finite Differences for Differential Equations 28 PART II. Finite Difference Methods for Differential Equations

Finite Differences for Differential Equations 28 PART II. Finite Difference Methods for Differential Equations Finite Differences for Differential Equations 28 PART II Finite Difference Methods for Differential Equations Finite Differences for Differential Equations 29 BOUNDARY VALUE PROBLEMS (I) Solving a TWO

More information

ENGI 3424 First Order ODEs Page 1-01

ENGI 3424 First Order ODEs Page 1-01 ENGI 344 First Order ODEs Page 1-01 1. Ordinary Differential Equations Equations involving only one independent variable and one or more dependent variables, together with their derivatives with respect

More information