Numerical Algorithms for ODEs/DAEs (Transient Analysis)
|
|
- Noel Norman
- 6 years ago
- Views:
Transcription
1 Numerical Algorithms for ODEs/DAEs (Transient Analysis) Slide 1
2 Solving Differential Equation Systems d q ( x(t)) + f (x(t)) + b(t) = 0 dt DAEs: many types of solutions useful DC steady state: state no time variations transient: ckt. waveforms changing with time transient periodic steady state: changes periodic w time linear(ized): all sinusoidal waveforms: AC analysis nonlinear steady state: shooting, shooting harmonic balance noise analysis: analysis random/stochastic waveforms sensitivity analysis: analysis effects of changes in circuit parameters Slide 2
3 Transient Analysis d q ( x(t)) + f (x(t)) + b(t) = 0 dt What inputs b(t) changing with time Why find waveforms of x(t) as they change with time most general analysis typically needed sine wave, pulse, etc. inputs typical in many applications How solve DAE using numerical methods discretize time : replace d/dt term convert DAE to nonlinear algebraic equation at each discrete time point solve this using NR Slide 3
4 Solving DAEs: Preliminaries Given a DAE: does it have a solution? Depends. Various conditions need to hold. Easier to analyze if DAEs are really ODEs Ordinary Differential Equations: i.e., q ( x) x d d x(t) + f ( x(t)) + b(t) = 0 ) x(t) = g ( x; t) dt dt Existence/Uniqueness conditions well known for ODEs f(x) needs to be Lipschitz device models must be smooth / bounded / physically reasonable watch those if conditions, 1/x, log(x), sqrt(x), etc. terms! DAEs? Much more involved in practice: modifications of ODE methods + heuristics Slide 4
5 Analytical Exemplar (Model Problem) k1 A B k2 de e C = I(t) dt R d[a] = (k1 + k2 )[A] + k2 dt x_ = x + b(t) Useful because has analytical solution vector linear systems reducible to this form locally approximates nonlinear systems Prototype for stability analysis of ODE solution methods Slide 5
6 Existence and Uniqueness Does a solution exist? Examples: x_ = x + b(t) yes: x(t) = x(t0 )e (t t0 ) + Z t e (t ) b( ) d 0 1 x_ = ; 2x q Solution is unique, given an initial condition x(t) = 3 13 x_ = x 2 ( x(0) = x0 x20 t : no solution for t > x20 0; 3 (t k) 2 ; 0 <= t <= k, for ANY k > 0! t>k x(t) = Infinite number of solutions! Slide 6
7 Existence/Uniqueness Theorem Picard-Lindelöf Theorem (roughly) If g (x; t) is defined over all t, x Lipschitz for all x then x_ (t) = g (x; t) ; global solution x(t0 ) = x0 has a unique g (x; t) is Lipschitz if there exists some finite L such that: kg ( x1 ; t) g ( x2 ; t) k < Lk x1 x2 k; 8 x1 ; x2 Slide 7
8 The Lipschitz Condition Linear systems: Lipschitz p 3 x, 1 : not Lipschitz x x0 Slide 8
9 Is this globally Lipschitz? e1 (t) e2 (t) ie (t) n1 KCL: ie + d(e1 e2 ) = 0 e2 d n2 KCL: d(e1 e2 ) + + (Ce2 ) = 0 R dt E BCR: e1 E = 0 d e2 d(e(t) e2 ) n2 KCL: e2 + =0 dt RC C Slide 9
10 Solving ODEs: Overview of Strategy Discretize the time axis (starting from, e.g., t=0) Approximate d/dt term by finite difference t0 = 0; t1 ; t2 ; ; tn d x xi xi 1 ' e.g., dt ti ti 1 ODE becomes algebraic nonlinear equation xi xi 1 + f ( xi ) + b(ti ) = 0 ti ti 1 {z } hi ( xi ) Solve using Newton-Raphson repeat for i=1,2,3,...,n using previous solution (or initial condition) at ti-1 Key issues: how to discretize? errors/accuracy? computation? coding? Slide 10
11 Piecewise Polynomial Approximation Using locally polynomial bases assume: ODE solution is locally polynomial characterize polynomial with a few numbers e.g., samples at different points find those numbers so that the local polynomial satisfies the ODE x(t) ' x1 + c1 (t t1 ) + c2 (t t1 )2 ; x(t) ' x1 + x2 x1 (t t1 ); t2 t1 t 2 [t1 ; t2 ] t 2 [t1 ; t2 ] Slide 11
12 Linear Polynomials: FE and BE Use of locally linear approximations for x(t) x2 x1 x(t) ' x1 + (t t1 ); t2 t1 Knowns: t1, t2, x1 (x1 known from, e.g., initial condition) Unknown: x2 x2 x1 Use linear approx. to express x(t) : x(t) ' t2 t1 Enforce ODE x_ (t) = g (x; t) at t : Forward Euler (FE) 1 t 2 [t1 ; t2 ] x2 x1 _ x(t1 ) = g ( x1 ; t1 ) : = g ( x1 ; t1 ) t2 t1 Enforce ODE x_ (t) = g (x; t) at t2: Backward Euler (BE) x2 x1 _ x(t1 ) = g (x2 ; t2 ) : = g ( x2 ; t2 ) t2 t1 Slide 12
13 The Forward Euler Method xi xi 1 x_ (ti 1 ) = g ( xi 1 ; ti 1 ) : = g ( xi 1 ; ti 1 ) ti ti 1 ) xi = xi 1 + (ti ti 1 )g (xi 1 ; ti 1 ) Explicit integration method x2 available explicitly in terms of knowns nonlinear solve not needed (single eval of g(.,.) suffices) (we'll see later) not numerically stable (we'll see later) does not work for DAEs Time stepping ODE solution process 1) start with initial condition: x0 = x(t0), i=1 2) find xi using FE equation, above 3) increment i; stop if ti>stoptime, else goto 2 Slide 13
14 The Backward Euler Method xi xi 1 xi xi 1 g ( xi ; ti ) = 0 x_ (ti ) = g ( xi ; ti ) : = g ( x i ; ti ) ) ti ti 1 ti ti 1 Implicit integration method Finding x2 requires nonlinear solution (N-R) (we'll see later) numerically (over)stable (we'll see later) does work for DAEs Time stepping ODE solution process 1) start with initial condition: x0 = x(t0), i=1 2) find xi using BE equation, above solve it using Newton-Raphson 3) increment i; stop if ti>stoptime, else goto 2 Slide 14
15 The Trapezoidal Method Average FE and BE: + x_ (t1 ) = g ( x1 ; t1 ) x_ (t2 ) = g ( x2 ; t2 ) x_ (t1 ) + x_ (t2 ) g ( x1 ; t1 ) + g (x2 ; t2 ) = 2 2 PWL assumption x2 x1 ) x(t1 ) = x(t2 ) = t2 t1 Trapezoidal Method: Method at ith timestep: x2 x1 g ( x1 ; t1 ) + g ( x2 ; t2 ) = t2 t1 2 Implicit (N-R needed) xi xi 1 g (xi 1 ; ti 1 ) + g ( xi ; ti ) = ti ti 1 2 Perfectly stable numerically (we'll see later) Slide 15
16 FE, BE, TRAP: Pictorial Summary Difference: where/how ODE is enforced Slide 16
17 Linear Multi Step (LMS) Methods FE: xi xi 1 = hi g (xi 1 ; ti 1 ) ; BE: xi xi 1 = hi g ( xi ; ti ) hi ti ti 1 : g ( xi ; ti ) + g (xi 1 ; ti 1 ) TRAP: xi xi 1 = hi 2 Generic: 0 xi + 1 xi 1 = 0g (xi ; ti ) + 1g (xi 1 ; ti 1 ) FE: 0 = 1; 1 = 1; 0 = 0; 1 = hi BE: 0 = 1; 1 = 1; 0 = hi ; 1 = 0 hi hi TRAP: 0 = 1; 1 = 1; 0 = ; 1 = 2 2 pth-order Linear Multi Step integration formula p X i xn i = i=0 p X i g ( xn i ; tn i ) i=0 Slide 17
18 Use of ODE LMS Methods for DAEs d d q ( x(t)) + f (x(t)) + b(t) = 0 ) q ( x(t)) = g( x; t) dt dt The (simple) idea: re-do all derivations with q (t) q ( x(t)) on LHS, instead of x(t). Generic LMS for p=1 (1-step LMS): 0 q (xi ) + 1 q ( xi 1 ) = 0g (xi ; ti ) + 1g ( xi 1 ; ti 1 ) q ( xi ) q (xi 1 ) = hi g ( xi ; ti ) BE: Implicit (N-R needed) g ( xi ; ti ) + g ( xi 1 ; ti 1 ) q ( xi ) q ( xi 1 ) = hi TRAP: 2 q ( xi ) q ( xi 1 ) = hi g ( xi 1 ; ti 1 ) : FE: Implicit? Slide 18
19 Stability of LMS Methods Test ODE: x(0) = x0 : exact solution: x(t) = x0 e t : x(t) _ = x(t); solution decays if < 0: What do FE/BE/TRAP produce? FE is qualitatitively wrong Slide 19
20 Why FE Explodes FE (with constant timestep h) xn = (1 + h )xn 1 ) xn = x0 (1 + h )n : if j1 + h j > 1, solution blows up w.r.t n. solution is qualitatively wrong for < 0: Basic requirement for FE h should be small enough s.t. j1 + h j < 1: Example: = 109 ) h < : FE limited to small timesteps for even qualitatitive accuracy FE said to be (numerically) unstable if j1 + h j > 1 Slide 20
21 FE: Stability Picture for Complex In general: eigenvalues can be complex stability condition j1 + h j < 1 : circle in h plane Region of stability Slide 21
22 Stability of BE BE with constant timestep h xn (1 h ) = xn 1 solution will die down if j1 h j > 1: i.e., all of left half plane. but also much of right half plane BE is overstable 1 ) xn = x0 : n (1 h ) OK only within circle Applications more important much better than FE Slide 22
23 Stability of TRAP TRAP with constant timestep h µ µ µ n h h 2 + h xn 1 = xn ) xn = x0 : h solution will die down if Re( ) < 0 solution will blow up if Re( ) > 0 Also very accurate i.e, perfect stability (we'll see later) Only concern DAE initial consistency (we'll see later) (easy practical workaround) Slide 23
24 Accuracy and Truncation Error Even if stable: is the method accurate? Test problem exact solution: x(nh) = x0 e nh : How do numerical method solutions compare? FE: x(nh) ' x0 (1 + h )n : 1 : n (1 h ) µ n 2 + h TRAP: x(nh) ' x0 2 h : BE: x(nh) ' x0 None are identical, but how different? Slide 24
25 Taylor Expansion Error Exact: x(nh) = x0 e nh µ n h = x0 1 + nh + + 2! µ n(n 1) 2 2 FE: x(nh) ' x h nh + 2 first-order accurate µ n(n + 1) 2 2 BE: x(nh) ' x h nh + 2 also first-order accurate µ 2 n 2 2 TRAP: x(nh) ' x h nh + 2 second-order accurate Slide 25
26 Transient: Timestep Control Choosing the next timestep dynamically LTE based control apply LTE formulae to estimate error error specification: like reltol-abstol (reltol=percentage) make sure these are looser than NR tolerances! element-by-element vs vector norm based change timestep to meet some specified error 2-norm vs max norm; DAE issues (change integration method based on timestep) NR convergence based control cut timestep if NR does not converge also: increase maxiter increase timestep if NR converges too easily also: decrease maxiter Slide 26
27 ODE/DAE Packages Out There MATLAB has various ODE/DAE integrators DASSL/DASPK: general purpose DAE packages ode23, ode45,...; ode23t, ode15s,... Linda Petzold, UCSB Fortran some tweaking helpful for circuit applications Easy (and often worthwhile) to roll your own tweaking, special heuristics, debugging,... Slide 27
28 Transient: Other Important Issues What integration method to use? stability? nonlinear solution required? (implicit vs explicit) accuracy loss due to discretization? Vast body of work on ODE integration linear multi-step methods (LMS), Runge-Kutta, symmetric, symplectic, energy-conserving, etc. Stiff differential equations different variables have very different time constants stiffly stable methods allow you to take larger time steps DAE issues Local Truncation Error (LTE) higher order methods (more than 1 previous timepoint) initial condition consistency; stability; index; Dynamic timestep control, NR heuristics,... Slide 28
29 Solving the Circuit's Equations d q ( x(t)) + f (x(t)) + b(t) = 0 dt Ckt. DAEs: many types of solutions useful DC steady state: state no time variations transient: transient ckt. waveforms changing with time periodic steady state: changes periodic w time linear(ized): all sinusoidal waveforms: AC analysis nonlinear steady state: shooting, shooting harmonic balance noise analysis: analysis random/stochastic waveforms sensitivity analysis: analysis effects of changes in circuit parameters Slide 29
30 The Periodic Steady State Problem d q ( x(t)) + f (x(t)) + b(t) = 0 dt What inputs b(t) are periodic e.g., sinusoidal suppose outputs x(t) also become periodic (happens for stable circuits and systems... eventually can take a long time) want to find this periodic steady state directly without using general/expensive transient analysis Why audio amps, RF amps, mixers, oscillators, clocks,... linear circuits: frequency-domain analysis important ckt nonlinear => sinusoids will in general be distorted much easier and more insightful than transient How (for linear circuits): AC analysis Slide 30
Quiescent Steady State (DC) Analysis The Newton-Raphson Method
Quiescent Steady State (DC) Analysis The Newton-Raphson Method J. Roychowdhury, University of California at Berkeley Slide 1 Solving the System's DAEs DAEs: many types of solutions useful DC steady state:
More informationOrdinary Differential Equations
Ordinary Differential Equations We call Ordinary Differential Equation (ODE) of nth order in the variable x, a relation of the kind: where L is an operator. If it is a linear operator, we call the equation
More informationNUMERICAL SOLUTION OF ODE IVPs. Overview
NUMERICAL SOLUTION OF ODE IVPs 1 Quick review of direction fields Overview 2 A reminder about and 3 Important test: Is the ODE initial value problem? 4 Fundamental concepts: Euler s Method 5 Fundamental
More informationCHAPTER 10: Numerical Methods for DAEs
CHAPTER 10: Numerical Methods for DAEs Numerical approaches for the solution of DAEs divide roughly into two classes: 1. direct discretization 2. reformulation (index reduction) plus discretization Direct
More informationConsistency and Convergence
Jim Lambers MAT 77 Fall Semester 010-11 Lecture 0 Notes These notes correspond to Sections 1.3, 1.4 and 1.5 in the text. Consistency and Convergence We have learned that the numerical solution obtained
More informationChapter 5 Exercises. (a) Determine the best possible Lipschitz constant for this function over 2 u <. u (t) = log(u(t)), u(0) = 2.
Chapter 5 Exercises From: Finite Difference Methods for Ordinary and Partial Differential Equations by R. J. LeVeque, SIAM, 2007. http://www.amath.washington.edu/ rjl/fdmbook Exercise 5. (Uniqueness for
More informationOrdinary Differential Equations
CHAPTER 8 Ordinary Differential Equations 8.1. Introduction My section 8.1 will cover the material in sections 8.1 and 8.2 in the book. Read the book sections on your own. I don t like the order of things
More informationRunge-Kutta Theory and Constraint Programming Julien Alexandre dit Sandretto Alexandre Chapoutot. Department U2IS ENSTA ParisTech SCAN Uppsala
Runge-Kutta Theory and Constraint Programming Julien Alexandre dit Sandretto Alexandre Chapoutot Department U2IS ENSTA ParisTech SCAN 2016 - Uppsala Contents Numerical integration Runge-Kutta with interval
More informationECE 422/522 Power System Operations & Planning/Power Systems Analysis II : 7 - Transient Stability
ECE 4/5 Power System Operations & Planning/Power Systems Analysis II : 7 - Transient Stability Spring 014 Instructor: Kai Sun 1 Transient Stability The ability of the power system to maintain synchronism
More informationChapter 11 ORDINARY DIFFERENTIAL EQUATIONS
Chapter 11 ORDINARY DIFFERENTIAL EQUATIONS The general form of a first order differential equations is = f(x, y) with initial condition y(a) = y a We seek the solution y = y(x) for x > a This is shown
More informationNumerical Methods for Engineers. and Scientists. Applications using MATLAB. An Introduction with. Vish- Subramaniam. Third Edition. Amos Gilat.
Numerical Methods for Engineers An Introduction with and Scientists Applications using MATLAB Third Edition Amos Gilat Vish- Subramaniam Department of Mechanical Engineering The Ohio State University Wiley
More informationComputing Phase Noise Eigenfunctions Directly from Steady-State Jacobian Matrices
Computing Phase Noise Eigenfunctions Directly from Steady-State Jacobian Matrices Alper Demir David Long Jaijeet Roychowdhury Bell Laboratories Murray Hill New Jersey USA Abstract The main effort in oscillator
More informationChapter 9 Implicit Methods for Linear and Nonlinear Systems of ODEs
Chapter 9 Implicit Methods for Linear and Nonlinear Systems of ODEs In the previous chapter, we investigated stiffness in ODEs. Recall that an ODE is stiff if it exhibits behavior on widelyvarying timescales.
More informationLecture 4: Numerical solution of ordinary differential equations
Lecture 4: Numerical solution of ordinary differential equations Department of Mathematics, ETH Zürich General explicit one-step method: Consistency; Stability; Convergence. High-order methods: Taylor
More informationDifferential Equations
Differential Equations Overview of differential equation! Initial value problem! Explicit numeric methods! Implicit numeric methods! Modular implementation Physics-based simulation An algorithm that
More informationDifferential Equations
Pysics-based simulation xi Differential Equations xi+1 xi xi+1 xi + x x Pysics-based simulation xi Wat is a differential equation? Differential equations describe te relation between an unknown function
More informationDefect-based a-posteriori error estimation for implicit ODEs and DAEs
1 / 24 Defect-based a-posteriori error estimation for implicit ODEs and DAEs W. Auzinger Institute for Analysis and Scientific Computing Vienna University of Technology Workshop on Innovative Integrators
More informationPreliminary Examination in Numerical Analysis
Department of Applied Mathematics Preliminary Examination in Numerical Analysis August 7, 06, 0 am pm. Submit solutions to four (and no more) of the following six problems. Show all your work, and justify
More informationEuler s Method applied to the control of switched systems
Euler s Method applied to the control of switched systems FORMATS 2017 - Berlin Laurent Fribourg 1 September 6, 2017 1 LSV - CNRS & ENS Cachan L. Fribourg Euler s method and switched systems September
More informationCS 450 Numerical Analysis. Chapter 9: Initial Value Problems for Ordinary Differential Equations
Lecture slides based on the textbook Scientific Computing: An Introductory Survey by Michael T. Heath, copyright c 2018 by the Society for Industrial and Applied Mathematics. http://www.siam.org/books/cl80
More informationSolving PDEs with PGI CUDA Fortran Part 4: Initial value problems for ordinary differential equations
Solving PDEs with PGI CUDA Fortran Part 4: Initial value problems for ordinary differential equations Outline ODEs and initial conditions. Explicit and implicit Euler methods. Runge-Kutta methods. Multistep
More informationLecture Notes to Accompany. Scientific Computing An Introductory Survey. by Michael T. Heath. Chapter 9
Lecture Notes to Accompany Scientific Computing An Introductory Survey Second Edition by Michael T. Heath Chapter 9 Initial Value Problems for Ordinary Differential Equations Copyright c 2001. Reproduction
More information1 Ordinary Differential Equations
Ordinary Differential Equations.0 Mathematical Background.0. Smoothness Definition. A function f defined on [a, b] is continuous at ξ [a, b] if lim x ξ f(x) = f(ξ). Remark Note that this implies existence
More informationAM205: Assignment 3 (due 5 PM, October 20)
AM25: Assignment 3 (due 5 PM, October 2) For this assignment, first complete problems 1, 2, 3, and 4, and then complete either problem 5 (on theory) or problem 6 (on an application). If you submit answers
More informationMethods for Computing Periodic Steady-State Jacob White
Introduction to Simulation - Lecture 15 Methods for Computing Periodic Steady-State Jacob White Thanks to Deepak Ramaswamy, Michal Rewienski, and Karen Veroy Outline Periodic Steady-state problems Application
More informationSolving Ordinary Differential Equations
Solving Ordinary Differential Equations Sanzheng Qiao Department of Computing and Software McMaster University March, 2014 Outline 1 Initial Value Problem Euler s Method Runge-Kutta Methods Multistep Methods
More informationScientific Computing: An Introductory Survey
Scientific Computing: An Introductory Survey Chapter 9 Initial Value Problems for Ordinary Differential Equations Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign
More informationNumerical Methods for Engineers
Numerical Methods for Engineers SEVENTH EDITION Steven C Chopra Berger Chair in Computing and Engineering Tufts University Raymond P. Canal Professor Emeritus of Civil Engineering of Michiaan University
More informationMath 660 Lecture 4: FDM for evolutionary equations: ODE solvers
Math 660 Lecture 4: FDM for evolutionary equations: ODE solvers Consider the ODE u (t) = f(t, u(t)), u(0) = u 0, where u could be a vector valued function. Any ODE can be reduced to a first order system,
More informationAdvanced Computational Methods for VLSI Systems. Lecture 4 RF Circuit Simulation Methods. Zhuo Feng
Advanced Computational Methods for VLSI Systems Lecture 4 RF Circuit Simulation Methods Zhuo Feng 6. Z. Feng MTU EE59 Neither ac analysis nor pole / zero analysis allow nonlinearities Harmonic balance
More informationNumerical Methods for ODEs. Lectures for PSU Summer Programs Xiantao Li
Numerical Methods for ODEs Lectures for PSU Summer Programs Xiantao Li Outline Introduction Some Challenges Numerical methods for ODEs Stiff ODEs Accuracy Constrained dynamics Stability Coarse-graining
More informationModeling & Simulation 2018 Lecture 12. Simulations
Modeling & Simulation 2018 Lecture 12. Simulations Claudio Altafini Automatic Control, ISY Linköping University, Sweden Summary of lecture 7-11 1 / 32 Models of complex systems physical interconnections,
More informationCS520: numerical ODEs (Ch.2)
.. CS520: numerical ODEs (Ch.2) Uri Ascher Department of Computer Science University of British Columbia ascher@cs.ubc.ca people.cs.ubc.ca/ ascher/520.html Uri Ascher (UBC) CPSC 520: ODEs (Ch. 2) Fall
More informationFinite Difference and Finite Element Methods
Finite Difference and Finite Element Methods Georgy Gimel farb COMPSCI 369 Computational Science 1 / 39 1 Finite Differences Difference Equations 3 Finite Difference Methods: Euler FDMs 4 Finite Element
More informationOn linear and non-linear equations. (Sect. 1.6).
On linear and non-linear equations. (Sect. 1.6). Review: Linear differential equations. Non-linear differential equations. The Picard-Lindelöf Theorem. Properties of solutions to non-linear ODE. The Proof
More informationSolving Ordinary Differential equations
Solving Ordinary Differential equations Taylor methods can be used to build explicit methods with higher order of convergence than Euler s method. The main difficult of these methods is the computation
More information10.34 Numerical Methods Applied to Chemical Engineering. Quiz 2
10.34 Numerical Methods Applied to Chemical Engineering Quiz 2 This quiz consists of three problems worth 35, 35, and 30 points respectively. There are 4 pages in this quiz (including this cover page).
More informationOrdinary Differential Equations
Ordinary Differential Equations Professor Dr. E F Toro Laboratory of Applied Mathematics University of Trento, Italy eleuterio.toro@unitn.it http://www.ing.unitn.it/toro September 19, 2014 1 / 55 Motivation
More informationReview for Exam 2 Ben Wang and Mark Styczynski
Review for Exam Ben Wang and Mark Styczynski This is a rough approximation of what we went over in the review session. This is actually more detailed in portions than what we went over. Also, please note
More informationStability regions of Runge-Kutta methods. Stephan Houben Eindhoven University of Technology
Stability regions of Runge-Kutta methods Stephan Houben Eindhoven University of Technology February 19, 2002 1 Overview of the talk 1. Quick review of some concepts 2. Stability regions 3. L-stability
More informationEfficient Simulation of Physical System Models Using Inlined Implicit Runge Kutta Algorithms
Efficient Simulation of Physical System Models Using Inlined Implicit Runge Kutta Algorithms by Vicha Treeaporn A Thesis Submitted to the Faculty of the Department of Electrical and Computer Engineering
More informationInitial value problems for ordinary differential equations
AMSC/CMSC 660 Scientific Computing I Fall 2008 UNIT 5: Numerical Solution of Ordinary Differential Equations Part 1 Dianne P. O Leary c 2008 The Plan Initial value problems (ivps) for ordinary differential
More informationEuler s Method, Taylor Series Method, Runge Kutta Methods, Multi-Step Methods and Stability.
Euler s Method, Taylor Series Method, Runge Kutta Methods, Multi-Step Methods and Stability. REVIEW: We start with the differential equation dy(t) dt = f (t, y(t)) (1.1) y(0) = y 0 This equation can be
More informationMath 411 Preliminaries
Math 411 Preliminaries Provide a list of preliminary vocabulary and concepts Preliminary Basic Netwon's method, Taylor series expansion (for single and multiple variables), Eigenvalue, Eigenvector, Vector
More informationECE257 Numerical Methods and Scientific Computing. Ordinary Differential Equations
ECE257 Numerical Methods and Scientific Computing Ordinary Differential Equations Today s s class: Stiffness Multistep Methods Stiff Equations Stiffness occurs in a problem where two or more independent
More informationNUMERICAL METHODS FOR ENGINEERING APPLICATION
NUMERICAL METHODS FOR ENGINEERING APPLICATION Second Edition JOEL H. FERZIGER A Wiley-Interscience Publication JOHN WILEY & SONS, INC. New York / Chichester / Weinheim / Brisbane / Singapore / Toronto
More informationKINGS COLLEGE OF ENGINEERING DEPARTMENT OF MATHEMATICS ACADEMIC YEAR / EVEN SEMESTER QUESTION BANK
KINGS COLLEGE OF ENGINEERING MA5-NUMERICAL METHODS DEPARTMENT OF MATHEMATICS ACADEMIC YEAR 00-0 / EVEN SEMESTER QUESTION BANK SUBJECT NAME: NUMERICAL METHODS YEAR/SEM: II / IV UNIT - I SOLUTION OF EQUATIONS
More informationThe family of Runge Kutta methods with two intermediate evaluations is defined by
AM 205: lecture 13 Last time: Numerical solution of ordinary differential equations Today: Additional ODE methods, boundary value problems Thursday s lecture will be given by Thomas Fai Assignment 3 will
More information10.34: Numerical Methods Applied to Chemical Engineering. Lecture 19: Differential Algebraic Equations
10.34: Numerical Methods Applied to Chemical Engineering Lecture 19: Differential Algebraic Equations 1 Recap Differential algebraic equations Semi-explicit Fully implicit Simulation via backward difference
More informationOrdinary Differential Equations II
Ordinary Differential Equations II CS 205A: Mathematical Methods for Robotics, Vision, and Graphics Justin Solomon CS 205A: Mathematical Methods Ordinary Differential Equations II 1 / 29 Almost Done! No
More informationOrdinary Differential Equations I
Ordinary Differential Equations I CS 205A: Mathematical Methods for Robotics, Vision, and Graphics Justin Solomon CS 205A: Mathematical Methods Ordinary Differential Equations I 1 / 27 Theme of Last Three
More informationCHAPTER 5: Linear Multistep Methods
CHAPTER 5: Linear Multistep Methods Multistep: use information from many steps Higher order possible with fewer function evaluations than with RK. Convenient error estimates. Changing stepsize or order
More informationOrdinary Differential Equations (ODEs)
Ordinary Differential Equations (ODEs) 1 Computer Simulations Why is computation becoming so important in physics? One reason is that most of our analytical tools such as differential calculus are best
More informationOrdinary Differential Equations
Ordinary Differential Equations In this lecture, we will look at different options for coding simple differential equations. Start by considering bicycle riding as an example. Why does a bicycle move forward?
More informationOrdinary Differential Equations II
Ordinary Differential Equations II CS 205A: Mathematical Methods for Robotics, Vision, and Graphics Justin Solomon CS 205A: Mathematical Methods Ordinary Differential Equations II 1 / 33 Almost Done! Last
More informationApplied Math for Engineers
Applied Math for Engineers Ming Zhong Lecture 15 March 28, 2018 Ming Zhong (JHU) AMS Spring 2018 1 / 28 Recap Table of Contents 1 Recap 2 Numerical ODEs: Single Step Methods 3 Multistep Methods 4 Method
More informationOrdinary differential equations - Initial value problems
Education has produced a vast population able to read but unable to distinguish what is worth reading. G.M. TREVELYAN Chapter 6 Ordinary differential equations - Initial value problems In this chapter
More informationScientific Computing with Case Studies SIAM Press, Lecture Notes for Unit V Solution of
Scientific Computing with Case Studies SIAM Press, 2009 http://www.cs.umd.edu/users/oleary/sccswebpage Lecture Notes for Unit V Solution of Differential Equations Part 1 Dianne P. O Leary c 2008 1 The
More informationIdentification Methods for Structural Systems. Prof. Dr. Eleni Chatzi Lecture March, 2016
Prof. Dr. Eleni Chatzi Lecture 4-09. March, 2016 Fundamentals Overview Multiple DOF Systems State-space Formulation Eigenvalue Analysis The Mode Superposition Method The effect of Damping on Structural
More informationThe Chemical Kinetics Time Step a detailed lecture. Andrew Conley ACOM Division
The Chemical Kinetics Time Step a detailed lecture Andrew Conley ACOM Division Simulation Time Step Deep convection Shallow convection Stratiform tend (sedimentation, detrain, cloud fraction, microphysics)
More informationValidated Explicit and Implicit Runge-Kutta Methods
Validated Explicit and Implicit Runge-Kutta Methods Alexandre Chapoutot joint work with Julien Alexandre dit Sandretto and Olivier Mullier U2IS, ENSTA ParisTech 8th Small Workshop on Interval Methods,
More informationAchieving Accurate Results With a Circuit Simulator. Ken Kundert and Ian Clifford Cadence Design Systems Analog Division San Jose, Calif 95134
Achieving Accurate Results With a Circuit Simulator Ken Kundert and Ian Clifford Cadence Design Systems Analog Division San Jose, Calif 95134 1 Outline Solving Nonlinear Systems of Equations Convergence
More information3 Modeling and Simulation
ME 132, Spring 2005, UC Berkeley, A Packard 13 3 Modeling and Simulation 31 Systems of 1st order, coupled differential equations Consider an input/output system, with m inputs (denoted by d), q outputs
More informationENGI9496 Lecture Notes State-Space Equation Generation
ENGI9496 Lecture Notes State-Space Equation Generation. State Equations and Variables - Definitions The end goal of model formulation is to simulate a system s behaviour on a computer. A set of coherent
More informationMultistep Methods for IVPs. t 0 < t < T
Multistep Methods for IVPs We are still considering the IVP dy dt = f(t,y) t 0 < t < T y(t 0 ) = y 0 So far we have looked at Euler s method, which was a first order method and Runge Kutta (RK) methods
More informationPowerPoints organized by Dr. Michael R. Gustafson II, Duke University
Part 6 Chapter 20 Initial-Value Problems PowerPoints organized by Dr. Michael R. Gustafson II, Duke University All images copyright The McGraw-Hill Companies, Inc. Permission required for reproduction
More informationComputing DC operating points of non-linear circuits using homotopy methods
ENSC 895: SPECIAL TOPICS: THEORY, ANALYSIS, AND SIMULATION OF NONLINEAR CIRCUITS Computing DC operating points of non-linear circuits using homotopy methods Spring 2004 Final Project Report Renju S. Narayanan
More informationInitial value problems for ordinary differential equations
Initial value problems for ordinary differential equations Xiaojing Ye, Math & Stat, Georgia State University Spring 2019 Numerical Analysis II Xiaojing Ye, Math & Stat, Georgia State University 1 IVP
More informationPart IB Numerical Analysis
Part IB Numerical Analysis Definitions Based on lectures by G. Moore Notes taken by Dexter Chua Lent 206 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after
More informationWoods Hole Methods of Computational Neuroscience. Differential Equations and Linear Algebra. Lecture Notes
Woods Hole Methods of Computational Neuroscience Differential Equations and Linear Algebra Lecture Notes c 004, 005 William L. Kath MCN 005 ODE & Linear Algebra Notes 1. Classification of differential
More informationMathematics Qualifying Exam Study Material
Mathematics Qualifying Exam Study Material The candidate is expected to have a thorough understanding of engineering mathematics topics. These topics are listed below for clarification. Not all instructors
More informationAccurate Fourier Analysis for Circuit Simulators
Accurate Fourier Analysis for Circuit Simulators Kenneth S. Kundert Cadence Design Systems (Based on Presentation to CICC 94) Abstract A new approach to Fourier analysis within the context of circuit simulation
More informationButcher tableau Can summarize an s + 1 stage Runge Kutta method using a triangular grid of coefficients
AM 205: lecture 13 Last time: ODE convergence and stability, Runge Kutta methods Today: the Butcher tableau, multi-step methods, boundary value problems Butcher tableau Can summarize an s + 1 stage Runge
More informationPreliminary Examination, Numerical Analysis, August 2016
Preliminary Examination, Numerical Analysis, August 2016 Instructions: This exam is closed books and notes. The time allowed is three hours and you need to work on any three out of questions 1-4 and any
More informationWhat we ll do: Lecture 21. Ordinary Differential Equations (ODEs) Differential Equations. Ordinary Differential Equations
What we ll do: Lecture Ordinary Differential Equations J. Chaudhry Department of Mathematics and Statistics University of New Mexico Review ODEs Single Step Methods Euler s method (st order accurate) Runge-Kutta
More informationHigh-Order Representation of Poincaré Maps
High-Order Representation of Poincaré Maps Johannes Grote, Martin Berz, and Kyoko Makino Department of Physics and Astronomy, Michigan State University, East Lansing, MI, USA. {grotejoh,berz,makino}@msu.edu
More information2tdt 1 y = t2 + C y = which implies C = 1 and the solution is y = 1
Lectures - Week 11 General First Order ODEs & Numerical Methods for IVPs In general, nonlinear problems are much more difficult to solve than linear ones. Unfortunately many phenomena exhibit nonlinear
More informationLinear Multistep Methods I: Adams and BDF Methods
Linear Multistep Methods I: Adams and BDF Methods Varun Shankar January 1, 016 1 Introduction In our review of 5610 material, we have discussed polynomial interpolation and its application to generating
More informationComputational Techniques Prof. Dr. Niket Kaisare Department of Chemical Engineering Indian Institute of Technology, Madras
Computational Techniques Prof. Dr. Niket Kaisare Department of Chemical Engineering Indian Institute of Technology, Madras Module No. # 07 Lecture No. # 05 Ordinary Differential Equations (Refer Slide
More informationIntroductory Numerical Analysis
Introductory Numerical Analysis Lecture Notes December 16, 017 Contents 1 Introduction to 1 11 Floating Point Numbers 1 1 Computational Errors 13 Algorithm 3 14 Calculus Review 3 Root Finding 5 1 Bisection
More informationCONVERGENCE AND STABILITY CONSTANT OF THE THETA-METHOD
Conference Applications of Mathematics 2013 in honor of the 70th birthday of Karel Segeth. Jan Brandts, Sergey Korotov, Michal Křížek, Jakub Šístek, and Tomáš Vejchodský (Eds.), Institute of Mathematics
More informationNumerical Differential Equations: IVP
Chapter 11 Numerical Differential Equations: IVP **** 4/16/13 EC (Incomplete) 11.1 Initial Value Problem for Ordinary Differential Equations We consider the problem of numerically solving a differential
More informationSolution via Laplace transform and matrix exponential
EE263 Autumn 2015 S. Boyd and S. Lall Solution via Laplace transform and matrix exponential Laplace transform solving ẋ = Ax via Laplace transform state transition matrix matrix exponential qualitative
More informationFinite Differences for Differential Equations 28 PART II. Finite Difference Methods for Differential Equations
Finite Differences for Differential Equations 28 PART II Finite Difference Methods for Differential Equations Finite Differences for Differential Equations 29 BOUNDARY VALUE PROBLEMS (I) Solving a TWO
More informationMB4018 Differential equations
MB4018 Differential equations Part II http://www.staff.ul.ie/natalia/mb4018.html Prof. Natalia Kopteva Spring 2015 MB4018 (Spring 2015) Differential equations Part II 0 / 69 Section 1 Second-Order Linear
More informationOrdinary differential equations. Phys 420/580 Lecture 8
Ordinary differential equations Phys 420/580 Lecture 8 Most physical laws are expressed as differential equations These come in three flavours: initial-value problems boundary-value problems eigenvalue
More informationSolutions to Math 53 Math 53 Practice Final
Solutions to Math 5 Math 5 Practice Final 20 points Consider the initial value problem y t 4yt = te t with y 0 = and y0 = 0 a 8 points Find the Laplace transform of the solution of this IVP b 8 points
More informationIntroduction to the Numerical Solution of IVP for ODE
Introduction to the Numerical Solution of IVP for ODE 45 Introduction to the Numerical Solution of IVP for ODE Consider the IVP: DE x = f(t, x), IC x(a) = x a. For simplicity, we will assume here that
More informationFourth Order RK-Method
Fourth Order RK-Method The most commonly used method is Runge-Kutta fourth order method. The fourth order RK-method is y i+1 = y i + 1 6 (k 1 + 2k 2 + 2k 3 + k 4 ), Ordinary Differential Equations (ODE)
More informationAdditional exercises with Numerieke Analyse
Additional exercises with Numerieke Analyse March 10, 017 1. (a) Given different points x 0, x 1, x [a, b] and scalars y 0, y 1, y, z 1, show that there exists at most one polynomial p P 3 with p(x i )
More informationYou may not use your books, notes; calculators are highly recommended.
Math 301 Winter 2013-14 Midterm 1 02/06/2014 Time Limit: 60 Minutes Name (Print): Instructor This exam contains 8 pages (including this cover page) and 6 problems. Check to see if any pages are missing.
More informationThe Finite Element Method for the Analysis of Non-Linear and Dynamic Systems: Non-Linear Dynamics Part I
The Finite Element Method for the Analysis of Non-Linear and Dynamic Systems: Non-Linear Dynamics Part I Prof. Dr. Eleni Chatzi Dr. Giuseppe Abbiati, Dr. Konstantinos Agathos Lecture 5/Part A - 23 November,
More informationDaba Meshesha Gusu and O.Chandra Sekhara Reddy 1
International Journal of Basic and Applied Sciences Vol. 4. No. 1 2015. Pp.22-27 Copyright by CRDEEP. All Rights Reserved. Full Length Research Paper Solutions of Non Linear Ordinary Differential Equations
More informationA Brief Introduction to Numerical Methods for Differential Equations
A Brief Introduction to Numerical Methods for Differential Equations January 10, 2011 This tutorial introduces some basic numerical computation techniques that are useful for the simulation and analysis
More informationOrdinary Differential Equations I
Ordinary Differential Equations I CS 205A: Mathematical Methods for Robotics, Vision, and Graphics Justin Solomon CS 205A: Mathematical Methods Ordinary Differential Equations I 1 / 32 Theme of Last Few
More informationOrdinary Differential Equations
Chapter 13 Ordinary Differential Equations We motivated the problem of interpolation in Chapter 11 by transitioning from analzying to finding functions. That is, in problems like interpolation and regression,
More informationDo not turn over until you are told to do so by the Invigilator.
UNIVERSITY OF EAST ANGLIA School of Mathematics Main Series UG Examination 216 17 INTRODUCTION TO NUMERICAL ANALYSIS MTHE612B Time allowed: 3 Hours Attempt QUESTIONS 1 and 2, and THREE other questions.
More informationThe Definition and Numerical Method of Final Value Problem and Arbitrary Value Problem Shixiong Wang 1*, Jianhua He 1, Chen Wang 2, Xitong Li 1
The Definition and Numerical Method of Final Value Problem and Arbitrary Value Problem Shixiong Wang 1*, Jianhua He 1, Chen Wang 2, Xitong Li 1 1 School of Electronics and Information, Northwestern Polytechnical
More informationCS 257: Numerical Methods
CS 57: Numerical Methods Final Exam Study Guide Version 1.00 Created by Charles Feng http://www.fenguin.net CS 57: Numerical Methods Final Exam Study Guide 1 Contents 1 Introductory Matter 3 1.1 Calculus
More informationChapter 8. Numerical Solution of Ordinary Differential Equations. Module No. 2. Predictor-Corrector Methods
Numerical Analysis by Dr. Anita Pal Assistant Professor Department of Matematics National Institute of Tecnology Durgapur Durgapur-7109 email: anita.buie@gmail.com 1 . Capter 8 Numerical Solution of Ordinary
More information