Finite Difference and Finite Element Methods
|
|
- Harold Rogers
- 6 years ago
- Views:
Transcription
1 Finite Difference and Finite Element Methods Georgy Gimel farb COMPSCI 369 Computational Science 1 / 39
2 1 Finite Differences Difference Equations 3 Finite Difference Methods: Euler FDMs 4 Finite Element Methods (FEM) [optional] Learning outcomes: Be familiar with the finite difference models and methods (Euler FDMs) Optional: Runge-Kutta FDMs, more accurate FEMs Recommended reading: M. T. Heath, Scientific Computing: An Introductory Survey. McGraw-Hill, 00: Chapters 5, 8 11 M. Shäfer, Computational Engineering - Introduction to Numerical Methods. Springer, 006: Chapters 3, 5 G. Strang, Computational Science and Engineering. Wellesley-Cambridge Press, 007: Chapters 1., 3, 6 / 39
3 Let s Recall Differential Equations Modern science and engineering assume our world is continuous and described by differential equations and integral equations Example I: 1 st -order differential equation du(x) = ; u(0) = 0 General solution: u(x) = x + A Boundary condition: u(0) = 0 gives A = 0 Final solution: u(x) = x Unknown u(x) is specified by a known instant speed of changes: du(x) = lim u(x + x) u(x) x 0 x 3 / 39
4 Let s Recall Differential Equations, continued Example II: nd -order DE d u(x) = ; u(0) = u(1) = 0 General solution: u(x) = x + Ax + B Boundary conditions: u(0) = 0; u(1) = 0 give B = 0; A = 1 Final solution: u(x) = x x Unknown u(x) is specified by a known instant acceleration of changes: ( ) d u(x) 1 = lim du(x+ x) x 0 x du(x) = lim x 0 ( 1 u(x+ x) u(x+ x) x x u(x+ x) u(x+ x)+u(x) = lim x 0 x ) u(x+ x) u(x) x 4 / 39
5 Physical Oscillating Second-order Systems Non-damped mass on a spring: m d x(t) = kx dt x(t) a displacement k a spring constant (the Hooke s law) m a mass Displacement x Mass m x Damped mass on a spring (γ the friction constant): m d x(t) dt = γ (t) dt + kx Pendulum: mr d θ dt d θ = g dt R sin θ = mgr sin θ θ R m mg 5 / 39
6 Differences Vs. Derivatives Finite differences: natural approximations to derivatives du(x) = lim u(x + x) u(x) x 0 x u(x) x u(x + x) u(x) x u u x x Discrete step x can be small but it does not tend to zero! x 6 / 39
7 Differences Vs. Derivatives Three possibilities for the finite difference: Forward difference u(x+h) u(x) h Test for u(x) = x (x+h) x h = x + h Backward difference u(x) u(x h) h x (x h) h = x h Centred difference u(x+h) u(x h) h (x+h) (x h) h = x Results of testing: The centred difference gives the exact derivative du(x) The forward and the backward differences differ by h = x 7 / 39
8 Taylor Series Approximation Let u(x) be an arbitrary infinitely differentiable function In plain words, let all its derivatives exist: d n u(x) n ; 1 n Given u(x 0 ) and dn u(x) x=x0 ; n = 1,,..., at x = x n 0, the value u(x 0 + h) at x = x 0 + h is represented by the Taylor s series of the values at x = x 0 : u(x 0 + h) = u(x 0 ) + n=1 u(x 0 ) + n=1 h n n! d n (u(x) n }{{ x=x0 } u [n] (x 0 ) h n n! u[n] (x 0 ) 8 / 39
9 A Few Famous Taylor Series Exponential function u(x) = e x e 0 = 1; dex x=0 = e x x=0 = 1: u(0 + h) e h = 1 + h + h + h3 6 + h Polynomial ratio u(x) = 1 1+x u(0) = 1; du(x) = x x=0 (1+x ) = 0; ( x=0 d u(x) x=0 = (1+x ) + 8x x=0 (1+x ) = : 3 u(0+h) h = 1 h +h 4... u(1) = 1 = Trivial for any polynomial u(x) = x 3 u(1) = 1; du(x) = 3x ; d u(x) = 6x; d3 u(x) 3 = 6: u(1 + h) = 1 + 3h + 6 h + 6h3 6 = 1 + 3h + 3h + h 3 9 / 39
10 Accuracy of Finite Differences Taylor series approximations: u(x + h) = u(x) + hu (x) + 1 h u (x) h3 u [3] (x) +... u(x h) = u(x) hu (x) + 1 h u (x) 1 6 h3 u [3] (x) +... The first-order accuracy O(h) of the one-sided differences: u(x+h) u(x) h = u (x) + 1 hu (x) +... u(x) u(x h) h = u (x) + 1 hu (x) +... The second-order accuracy O(h ) of the centred differences: u(x + h) u(x h) h = u (x) h u [3] (x) / 39
11 Second Difference The second difference approximation of the second derivative: d u u u(x + x) u(x) + u(x x) = x x The second order accuracy O(h ) due to the centred u: u(x + x) u(x) + u(x x) x = u (x)+ 1 1 h u [4] (x)+... Exact second derivatives (x+h) x +(x h) h = for u(x) = x and (x+h)3 x 3 +(x h) 3 h = 6x for u(x) = x 3 O(h ) accuracy (x+h)4 x 4 +(x h) 4 h = 1x + h for u(x) = x 4 with the true second derivative u (x) = 1x 11 / 39
12 Finite Difference Equations The nd -order differential equation d u(x) Known source function f(x) = f(x) Known boundary conditions, e.g. u(0) = 0 and u(1) = 0 Its discrete form the nd -order finite difference equation: Divide the interval [0, 1] into equal pieces of length h = 1 n+1 that meet at the points x = h, x = h,..., x = nh: Approximate the goal values u(h),..., u(nh) at n discrete points [h, h,..., nh] inside the interval [0, 1] with the values u 1,..., u n, respectively, using the finite difference u x : u 0 u 1 + u = f 1 f(h); u 1 u + u 3 = f f(h);... u n 1 u n + u n+1 = f n f(nh) 1 / 39
13 Finite Difference Equations: Matrix-Vector Form For the n unknowns u 1, u,..., u n and the boundary conditions u 0 = u n+1 = 0, the differential operator d is replaced with the n (n + ) matrix: 1 1 u 0 = 0 f u 1 f =. 1 h u n u n+1 = 0 f n 1 f n where the source values are specified as f i = f(ih) For the special case d u = 1 with the above boundary conditions, the finite differences give an exact match between u(ih) and u i 13 / 39
14 Example with the Constant Source f(x) = 1 Differential equation: d u = 1 with u(0) = u(1) = 0 Complete solution u complete = u part + u null : a particular one for u = 1 plus the nullspace one for u = 0 Particular solution: d u Nullspace solution: d u u(x) = x = 1 is solved by u part = x = 0 is solved by u null = Cx + D + Cx + D From the boundary conditions: u(0) = D = 0 u(1) = 1 + C + D = 0 C = 1 u(x) = x x Difference equation: u i 1+u i u i+1 h = 1 with u 0 = u n+1 = 0 (!) Just the same parabolic solution: u i = ih i h However such a perfect agreement between the discrete u i and the exact continuous u(ih) is very unusual 14 / 39
15 Another Example: Free End Boundary Condition (optional) Free end condition: zero slope u (0) = 0 at x = 0 and u(1) = 0 Differential equation: d u = 1 with du (0) = u(1) = 0 The complete solution: u(x) = x 1 x + Cx + D = Boundary conditions: u (0) = C = 0; u(1) = C + D = 0 D = 0.5 Difference equation: u i 1+u i u i+1 = 1 with u 1 u 0 h h = 0 and u n+1 = u u = 1 h 1 1 } {{ 1 } T n u n 1 u n / 39
16 Free End Boundary Condition, continued u 1 u. u n 1 u n = h n n 1 n... 1 n 1 n 1 n... 1 n n n } 1 1 {{ } T 1 n Discrete solution: u i = h (n+i)(n+1 i) Error w.r.t. the exact solution: u(ih) u i u ( i n+1 ) u i = 1 = 1 n+1 i = 1 (n+1) ( ) 1 i 1 (n+i)(n+1 i) (n+1) (n+1) ( 1 n+1 i (n+1) ) O(h) 16 / 39
17 Free End Boundary Condition, continued Therefore, the one-sided boundary conditions change the matrix and may result in O(h) error A more accurate difference equation can be constructed by centring the boundary conditions Centred difference equation will have nd -order errors O(h ) Previous and similar differential and difference equations can be met in many practical problems Simple physical examples of oscillators (see Slide 5): a non-damped mass on a spring a damped mass on a spring a pendulum 17 / 39
18 Stiff Differential Equations [ d v Example: dt w A ] [{}}{ = ] [ v w ] [ v(0) ; w(0) Solution: v(t) = e t + e 99t and w(t) = e t e 99t ] = [ 0 Time scales differ by a factor of 99 (the condition number of A) Solution decays at the slow time scale of e t, but computing e 99t may require a very small step t for stability Thus, t is controlled by the fast decaying component, and this is really counterproductive! Stiffness comes with any problem involving very different time scales (chemical kinetics, control theory, circuit simulations, etc.) ] 18 / 39
19 Forward and Backward Euler Methods (optional) Differential equation du(t) dt = f(u, t); an initial value u(0) The rate of change u is determined by the current state u at any moment t Forward Euler: u n+1 u n t Backward Euler: = f(u n, t n ) u n+1 = u n + t f n u n+1 u n t = f(u n+1, t n+1 ) u n+1 t f n+1 = u n Implicit method: if f is linear in u, a linear system is solved at each step 19 / 39
20 Forward and Backward Euler Methods, continued Example: Linear differential equation u = au (i.e. du(t) dt = au); u(0) = u 0 > 0, with the exact solution: u(t) = e at u(0) u 0 e at Generally, a is a complex number: a = (Re a) + (Im a) 1 Forward Euler: one step u n+1 = (1 + a t)u n u n = (1 + a t) n u 0 Convergence: (1 + a t) T/ t e at as t 0 Sharp instability border 1 + a t = 1, i.e. for a = / t Backward Euler: one step (1 a t)u n+1 = u n u n = (1 a t) n u 0 Convergence: (1 a t) 1 = 1 + a t+ higher order terms, so that (1 a t) T/ t e at as t 0 Stability whenever u = au is stable (i.e. for a having the negative real part: Re a < 0) 0 / 39
21 Forward and Backward Euler Methods, continued Since forward and backward differences are first order accurate, the errors from both methods are O( t) Second-order methods: Formal notation: f n = f(u n, t n ) and f n+1 = f(u n+1, t n+1 ) Crank-Nicolson: u n+1 u n t = f n+1 + f n u n+1 = a t 1 1 a tu n Stable even for stiff equations, when a 0 1 / 39
22 Forward and Backward Euler Methods, continued Second-order methods: Explicit forward Euler: u n+1 u n t = 3f n f n 1 Stable if t is small enough: a t 1 if a is real But explicit systems always impose a limit on t Implicit backward difference: 3u n+1 4u n + u n 1 t = f n+1 More stable and accurate than the Crank-Nicolson method (trapezoidal rule) / 39
23 Explicit and Implicit Multistep Methods (optional) With p earlier values of u n, the accuracy is increased to order p u = u(t) u(t t) u = u(t) u(t t) + u(t t) 3 u = u(t) 3u(t t) + 3u(t t) u(t 3 t)... p u = u(t) pt(y t) ( 1) p u(t p t) Backward differences: ( p p ) u n+1 = t f(u n+1, t n+1 ) Backward Euler method: p = 1 Implicit backward difference method: p = 3 / 39
24 Explicit and Implicit Multistep Methods, continued An alternative: using older values of f(u n, t n ) instead of u n Explicit forward Euler methods: u n+1 u n = t (b 1 f n b p f n p+1 ) order of b 1 b b 3 b 4 limit on a t accuracy for stability p = 1 1 p = 3/ -1/ 1 p = 3 3/1-16/1 5/1 6/11 p = 4 55/4-59/4 37/4-9/4 3/10 The like implicit methods are even more stable and accurate 4 / 39
25 Runge-Kutta Methods (optional) Highly competitive and self-starting if evaluations of f(u, t) are not too expensive Compound 1-step methods, using Euler s u n + tf n inside the function f Simplified RKM: u n+1 u n t = 1 f n + f(u n + tf n, t n+1 ) }{{} compounding of f 5 / 39
26 Simplified Runge-Kutta Method (optional) nd -order accuracy An example for u = au: u n+1 = u n + 1 t[au n + a(u n + tau n )] = (1 + a t + 1 ) a t u n }{{} Growth factor G This growth factor G reproduces the exact e a t through the third term 1 a ( t) of the Taylor s series 6 / 39
27 Higher-order Runge-Kutta Method (optional) Fourth-order RKM: u n+1 u n t = 1 3 (k 1 + k + k 3 + k 4 ) where k 1 = 1 f(u n, t n ) k 3 = 1 f ( u n + tk, t n+1/ ) k = 1 f ( u n + tk 1, t n+1/ ) k 4 = 1 f (u n + tk 3, t n+1 ) This 1-step method needs no special starting instructions It is simple to change t during computations The growth factor reproduces e a t through the fifth term 1 4 a4 ( t) 4 of the Taylor s series Among highly accurate methods, RKM is especially easy to code and run probably the easiest there is! The stability threshold is a t <.78 7 / 39
28 Finite Element Methods (FEM) [optional] Finite difference methods (FDM) approximate the differential equation (+) Very easy implementation ( ) Low accuracy between grid points Finite element methods (FEM) approximate directly the solution of the differential equation (+) Easy handling of complex geometry and boundaries of a problem domain (±) Usually, more accurate than FDM but this depends on a problem Unknown solution u(x) as a combination of n basis functions φ(x): u(x) = u 1 φ 1 (x) u n φ n (x) FDM are special cases of the FEM with specific basis functions 8 / 39
29 Finite Element Methods: Weak Form Weak (or variational) form of the differential equation u (x) = f(x) in [0, 1] with u(0) = u(1) = 0: For any smooth function ν(x) satisfying the boundary conditions ν(0) = ν(1) = 0: 1 0 f(x)ν(x) = 1 0 u (x)ν(x) = 1 0 u (x)ν (x) Recall the calculus: Integration by parts b a y(s)z (s)ds = y(s)z(s) b a a b y (s)z(s)ds 9 / 39
30 Galerkin s FEM: u = f in the discrete weak form Discretisation of ν(x) with n test functions ν 1 (x),..., ν n (x) The weak form gives one equation for each ν j (x) involving numerical coefficients u 1,..., u n : 1 ( n ) 1 dν j (x) = f(x)ν j (x); j = 1,..., n 0 dφ u i (x) i i=1 Ku = f, that is, K ij = n K ij u i = f j ; j = 1,..., n, where i=1 1 0 ( dφi (x) 0 ) dν j (x) 1 and f j = f(x)ν j (x) 0 30 / 39
31 Galerkin s FEM: u = f (cont.) Mostly, the test functions ν i s are the same as the basis functions φ i s for u(x) Then the stiffness matrix K is symmetric and positive definite Integrals of products of φ i (x) and ν i (x) giving the matrix components K ij should be finite ( < K ij < ) So step functions are not allowed as the basis and test functions! Derivative of a step-function is the delta-function δ, and the squared delta-function δ has an infinite integral Linear hat functions (having step functions as their derivatives) can be used as the basis and test functions 31 / 39
32 Linear Finite Elements: Hat Functions h = 1 3 ; u(x) = u 1φ 1 (x) + u φ (x) + u 3 φ 3 (x) Basis and test functions φ i (x) = ν i (x); i = 1,, 3: 1 φ 1 (x) φ (x) φ 3 (x) 0 h h 1 φ 1 (x) φ (x) φ 3 (x) 0 x 1 3 3x x 3 3x 3x x x 3x 3 / 39
33 Linear Finite Elements: An Example with Hat Functions 1 φ 1 (x) φ (x) φ 3 (x) 0.5 u(x) 0 h h 1 u 1 u u 3 0 h h 1 Piecewise-linear function u(x) = u 1 φ 1 (x) + u φ (x) + u 3 φ 3 (x) Differential equation: u = 1 (i.e. f(x) = 1) Free-end border conditions u(0) = 0; u (0) = 1 Complete solution of this differential eqution: u(x) = A + Bx x (nullspace + a particular solution); A = 0 and B = 1 (from the border conditions) u(x) = x x Test functions: ν i : hats φ 1 and φ and one half-hat φ 3 ; h = / 39
34 FEM Example with Hat Functions (cont.) Stiffness matrix: E.g. K = K ij = K 11 = K 1 = 1 0 dφ i (x) dφ j (x) 3 dφ 1 (x) i,j=1 dφ (x) = dφ 3 (x) 0 x x x ( ) dφ1(x) = = 6 dφ 1(x) dφ (x) = = 3 34 / 39
35 FEM Example with Hat Functions (cont.) Vector f = [f 1, f, f 3 ] T = [ 1 3, 1 3, 1 6] T: f 1 = f = f 3 = 1 φ 1 (x) = 0 1 φ (x) = 0 1/3 0 = 3x = 1 φ 3 (x) = 0 = /3 1/3 3x + 1/3 0 /3 1/3 ( + (3x 1) + ( 3x) x 3x 1 /3 ) /3 1/3 (3 3x) ( ) 3x x /3 ( ) 1 + 3x 3x 1/3 1 (3x ) /3 ( 3x x ) 1 /3 /3 = = 1 3 = = 1 3 = / 39
36 FEM Example with Hat Functions (cont.) Solving the finite element equation Ku = f for the mesh values in u: u 1 1/ u = 1/ /6 u 3 } {{ }}{{} K u u 1 5/18 u = 4/9 u 3 1/ } {{ } K 1 f } {{ } f u(x) = x x = 5/18 x = 1/3 4/9 x = /3 1/ x = 1 All three values u 1, u, u 3 agree exactly with the true solution of the differential equation u(x) = x x at the mesh points Values u i by the finite differences were not exact for this equation 36 / 39
37 Finite Element Methods Vs. Finite Differences FEM: two- and three-dimensional meshes of arbitrary geometry, compared to the inflexibility of a finite difference grid Using numerical integration for K and f, FEM allows for any functions f(x) and c(x) ( in solving ) the differential equation = f(x) d c(x) du(x) Linear finite elements: nd -order accuracy O(h ) in u(x) and 1 st -order accuracy O(h) in du(x) Better accuracy the higher-degree finite elements E.g. piecewise cubic polynomials with continuous slopes Adding to the hat functions the bubble functions: quadratic parabolas staying inside each mesh interval 37 / 39
38 More Accurate Finite Elements (optional) Hat + bubble functions piecewise linear slope u (x): u(x) = u 1 φ 1 (x)+u φ (x)+u 3 φ 3 (x)+u 4 φ 4 (x)+u 5 φ 5 (x)+u 6 φ 6 (x) 1 φ 4 φ 1 φ 5 φ φ 6 φ 3 0 h h 1 u(x) u(0.5) = u 5 + (u 1 + u )/ u = u u 1 h u 1 u u 3 0 h 0.5 h 1 Expected accuracy: 3 rd -order O(h 3 ) in u(x) and nd -order O(h ) in u (x) This higher accuracy without a very fine mesh required by only linear elements! 38 / 39
39 Numerical Linear Algebra Applied Mathematics (AM) Vs. Computational Science (CS): (AM) Stating a problem and building an equation to describe it (CS) Solving that equation using mostly numerical methods Numerical linear algebra represents this build up, break down process in its clearest form, with matrix models like Ku = f Crucial properties of K: symmetric or not sparse or not banded or not well conditioned or not Often the computations break K into simpler pieces The algorithm becomes clearest when it is seen as a factorisation into: triangular matrices or orthogonal matrices or very sparse matrices 39 / 39
Lecture IV: Time Discretization
Lecture IV: Time Discretization Motivation Kinematics: continuous motion in continuous time Computer simulation: Discrete time steps t Discrete Space (mesh particles) Updating Position Force induces acceleration.
More informationLecture V: The game-engine loop & Time Integration
Lecture V: The game-engine loop & Time Integration The Basic Game-Engine Loop Previous state: " #, %(#) ( #, )(#) Forces -(#) Integrate velocities and positions Resolve Interpenetrations Per-body change
More informationThe method of lines (MOL) for the diffusion equation
Chapter 1 The method of lines (MOL) for the diffusion equation The method of lines refers to an approximation of one or more partial differential equations with ordinary differential equations in just
More informationNumerical Solutions to Partial Differential Equations
Numerical Solutions to Partial Differential Equations Zhiping Li LMAM and School of Mathematical Sciences Peking University The Implicit Schemes for the Model Problem The Crank-Nicolson scheme and θ-scheme
More informationTime-dependent variational forms
Time-dependent variational forms Hans Petter Langtangen 1,2 1 Center for Biomedical Computing, Simula Research Laboratory 2 Department of Informatics, University of Oslo Oct 30, 2015 PRELIMINARY VERSION
More informationChapter Two: Numerical Methods for Elliptic PDEs. 1 Finite Difference Methods for Elliptic PDEs
Chapter Two: Numerical Methods for Elliptic PDEs Finite Difference Methods for Elliptic PDEs.. Finite difference scheme. We consider a simple example u := subject to Dirichlet boundary conditions ( ) u
More informationLarge Steps in Cloth Simulation. Safeer C Sushil Kumar Meena Guide: Prof. Parag Chaudhuri
Large Steps in Cloth Simulation Safeer C Sushil Kumar Meena Guide: Prof. Parag Chaudhuri Introduction Cloth modeling a challenging problem. Phenomena to be considered Stretch, shear, bend of cloth Interaction
More informationFrom Completing the Squares and Orthogonal Projection to Finite Element Methods
From Completing the Squares and Orthogonal Projection to Finite Element Methods Mo MU Background In scientific computing, it is important to start with an appropriate model in order to design effective
More informationLecture 1. Finite difference and finite element methods. Partial differential equations (PDEs) Solving the heat equation numerically
Finite difference and finite element methods Lecture 1 Scope of the course Analysis and implementation of numerical methods for pricing options. Models: Black-Scholes, stochastic volatility, exponential
More informationKINGS COLLEGE OF ENGINEERING DEPARTMENT OF MATHEMATICS ACADEMIC YEAR / EVEN SEMESTER QUESTION BANK
KINGS COLLEGE OF ENGINEERING MA5-NUMERICAL METHODS DEPARTMENT OF MATHEMATICS ACADEMIC YEAR 00-0 / EVEN SEMESTER QUESTION BANK SUBJECT NAME: NUMERICAL METHODS YEAR/SEM: II / IV UNIT - I SOLUTION OF EQUATIONS
More informationFinite difference methods for the diffusion equation
Finite difference methods for the diffusion equation D150, Tillämpade numeriska metoder II Olof Runborg May 0, 003 These notes summarize a part of the material in Chapter 13 of Iserles. They are based
More informationIntroduction to numerical schemes
236861 Numerical Geometry of Images Tutorial 2 Introduction to numerical schemes Heat equation The simple parabolic PDE with the initial values u t = K 2 u 2 x u(0, x) = u 0 (x) and some boundary conditions
More informationMA 262, Fall 2017, Final Version 01(Green)
INSTRUCTIONS MA 262, Fall 2017, Final Version 01(Green) (1) Switch off your phone upon entering the exam room. (2) Do not open the exam booklet until you are instructed to do so. (3) Before you open the
More information[ ] is a vector of size p.
Lecture 11 Copyright by Hongyun Wang, UCSC Recap: General form of explicit Runger-Kutta methods for solving y = F( y, t) k i = hfy n + i1 j =1 c ij k j, t n + d i h, i = 1,, p + p j =1 b j k j A Runge-Kutta
More informationAIMS Exercise Set # 1
AIMS Exercise Set #. Determine the form of the single precision floating point arithmetic used in the computers at AIMS. What is the largest number that can be accurately represented? What is the smallest
More informationChapter 1: The Finite Element Method
Chapter 1: The Finite Element Method Michael Hanke Read: Strang, p 428 436 A Model Problem Mathematical Models, Analysis and Simulation, Part Applications: u = fx), < x < 1 u) = u1) = D) axial deformation
More informationApplied Math for Engineers
Applied Math for Engineers Ming Zhong Lecture 15 March 28, 2018 Ming Zhong (JHU) AMS Spring 2018 1 / 28 Recap Table of Contents 1 Recap 2 Numerical ODEs: Single Step Methods 3 Multistep Methods 4 Method
More informationTutorial 2. Introduction to numerical schemes
236861 Numerical Geometry of Images Tutorial 2 Introduction to numerical schemes c 2012 Classifying PDEs Looking at the PDE Au xx + 2Bu xy + Cu yy + Du x + Eu y + Fu +.. = 0, and its discriminant, B 2
More informationDifferential Equations
Differential Equations Overview of differential equation! Initial value problem! Explicit numeric methods! Implicit numeric methods! Modular implementation Physics-based simulation An algorithm that
More informationPreliminaries Lectures. Dr. Abdulla Eid. Department of Mathematics MATHS 101: Calculus I
Preliminaries 2 1 2 Lectures Department of Mathematics http://www.abdullaeid.net/maths101 MATHS 101: Calculus I (University of Bahrain) Prelim 1 / 35 Pre Calculus MATHS 101: Calculus MATHS 101 is all about
More informationAM 205: lecture 14. Last time: Boundary value problems Today: Numerical solution of PDEs
AM 205: lecture 14 Last time: Boundary value problems Today: Numerical solution of PDEs ODE BVPs A more general approach is to formulate a coupled system of equations for the BVP based on a finite difference
More informationNumerical Algorithms for Visual Computing II 2010/11 Example Solutions for Assignment 6
Numerical Algorithms for Visual Computing II 00/ Example Solutions for Assignment 6 Problem (Matrix Stability Infusion). The matrix A of the arising matrix notation U n+ = AU n takes the following form,
More informationMath 660 Lecture 4: FDM for evolutionary equations: ODE solvers
Math 660 Lecture 4: FDM for evolutionary equations: ODE solvers Consider the ODE u (t) = f(t, u(t)), u(0) = u 0, where u could be a vector valued function. Any ODE can be reduced to a first order system,
More informationReview: control, feedback, etc. Today s topic: state-space models of systems; linearization
Plan of the Lecture Review: control, feedback, etc Today s topic: state-space models of systems; linearization Goal: a general framework that encompasses all examples of interest Once we have mastered
More information[2] (a) Develop and describe the piecewise linear Galerkin finite element approximation of,
269 C, Vese Practice problems [1] Write the differential equation u + u = f(x, y), (x, y) Ω u = 1 (x, y) Ω 1 n + u = x (x, y) Ω 2, Ω = {(x, y) x 2 + y 2 < 1}, Ω 1 = {(x, y) x 2 + y 2 = 1, x 0}, Ω 2 = {(x,
More informationMATH 31B: MIDTERM 2 REVIEW. sin 2 x = 1 cos(2x) dx = x 2 sin(2x) 4. + C = x 2. dx = x sin(2x) + C = x sin x cos x
MATH 3B: MIDTERM REVIEW JOE HUGHES. Evaluate sin x and cos x. Solution: Recall the identities cos x = + cos(x) Using these formulas gives cos(x) sin x =. Trigonometric Integrals = x sin(x) sin x = cos(x)
More informationAn Introduction to Numerical Methods for Differential Equations. Janet Peterson
An Introduction to Numerical Methods for Differential Equations Janet Peterson Fall 2015 2 Chapter 1 Introduction Differential equations arise in many disciplines such as engineering, mathematics, sciences
More informationPart IB Numerical Analysis
Part IB Numerical Analysis Definitions Based on lectures by G. Moore Notes taken by Dexter Chua Lent 206 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after
More information1.6: 16, 20, 24, 27, 28
.6: 6, 2, 24, 27, 28 6) If A is positive definite, then A is positive definite. The proof of the above statement can easily be shown for the following 2 2 matrix, a b A = b c If that matrix is positive
More informationOrdinary Differential Equations II
Ordinary Differential Equations II CS 205A: Mathematical Methods for Robotics, Vision, and Graphics Justin Solomon CS 205A: Mathematical Methods Ordinary Differential Equations II 1 / 29 Almost Done! No
More informationDifferential Equations
Electricity and Magnetism I (P331) M. R. Shepherd October 14, 2008 Differential Equations The purpose of this note is to provide some supplementary background on differential equations. The problems discussed
More informationUNIVERSITY OF MANITOBA
Question Points Score INSTRUCTIONS TO STUDENTS: This is a 6 hour examination. No extra time will be given. No texts, notes, or other aids are permitted. There are no calculators, cellphones or electronic
More informationWhat we ll do: Lecture 21. Ordinary Differential Equations (ODEs) Differential Equations. Ordinary Differential Equations
What we ll do: Lecture Ordinary Differential Equations J. Chaudhry Department of Mathematics and Statistics University of New Mexico Review ODEs Single Step Methods Euler s method (st order accurate) Runge-Kutta
More informationThe first order quasi-linear PDEs
Chapter 2 The first order quasi-linear PDEs The first order quasi-linear PDEs have the following general form: F (x, u, Du) = 0, (2.1) where x = (x 1, x 2,, x 3 ) R n, u = u(x), Du is the gradient of u.
More informationLecture 9 Approximations of Laplace s Equation, Finite Element Method. Mathématiques appliquées (MATH0504-1) B. Dewals, C.
Lecture 9 Approximations of Laplace s Equation, Finite Element Method Mathématiques appliquées (MATH54-1) B. Dewals, C. Geuzaine V1.2 23/11/218 1 Learning objectives of this lecture Apply the finite difference
More informationFDM for parabolic equations
FDM for parabolic equations Consider the heat equation where Well-posed problem Existence & Uniqueness Mass & Energy decreasing FDM for parabolic equations CNFD Crank-Nicolson + 2 nd order finite difference
More informationFinite Differences for Differential Equations 28 PART II. Finite Difference Methods for Differential Equations
Finite Differences for Differential Equations 28 PART II Finite Difference Methods for Differential Equations Finite Differences for Differential Equations 29 BOUNDARY VALUE PROBLEMS (I) Solving a TWO
More informationTEST CODE: MIII (Objective type) 2010 SYLLABUS
TEST CODE: MIII (Objective type) 200 SYLLABUS Algebra Permutations and combinations. Binomial theorem. Theory of equations. Inequalities. Complex numbers and De Moivre s theorem. Elementary set theory.
More informationScientific Computing II
Scientific Computing II Molecular Dynamics Numerics Michael Bader SCCS Technical University of Munich Summer 018 Recall: Molecular Dynamics System of ODEs resulting force acting on a molecule: F i = j
More informationModeling and Experimentation: Compound Pendulum
Modeling and Experimentation: Compound Pendulum Prof. R.G. Longoria Department of Mechanical Engineering The University of Texas at Austin Fall 2014 Overview This lab focuses on developing a mathematical
More informationFinite Element Methods
Solving Operator Equations Via Minimization We start with several definitions. Definition. Let V be an inner product space. A linear operator L: D V V is said to be positive definite if v, Lv > for every
More informationLecture Notes to Accompany. Scientific Computing An Introductory Survey. by Michael T. Heath. Chapter 9
Lecture Notes to Accompany Scientific Computing An Introductory Survey Second Edition by Michael T. Heath Chapter 9 Initial Value Problems for Ordinary Differential Equations Copyright c 2001. Reproduction
More informationFinite difference method for heat equation
Finite difference method for heat equation Praveen. C praveen@math.tifrbng.res.in Tata Institute of Fundamental Research Center for Applicable Mathematics Bangalore 560065 http://math.tifrbng.res.in/~praveen
More informationControl Systems. Internal Stability - LTI systems. L. Lanari
Control Systems Internal Stability - LTI systems L. Lanari outline LTI systems: definitions conditions South stability criterion equilibrium points Nonlinear systems: equilibrium points examples stable
More informationEigenvalues and Eigenvectors
/88 Chia-Ping Chen Department of Computer Science and Engineering National Sun Yat-sen University Linear Algebra Eigenvalue Problem /88 Eigenvalue Equation By definition, the eigenvalue equation for matrix
More informationFinite difference method for solving Advection-Diffusion Problem in 1D
Finite difference method for solving Advection-Diffusion Problem in 1D Author : Osei K. Tweneboah MATH 5370: Final Project Outline 1 Advection-Diffusion Problem Stationary Advection-Diffusion Problem in
More informationA very short introduction to the Finite Element Method
A very short introduction to the Finite Element Method Till Mathis Wagner Technical University of Munich JASS 2004, St Petersburg May 4, 2004 1 Introduction This is a short introduction to the finite element
More informationTime stepping methods
Time stepping methods ATHENS course: Introduction into Finite Elements Delft Institute of Applied Mathematics, TU Delft Matthias Möller (m.moller@tudelft.nl) 19 November 2014 M. Möller (DIAM@TUDelft) Time
More information11.2 Basic First-order System Methods
112 Basic First-order System Methods 797 112 Basic First-order System Methods Solving 2 2 Systems It is shown here that any constant linear system u a b = A u, A = c d can be solved by one of the following
More informationAbsorbing Boundary Conditions for Nonlinear Wave Equations
Absorbing Boundary Conditions for Nonlinear Wave Equations R. B. Gibson December, 2010 1 1 Linear Wave Equations 1.1 Boundary Condition 1 To begin, we wish to solve where with the boundary condition u
More informationLecture 4: Numerical solution of ordinary differential equations
Lecture 4: Numerical solution of ordinary differential equations Department of Mathematics, ETH Zürich General explicit one-step method: Consistency; Stability; Convergence. High-order methods: Taylor
More informationOrdinary Differential Equations
Ordinary Differential Equations We call Ordinary Differential Equation (ODE) of nth order in the variable x, a relation of the kind: where L is an operator. If it is a linear operator, we call the equation
More informationCS520: numerical ODEs (Ch.2)
.. CS520: numerical ODEs (Ch.2) Uri Ascher Department of Computer Science University of British Columbia ascher@cs.ubc.ca people.cs.ubc.ca/ ascher/520.html Uri Ascher (UBC) CPSC 520: ODEs (Ch. 2) Fall
More informationEN Nonlinear Control and Planning in Robotics Lecture 3: Stability February 4, 2015
EN530.678 Nonlinear Control and Planning in Robotics Lecture 3: Stability February 4, 2015 Prof: Marin Kobilarov 0.1 Model prerequisites Consider ẋ = f(t, x). We will make the following basic assumptions
More informationENO and WENO schemes. Further topics and time Integration
ENO and WENO schemes. Further topics and time Integration Tefa Kaisara CASA Seminar 29 November, 2006 Outline 1 Short review ENO/WENO 2 Further topics Subcell resolution Other building blocks 3 Time Integration
More informationAP Calculus AB: Semester Review Notes Information in the box are MASTERY CONCEPTS. Be prepared to apply these concepts on your midterm.
AP Calculus AB: Semester Review Notes Information in the box are MASTERY CONCEPTS. Be prepared to apply these concepts on your midterm. Name: Date: Period: I. Limits and Continuity Definition of Average
More informationChapter 2: Complex numbers
Chapter 2: Complex numbers Complex numbers are commonplace in physics and engineering. In particular, complex numbers enable us to simplify equations and/or more easily find solutions to equations. We
More informationPreliminary Examination, Numerical Analysis, August 2016
Preliminary Examination, Numerical Analysis, August 2016 Instructions: This exam is closed books and notes. The time allowed is three hours and you need to work on any three out of questions 1-4 and any
More informationCS 450 Numerical Analysis. Chapter 8: Numerical Integration and Differentiation
Lecture slides based on the textbook Scientific Computing: An Introductory Survey by Michael T. Heath, copyright c 2018 by the Society for Industrial and Applied Mathematics. http://www.siam.org/books/cl80
More informationLecture Notes on Numerical Schemes for Flow and Transport Problems
Lecture Notes on Numerical Schemes for Flow and Transport Problems by Sri Redeki Pudaprasetya sr pudap@math.itb.ac.id Department of Mathematics Faculty of Mathematics and Natural Sciences Bandung Institute
More informationSKMM 3023 Applied Numerical Methods
UNIVERSITI TEKNOLOGI MALAYSIA SKMM 3023 Applied Numerical Methods Numerical Differentiation ibn Abdullah Faculty of Mechanical Engineering Òº ÙÐÐ ÚºÒÙÐÐ ¾¼½ SKMM 3023 Applied Numerical Methods Numerical
More informationAnalytical Dynamics: Lagrange s Equation and its Application A Brief Introduction
Analytical Dynamics: Lagrange s Equation and its Application A Brief Introduction D. S. Stutts, Ph.D. Associate Professor of Mechanical Engineering Missouri University of Science and Technology Rolla,
More informationCS 450 Numerical Analysis. Chapter 9: Initial Value Problems for Ordinary Differential Equations
Lecture slides based on the textbook Scientific Computing: An Introductory Survey by Michael T. Heath, copyright c 2018 by the Society for Industrial and Applied Mathematics. http://www.siam.org/books/cl80
More informationIdentification Methods for Structural Systems. Prof. Dr. Eleni Chatzi Lecture March, 2016
Prof. Dr. Eleni Chatzi Lecture 4-09. March, 2016 Fundamentals Overview Multiple DOF Systems State-space Formulation Eigenvalue Analysis The Mode Superposition Method The effect of Damping on Structural
More informationLecture Notes on Numerical Schemes for Flow and Transport Problems
Lecture Notes on Numerical Schemes for Flow and Transport Problems by Sri Redeki Pudaprasetya sr pudap@math.itb.ac.id Department of Mathematics Faculty of Mathematics and Natural Sciences Bandung Institute
More informationOrdinary differential equations - Initial value problems
Education has produced a vast population able to read but unable to distinguish what is worth reading. G.M. TREVELYAN Chapter 6 Ordinary differential equations - Initial value problems In this chapter
More informationMIT (Spring 2014)
18.311 MIT (Spring 014) Rodolfo R. Rosales May 6, 014. Problem Set # 08. Due: Last day of lectures. IMPORTANT: Turn in the regular and the special problems stapled in two SEPARATE packages. Print your
More informationOrdinary Differential Equations II
Ordinary Differential Equations II CS 205A: Mathematical Methods for Robotics, Vision, and Graphics Justin Solomon CS 205A: Mathematical Methods Ordinary Differential Equations II 1 / 33 Almost Done! Last
More informationECEN 420 LINEAR CONTROL SYSTEMS. Lecture 6 Mathematical Representation of Physical Systems II 1/67
1/67 ECEN 420 LINEAR CONTROL SYSTEMS Lecture 6 Mathematical Representation of Physical Systems II State Variable Models for Dynamic Systems u 1 u 2 u ṙ. Internal Variables x 1, x 2 x n y 1 y 2. y m Figure
More informationNumerical Analysis: Interpolation Part 1
Numerical Analysis: Interpolation Part 1 Computer Science, Ben-Gurion University (slides based mostly on Prof. Ben-Shahar s notes) 2018/2019, Fall Semester BGU CS Interpolation (ver. 1.00) AY 2018/2019,
More informationNumerical Solutions to Partial Differential Equations
Numerical Solutions to Partial Differential Equations Zhiping Li LMAM and School of Mathematical Sciences Peking University A Model Problem and Its Difference Approximations 1-D Initial Boundary Value
More informationScientific Computing: An Introductory Survey
Scientific Computing: An Introductory Survey Chapter 9 Initial Value Problems for Ordinary Differential Equations Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign
More informationNUMERICAL SOLUTION OF ODE IVPs. Overview
NUMERICAL SOLUTION OF ODE IVPs 1 Quick review of direction fields Overview 2 A reminder about and 3 Important test: Is the ODE initial value problem? 4 Fundamental concepts: Euler s Method 5 Fundamental
More informationMIT Final Exam Solutions, Spring 2017
MIT 8.6 Final Exam Solutions, Spring 7 Problem : For some real matrix A, the following vectors form a basis for its column space and null space: C(A) = span,, N(A) = span,,. (a) What is the size m n of
More informationGraphs of polynomials. Sue Gordon and Jackie Nicholas
Mathematics Learning Centre Graphs of polynomials Sue Gordon and Jackie Nicholas c 2004 University of Sydney Mathematics Learning Centre, University of Sydney 1 1 Graphs of Polynomials Polynomials are
More information2nd-Order Linear Equations
4 2nd-Order Linear Equations 4.1 Linear Independence of Functions In linear algebra the notion of linear independence arises frequently in the context of vector spaces. If V is a vector space over the
More informationDefect-based a-posteriori error estimation for implicit ODEs and DAEs
1 / 24 Defect-based a-posteriori error estimation for implicit ODEs and DAEs W. Auzinger Institute for Analysis and Scientific Computing Vienna University of Technology Workshop on Innovative Integrators
More information7 Hyperbolic Differential Equations
Numerical Analysis of Differential Equations 243 7 Hyperbolic Differential Equations While parabolic equations model diffusion processes, hyperbolic equations model wave propagation and transport phenomena.
More informationUnit IV Derivatives 20 Hours Finish by Christmas
Unit IV Derivatives 20 Hours Finish by Christmas Calculus There two main streams of Calculus: Differentiation Integration Differentiation is used to find the rate of change of variables relative to one
More informationUnit IV Derivatives 20 Hours Finish by Christmas
Unit IV Derivatives 20 Hours Finish by Christmas Calculus There two main streams of Calculus: Differentiation Integration Differentiation is used to find the rate of change of variables relative to one
More informationNumerical Solutions to Partial Differential Equations
Numerical Solutions to Partial Differential Equations Zhiping Li LMAM and School of Mathematical Sciences Peking University Numerical Methods for Partial Differential Equations Finite Difference Methods
More informationEngg. Math. II (Unit-IV) Numerical Analysis
Dr. Satish Shukla of 33 Engg. Math. II (Unit-IV) Numerical Analysis Syllabus. Interpolation and Curve Fitting: Introduction to Interpolation; Calculus of Finite Differences; Finite Difference and Divided
More informationNumerical Algorithms for ODEs/DAEs (Transient Analysis)
Numerical Algorithms for ODEs/DAEs (Transient Analysis) Slide 1 Solving Differential Equation Systems d q ( x(t)) + f (x(t)) + b(t) = 0 dt DAEs: many types of solutions useful DC steady state: state no
More informationM.SC. PHYSICS - II YEAR
MANONMANIAM SUNDARANAR UNIVERSITY DIRECTORATE OF DISTANCE & CONTINUING EDUCATION TIRUNELVELI 627012, TAMIL NADU M.SC. PHYSICS - II YEAR DKP26 - NUMERICAL METHODS (From the academic year 2016-17) Most Student
More informationRobotics. Dynamics. Marc Toussaint U Stuttgart
Robotics Dynamics 1D point mass, damping & oscillation, PID, dynamics of mechanical systems, Euler-Lagrange equation, Newton-Euler recursion, general robot dynamics, joint space control, reference trajectory
More informationIntegration, differentiation, and root finding. Phys 420/580 Lecture 7
Integration, differentiation, and root finding Phys 420/580 Lecture 7 Numerical integration Compute an approximation to the definite integral I = b Find area under the curve in the interval Trapezoid Rule:
More informationReview Higher Order methods Multistep methods Summary HIGHER ORDER METHODS. P.V. Johnson. School of Mathematics. Semester
HIGHER ORDER METHODS School of Mathematics Semester 1 2008 OUTLINE 1 REVIEW 2 HIGHER ORDER METHODS 3 MULTISTEP METHODS 4 SUMMARY OUTLINE 1 REVIEW 2 HIGHER ORDER METHODS 3 MULTISTEP METHODS 4 SUMMARY OUTLINE
More informationPDEs in Image Processing, Tutorials
PDEs in Image Processing, Tutorials Markus Grasmair Vienna, Winter Term 2010 2011 Direct Methods Let X be a topological space and R: X R {+ } some functional. following definitions: The mapping R is lower
More informationAMS 529: Finite Element Methods: Fundamentals, Applications, and New Trends
AMS 529: Finite Element Methods: Fundamentals, Applications, and New Trends Lecture 3: Finite Elements in 2-D Xiangmin Jiao SUNY Stony Brook Xiangmin Jiao Finite Element Methods 1 / 18 Outline 1 Boundary
More informationModule 4: Numerical Methods for ODE. Michael Bader. Winter 2007/2008
Outlines Module 4: for ODE Part I: Basic Part II: Advanced Lehrstuhl Informatik V Winter 2007/2008 Part I: Basic 1 Direction Fields 2 Euler s Method Outlines Part I: Basic Part II: Advanced 3 Discretized
More informationLecture 6 Quantum Mechanical Systems and Measurements
Lecture 6 Quantum Mechanical Systems and Measurements Today s Program: 1. Simple Harmonic Oscillator (SHO). Principle of spectral decomposition. 3. Predicting the results of measurements, fourth postulate
More informationNew Material Section 1: Functions and Geometry occurring in engineering
New Material Section 1: Functions and Geometry occurring in engineering 1. Plotting Functions: Using appropriate software to plot the graph of a function Linear f(x) = mx+c Quadratic f(x) = Px +Qx+R Cubic
More informationFixed point iteration and root finding
Fixed point iteration and root finding The sign function is defined as x > 0 sign(x) = 0 x = 0 x < 0. It can be evaluated via an iteration which is useful for some problems. One such iteration is given
More informationNonconstant Coefficients
Chapter 7 Nonconstant Coefficients We return to second-order linear ODEs, but with nonconstant coefficients. That is, we consider (7.1) y + p(t)y + q(t)y = 0, with not both p(t) and q(t) constant. The
More informationResonance and response
Chapter 2 Resonance and response Last updated September 20, 2008 In this section of the course we begin with a very simple system a mass hanging from a spring and see how some remarkable ideas emerge.
More informationENGI 9420 Lecture Notes 1 - ODEs Page 1.01
ENGI 940 Lecture Notes - ODEs Page.0. Ordinary Differential Equations An equation involving a function of one independent variable and the derivative(s) of that function is an ordinary differential equation
More informationENGI 9420 Lecture Notes 4 - Stability Analysis Page Stability Analysis for Non-linear Ordinary Differential Equations
ENGI 940 Lecture Notes 4 - Stability Analysis Page 4.01 4. Stability Analysis for Non-linear Ordinary Differential Equations A pair of simultaneous first order homogeneous linear ordinary differential
More informationApplied Numerical Analysis
Applied Numerical Analysis Using MATLAB Second Edition Laurene V. Fausett Texas A&M University-Commerce PEARSON Prentice Hall Upper Saddle River, NJ 07458 Contents Preface xi 1 Foundations 1 1.1 Introductory
More informationPolynomial Functions. x n 2 a n. x n a 1. f x = a o. x n 1 a 2. x 0, , a 1
Polynomial Functions A polynomial function is a sum of multiples of an independent variable raised to various integer powers. The general form of a polynomial function is f x = a o x n a 1 x n 1 a 2 x
More informationn 1 f n 1 c 1 n+1 = c 1 n $ c 1 n 1. After taking logs, this becomes
Root finding: 1 a The points {x n+1, }, {x n, f n }, {x n 1, f n 1 } should be co-linear Say they lie on the line x + y = This gives the relations x n+1 + = x n +f n = x n 1 +f n 1 = Eliminating α and
More information