ESO 208A: Computational Methods in Engineering. Saumyen Guha
|
|
- Roger Lawson
- 5 years ago
- Views:
Transcription
1 ESO 208A: Computational Methods in Engineering Introduction, Error Analysis Saumyen Guha Department of Civil Engineering IIT Kanpur
2 What is Computational Methods or Numerical Methods in Engineering? Formulation of mathematical problems in such a way that numerical answers can be computed using arithmetic operations in a computer Computer can only perform: + - / All kinds of problems can be solved: linear and non-linear systems of equations; approximation and interpolation of data; differentiation and integration, ODE, PDE
3 What is Numerical Analysis? Mathematical method to analyze whether the solution obtained from a Numerical Method represents the solution of the original mathematical problem! A way to test for convergence! Convergence can be conditional or unconditional! A method cannot be used for a given problem without the analysis!
4 Example 1: Calculate the square root of 2. Mathematical Problem: x 2 = 2, x =? or Calculate the root of x 2 2 = 0 Square root of 2 (an irrational number) cannot be computed using simple arithmetic operations! Generate a Cauchy sequence that converges to the square root of 2. Some Numerical Methods: x n+1 = 2 x n x n+1 = 1 x 2 n + 2 x n x n+1 = x n+2 x n +1
5 Let s start all the methods with x 0 = 1 and compute for five iterations: x n+1 = 2 x n : x 1 = 2, x 2 = 1, x 3 = 2, x 4 = 1, x 5 = 2 x n+1 = 1 2 x n + 2 x n : x 1 = 1.5, x 2 = , x 3 = , x 4 = , x 5 = x n+1 = x n+2 x n +1 : x 1 = 1.5, x 2 = 1.4, x 3 = , x 4 = , x 5 = Could we have predicted this without having to perform computations?
6 Test for convergence of sequence (MTH 101): Sequence: x n+1 = 1 2 x n + 2 x n = 2x n x n+1 x n Since the root is real, x n Therefore, x n = 2x n x n+1 2 2x n x n+1 2, the sequence is bounded! for n 2, x n x n+1 = x n 1 2 x n x n 2 2 x n x n = 0, monotonically decreasing sequence! Monotonically decreasing sequence and bounded:- a Cauchy sequence that converges to the lower bound 2
7 Example 2: Solve the problem of the radioactive decay: dn dt = λn at t = 0, N = N 0 True Solution: N = N 0 e λt A Numerical Method: Euler Method (MTH 102) N i+1 = N i λhn i where, h = time step Δt Consider two different elements with λ = 0.1 and 2.2 Let us compare true analytical solutions with the numerical solutions for h = Δt = 1 for these two elements.
8 λ = 0.1 /day, N 0 = 10 6, h = Δt = 1, solution for 25 days There is some error but the numerical solution behaves like the true solution
9 λ = 2.2 /day, N 0 = 10 6, h = Δt = 1, solution for 25 days The error can grow to make the solution unacceptable! Numerical analysis could have told me this saving much time of programming and computation!
10 λ = 0.1 /day, N 0 = 10 6, varying h, solution for 25 days Numerical analysis could have told me this saving much time of programming and computation!
11 Take away message: Learning Numerical Analysis is as important as the Numerical Method for you to be able to apply the method for a given problem!! This is true irrespective of whether you are writing the program or using an existing program or package or software!
12 Errors and Error Analysis
13 Accuracy, Precision what are they? Accuracy: how closely a computed or measured value agrees with the True value opposite sense: inaccurate Precision: How closely individual computed or measured values agree with each other Opposite sense: imprecise
14 Define Error: True Value (a) = Approximate Value a + Error (ε) Absolute Error: ε = a a Relative Error: e = ε a = a a a Relative error is often expressed as (%) by multiplying (e) with 100. Absolute error can have sign as well as. If the error is computed with respect to the true value (if known), a prefix True is added. For an iterative process, the true value a is replaced with the previous iteration value and a prefix approximate is added. This is used for testing convergence of the iterative process.
15 Sources of Error in computation? Errors in the Input data: initial and boundary conditions, measured values of the parameters and constants in the model Round-off error: irrational numbers, product and division of two numbers, limited by the machine capability Truncation error: truncation of an infinite series, often arises in the design of the numerical method through approximation of the mathematical problem.
16 Error Analyses: Forward Error Analysis: Error in the Input Both computations are using the original Mathematical Model How an error in the given input propagates through the system model. (Robustness of the model) Backward Error Analysis: Error in the Output Computation using numerical algorithm Computation using mathematical problem Error in the Output Quantification of error resulting from interaction between round-off error and truncation error in the algorithm. (Robustness of the algorithm)
17 Forward Error Analysis: Single Variable Function: y = f(x). If an error is introduced in x, what is the error in y? x = x x y = y y = f x f x f x = f x + x = f x + xf x + x2 2! f x +.. Assuming the error to be small, the 2 nd and higher order terms are neglected. (a first order approximation!) y = f x f x xf x
18 Condition Number of the Problem (C p ): C p = Relative Error in y Relative Error in x = y y x x xf x f x = xf x x x f x Also: C p = As Δx 0, y y x = Τ x f x f x f x x = x Τ x f x f x+ x f x x C p = xf f x x C p < 1: problem is well-conditioned, error is attenuated C p > 1: problem is ill-conditioned, error is amplified C p = 1: neutral, error is translated
19 Examples of Forward Error Analysis and C p : Problem 1: y = e x ; y = xe x ; C p = x. The problem is well-conditioned for 0 x < 1; neutral at x = 1 and illconditioned for x > 1. Problem 2: Solve the following system of equations: x + αy = 1; αx + y = 0 Solving: x = 1 1 α 2 = x α ; x α = 2α 1 α 2 2 2α α 1 α C p = 2 2 2α 2 = 1 1 α 2 1 α 2 well-conditioned for α << 1 and ill-conditioned for α 1.
20 Forward Error Analysis: Function of Multiple Variables: y = f(x), where X is a vector, X = {x 0, x 1,.. x n }. If error is introduced in the x i s, what is the error in y? X = X X = f X = f X + x i n i=1 y = y y = f X f X x 0 x 0 x 1 x 1 = x n x n f ቤ x i An upper bound of y = σn i=1 X x 0 x 1 x n + HOT f σ n i=1 x i ቚ x i x i f x i ቚ X X
21 Bacward Error Analysis: Computation using numerical algorithm Computation using mathematical problem Error in the Output What is the perturbation required in the input in order to explain the error in the output if the computation is carried out by true mathematical function without any error. Hypothetical error in the Input computed using backward error analysis Error in the Output Both computations are using the original Mathematical Model
22 Floating point representation of a number = m b q m = mantissa; 1/b m 1 b = base; 2 for binary, 10 for decimal, 16 for hexadecimal q Q (set of rationals) If a machine (computer) rounds a number off to t decimal places: a = m 10 q ; a = m 10 q m m t Machine round-off unit(u) is the upper bound of the relative error in one round-off operation a a t 10 q a m 10 q t = u Condition Number of Algorithm (C a ): change necessary in the input data in order to explain the error in the final result expressed in terms of u.
23 Consider one floating point operation fl(x op y). op can be any of +, -,, /. By definition of u: fl x op y x op y x op y u Let s consider the op as : fl(x y) = x y(1 + δ) x y(1 + u) where δ u Example: A machine with t = 2, u = = 0.05 x = 0.30, y = 0.51, x y = 0.153; fl(x y) = 0.15 Relative error = ( )/0.153 = 0.02 u (= 0.05) For this operation: δ = -0.01; δ = 0.01 u (= 0.05)
24 Multiple Floating Point Operations: fl x 1 x 2 x 3 x n = x 1 x δ 1 x δ 2 x n 1 + δ n 1 δ i u for i = 1, 2, n 1 Relative error in the final computed value: e = fl x 1 x 2 x 3 x n x 1 x 2 x 3 x n x 1 x 2 x 3 x n = 1 + δ δ δ n u n 1 1 The quantity 1 + u n 1 1 may be approximated as 1.06(n-1)u for (n-1)u < 0.1
25 Example: Using a machine with 4-decimal place precision, t = 4, u = = Compute y = 1 + sin x 1 for x = 1 fl x = π = fl sin x = fl 1 + sin x = fl 1 + sin x = fl 1 + sin x 1 = True value of y using infinite precision is This is equivalent to performing the same computation in a machine with infinite precision with a starting x = Required relative change in x is ( )/ = Condition number of the algorithm is C a = / sin x If the algorithm is changed to y =, the same machine with 4-1+sin x+1 decimal place precision computes y = with C a = 0.4
26 Total Relative Error in the output: Recall: C p = Relative Error in the output Relative Error in the input Relative Error in the Output = C p Relative Error in the Input Relative Error in the Input has two components: User specified relative error in the input data = r (say) Error introduced due to truncation and round-off errors in the algorithm. Equivalent relative error in the input due to this is computed by backward error analysis as C a u Total relative error in the Input data = (r + C a u) Therefore, Relative Error in the Output = C p (r + C a u)
Numerical Methods FOR ENGINEERING AND SCIENCE SAUMYEN GUHA. Professor Department of Civil Engineering IIT Kanpur RAJESH SRIVASTAVA
Numerical Methods FOR ENGINEERING AND SCIENCE SAUMYEN GUHA Professor Department of Civil Engineering IIT Kanpur RAJESH SRIVASTAVA Professor Department of Civil Engineering IIT Kanpur Preface ix Brief Contents
More informationNotes on floating point number, numerical computations and pitfalls
Notes on floating point number, numerical computations and pitfalls November 6, 212 1 Floating point numbers An n-digit floating point number in base β has the form x = ±(.d 1 d 2 d n ) β β e where.d 1
More informationErrors. Intensive Computation. Annalisa Massini 2017/2018
Errors Intensive Computation Annalisa Massini 2017/2018 Intensive Computation - 2017/2018 2 References Scientific Computing: An Introductory Survey - Chapter 1 M.T. Heath http://heath.cs.illinois.edu/scicomp/notes/index.html
More informationJim Lambers MAT 610 Summer Session Lecture 2 Notes
Jim Lambers MAT 610 Summer Session 2009-10 Lecture 2 Notes These notes correspond to Sections 2.2-2.4 in the text. Vector Norms Given vectors x and y of length one, which are simply scalars x and y, the
More informationPowerPoints organized by Dr. Michael R. Gustafson II, Duke University
Part 1 Chapter 4 Roundoff and Truncation Errors PowerPoints organized by Dr. Michael R. Gustafson II, Duke University All images copyright The McGraw-Hill Companies, Inc. Permission required for reproduction
More informationFloating Point Number Systems. Simon Fraser University Surrey Campus MACM 316 Spring 2005 Instructor: Ha Le
Floating Point Number Systems Simon Fraser University Surrey Campus MACM 316 Spring 2005 Instructor: Ha Le 1 Overview Real number system Examples Absolute and relative errors Floating point numbers Roundoff
More informationLecture 7. Floating point arithmetic and stability
Lecture 7 Floating point arithmetic and stability 2.5 Machine representation of numbers Scientific notation: 23 }{{} }{{} } 3.14159265 {{} }{{} 10 sign mantissa base exponent (significand) s m β e A floating
More informationNotes for Chapter 1 of. Scientific Computing with Case Studies
Notes for Chapter 1 of Scientific Computing with Case Studies Dianne P. O Leary SIAM Press, 2008 Mathematical modeling Computer arithmetic Errors 1999-2008 Dianne P. O'Leary 1 Arithmetic and Error What
More informationFloating-point Computation
Chapter 2 Floating-point Computation 21 Positional Number System An integer N in a number system of base (or radix) β may be written as N = a n β n + a n 1 β n 1 + + a 1 β + a 0 = P n (β) where a i are
More informationArithmetic and Error. How does error arise? How does error arise? Notes for Part 1 of CMSC 460
Notes for Part 1 of CMSC 460 Dianne P. O Leary Preliminaries: Mathematical modeling Computer arithmetic Errors 1999-2006 Dianne P. O'Leary 1 Arithmetic and Error What we need to know about error: -- how
More informationToday s class. Numerical differentiation Roots of equation Bracketing methods. Numerical Methods, Fall 2011 Lecture 4. Prof. Jinbo Bi CSE, UConn
Today s class Numerical differentiation Roots of equation Bracketing methods 1 Numerical Differentiation Finite divided difference First forward difference First backward difference Lecture 3 2 Numerical
More informationChapter 1: Introduction and mathematical preliminaries
Chapter 1: Introduction and mathematical preliminaries Evy Kersalé September 26, 2011 Motivation Most of the mathematical problems you have encountered so far can be solved analytically. However, in real-life,
More informationEAD 115. Numerical Solution of Engineering and Scientific Problems. David M. Rocke Department of Applied Science
EAD 115 Numerical Solution of Engineering and Scientific Problems David M. Rocke Department of Applied Science Computer Representation of Numbers Counting numbers (unsigned integers) are the numbers 0,
More information1 ERROR ANALYSIS IN COMPUTATION
1 ERROR ANALYSIS IN COMPUTATION 1.2 Round-Off Errors & Computer Arithmetic (a) Computer Representation of Numbers Two types: integer mode (not used in MATLAB) floating-point mode x R ˆx F(β, t, l, u),
More informationChapter 1 Mathematical Preliminaries and Error Analysis
Numerical Analysis (Math 3313) 2019-2018 Chapter 1 Mathematical Preliminaries and Error Analysis Intended learning outcomes: Upon successful completion of this chapter, a student will be able to (1) list
More informationNumerical Algorithms. IE 496 Lecture 20
Numerical Algorithms IE 496 Lecture 20 Reading for This Lecture Primary Miller and Boxer, Pages 124-128 Forsythe and Mohler, Sections 1 and 2 Numerical Algorithms Numerical Analysis So far, we have looked
More informationIntroduction and mathematical preliminaries
Chapter Introduction and mathematical preliminaries Contents. Motivation..................................2 Finite-digit arithmetic.......................... 2.3 Errors in numerical calculations.....................
More informationLecture Notes 7, Math/Comp 128, Math 250
Lecture Notes 7, Math/Comp 128, Math 250 Misha Kilmer Tufts University October 23, 2005 Floating Point Arithmetic We talked last time about how the computer represents floating point numbers. In a floating
More informationTu: 9/3/13 Math 471, Fall 2013, Section 001 Lecture 1
Tu: 9/3/13 Math 71, Fall 2013, Section 001 Lecture 1 1 Course intro Notes : Take attendance. Instructor introduction. Handout : Course description. Note the exam days (and don t be absent). Bookmark the
More informationACM 106a: Lecture 1 Agenda
1 ACM 106a: Lecture 1 Agenda Introduction to numerical linear algebra Common problems First examples Inexact computation What is this course about? 2 Typical numerical linear algebra problems Systems of
More informationChapter 1 Error Analysis
Chapter 1 Error Analysis Several sources of errors are important for numerical data processing: Experimental uncertainty: Input data from an experiment have a limited precision. Instead of the vector of
More informationAn Introduction to Differential Algebra
An Introduction to Differential Algebra Alexander Wittig1, P. Di Lizia, R. Armellin, et al. 1 ESA Advanced Concepts Team (TEC-SF) SRL, Milan Dinamica Outline 1 Overview Five Views of Differential Algebra
More informationChapter 1 Computer Arithmetic
Numerical Analysis (Math 9372) 2017-2016 Chapter 1 Computer Arithmetic 1.1 Introduction Numerical analysis is a way to solve mathematical problems by special procedures which use arithmetic operations
More informationECS 231 Computer Arithmetic 1 / 27
ECS 231 Computer Arithmetic 1 / 27 Outline 1 Floating-point numbers and representations 2 Floating-point arithmetic 3 Floating-point error analysis 4 Further reading 2 / 27 Outline 1 Floating-point numbers
More informationINTRODUCTION TO COMPUTATIONAL MATHEMATICS
INTRODUCTION TO COMPUTATIONAL MATHEMATICS Course Notes for CM 271 / AMATH 341 / CS 371 Fall 2007 Instructor: Prof. Justin Wan School of Computer Science University of Waterloo Course notes by Prof. Hans
More informationMATH ASSIGNMENT 03 SOLUTIONS
MATH444.0 ASSIGNMENT 03 SOLUTIONS 4.3 Newton s method can be used to compute reciprocals, without division. To compute /R, let fx) = x R so that fx) = 0 when x = /R. Write down the Newton iteration for
More informationFLOATING POINT ARITHMETHIC - ERROR ANALYSIS
FLOATING POINT ARITHMETHIC - ERROR ANALYSIS Brief review of floating point arithmetic Model of floating point arithmetic Notation, backward and forward errors Roundoff errors and floating-point arithmetic
More informationBACHELOR OF COMPUTER APPLICATIONS (BCA) (Revised) Term-End Examination December, 2015 BCS-054 : COMPUTER ORIENTED NUMERICAL TECHNIQUES
No. of Printed Pages : 5 BCS-054 BACHELOR OF COMPUTER APPLICATIONS (BCA) (Revised) Term-End Examination December, 2015 058b9 BCS-054 : COMPUTER ORIENTED NUMERICAL TECHNIQUES Time : 3 hours Maximum Marks
More informationElements of Floating-point Arithmetic
Elements of Floating-point Arithmetic Sanzheng Qiao Department of Computing and Software McMaster University July, 2012 Outline 1 Floating-point Numbers Representations IEEE Floating-point Standards Underflow
More informationComputer Arithmetic. MATH 375 Numerical Analysis. J. Robert Buchanan. Fall Department of Mathematics. J. Robert Buchanan Computer Arithmetic
Computer Arithmetic MATH 375 Numerical Analysis J. Robert Buchanan Department of Mathematics Fall 2013 Machine Numbers When performing arithmetic on a computer (laptop, desktop, mainframe, cell phone,
More informationFLOATING POINT ARITHMETHIC - ERROR ANALYSIS
FLOATING POINT ARITHMETHIC - ERROR ANALYSIS Brief review of floating point arithmetic Model of floating point arithmetic Notation, backward and forward errors 3-1 Roundoff errors and floating-point arithmetic
More informationNumerical Methods - Lecture 2. Numerical Methods. Lecture 2. Analysis of errors in numerical methods
Numerical Methods - Lecture 1 Numerical Methods Lecture. Analysis o errors in numerical methods Numerical Methods - Lecture Why represent numbers in loating point ormat? Eample 1. How a number 56.78 can
More informationElements of Floating-point Arithmetic
Elements of Floating-point Arithmetic Sanzheng Qiao Department of Computing and Software McMaster University July, 2012 Outline 1 Floating-point Numbers Representations IEEE Floating-point Standards Underflow
More informationChapter 4 Number Representations
Chapter 4 Number Representations SKEE2263 Digital Systems Mun im/ismahani/izam {munim@utm.my,e-izam@utm.my,ismahani@fke.utm.my} February 9, 2016 Table of Contents 1 Fundamentals 2 Signed Numbers 3 Fixed-Point
More informationMathematical preliminaries and error analysis
Mathematical preliminaries and error analysis Tsung-Ming Huang Department of Mathematics National Taiwan Normal University, Taiwan September 12, 2015 Outline 1 Round-off errors and computer arithmetic
More informationNumerical Methods - Preliminaries
Numerical Methods - Preliminaries Y. K. Goh Universiti Tunku Abdul Rahman 2013 Y. K. Goh (UTAR) Numerical Methods - Preliminaries 2013 1 / 58 Table of Contents 1 Introduction to Numerical Methods Numerical
More informationHomework 2 Foundations of Computational Math 1 Fall 2018
Homework 2 Foundations of Computational Math 1 Fall 2018 Note that Problems 2 and 8 have coding in them. Problem 2 is a simple task while Problem 8 is very involved (and has in fact been given as a programming
More information2.2. Methods for Obtaining FD Expressions. There are several methods, and we will look at a few:
.. Methods for Obtaining FD Expressions There are several methods, and we will look at a few: ) Taylor series expansion the most common, but purely mathematical. ) Polynomial fitting or interpolation the
More informationMathematics for Engineers. Numerical mathematics
Mathematics for Engineers Numerical mathematics Integers Determine the largest representable integer with the intmax command. intmax ans = int32 2147483647 2147483647+1 ans = 2.1475e+09 Remark The set
More informationIntroductory Numerical Analysis
Introductory Numerical Analysis Lecture Notes December 16, 017 Contents 1 Introduction to 1 11 Floating Point Numbers 1 1 Computational Errors 13 Algorithm 3 14 Calculus Review 3 Root Finding 5 1 Bisection
More informationTheme 1: Solving Nonlinear Equations
Theme 1: Solving Nonlinear Equations Prof. Mapundi K. Banda (Tuks) WTW263 Semester II 1 / 22 Sources of Errors Finite decimal representation (Rounding): Finite decimal representation will be used to represent
More informationCME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 5. Ax = b.
CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 5 GENE H GOLUB Suppose we want to solve We actually have an approximation ξ such that 1 Perturbation Theory Ax = b x = ξ + e The question is, how
More informationMATHia Unit MATHia Workspace Overview TEKS
1 Linear Equations Solving Linear Equations Exploring Two-Step Equations Solving Multi-Step Equations Students use a balance tool to explore two-step equations. They use a general strategy to solve any
More information1 Backward and Forward Error
Math 515 Fall, 2008 Brief Notes on Conditioning, Stability and Finite Precision Arithmetic Most books on numerical analysis, numerical linear algebra, and matrix computations have a lot of material covering
More informationLies My Calculator and Computer Told Me
Lies My Calculator and Computer Told Me 2 LIES MY CALCULATOR AND COMPUTER TOLD ME Lies My Calculator and Computer Told Me See Section.4 for a discussion of graphing calculators and computers with graphing
More informationCompute the behavior of reality even if it is impossible to observe the processes (for example a black hole in astrophysics).
1 Introduction Read sections 1.1, 1.2.1 1.2.4, 1.2.6, 1.3.8, 1.3.9, 1.4. Review questions 1.1 1.6, 1.12 1.21, 1.37. The subject of Scientific Computing is to simulate the reality. Simulation is the representation
More informationIntroduction CSE 541
Introduction CSE 541 1 Numerical methods Solving scientific/engineering problems using computers. Root finding, Chapter 3 Polynomial Interpolation, Chapter 4 Differentiation, Chapter 4 Integration, Chapters
More informationMAT 460: Numerical Analysis I. James V. Lambers
MAT 460: Numerical Analysis I James V. Lambers January 31, 2013 2 Contents 1 Mathematical Preliminaries and Error Analysis 7 1.1 Introduction............................ 7 1.1.1 Error Analysis......................
More informationNUMERICAL METHODS C. Carl Gustav Jacob Jacobi 10.1 GAUSSIAN ELIMINATION WITH PARTIAL PIVOTING
0. Gaussian Elimination with Partial Pivoting 0.2 Iterative Methods for Solving Linear Systems 0.3 Power Method for Approximating Eigenvalues 0.4 Applications of Numerical Methods Carl Gustav Jacob Jacobi
More information1.5 First Order PDEs and Method of Characteristics
1.5. FIRST ORDER PDES AND METHOD OF CHARACTERISTICS 35 1.5 First Order PDEs and Method of Characteristics We finish this introductory chapter by discussing the solutions of some first order PDEs, more
More informationCHAPTER 3. Iterative Methods
CHAPTER 3 Iterative Methods As we have seen in the previous two chapters, even for problems, which are theoretically well understood, such as computing the square root, one cannot provide the perfect answer
More informationCS 450 Numerical Analysis. Chapter 9: Initial Value Problems for Ordinary Differential Equations
Lecture slides based on the textbook Scientific Computing: An Introductory Survey by Michael T. Heath, copyright c 2018 by the Society for Industrial and Applied Mathematics. http://www.siam.org/books/cl80
More informationNumber Systems III MA1S1. Tristan McLoughlin. December 4, 2013
Number Systems III MA1S1 Tristan McLoughlin December 4, 2013 http://en.wikipedia.org/wiki/binary numeral system http://accu.org/index.php/articles/1558 http://www.binaryconvert.com http://en.wikipedia.org/wiki/ascii
More informationAIMS Exercise Set # 1
AIMS Exercise Set #. Determine the form of the single precision floating point arithmetic used in the computers at AIMS. What is the largest number that can be accurately represented? What is the smallest
More informationTABLE OF CONTENTS INTRODUCTION, APPROXIMATION & ERRORS 1. Chapter Introduction to numerical methods 1 Multiple-choice test 7 Problem set 9
TABLE OF CONTENTS INTRODUCTION, APPROXIMATION & ERRORS 1 Chapter 01.01 Introduction to numerical methods 1 Multiple-choice test 7 Problem set 9 Chapter 01.02 Measuring errors 11 True error 11 Relative
More informationExample 1 Which of these functions are polynomials in x? In the case(s) where f is a polynomial,
1. Polynomials A polynomial in x is a function of the form p(x) = a 0 + a 1 x + a 2 x 2 +... a n x n (a n 0, n a non-negative integer) where a 0, a 1, a 2,..., a n are constants. We say that this polynomial
More informationNUMERICAL SOLUTION OF ODE IVPs. Overview
NUMERICAL SOLUTION OF ODE IVPs 1 Quick review of direction fields Overview 2 A reminder about and 3 Important test: Is the ODE initial value problem? 4 Fundamental concepts: Euler s Method 5 Fundamental
More informationErrors Intensive Computation
Errors Intensive Computation Annalisa Massini - 2015/2016 OVERVIEW Sources of Approimation Before computation modeling empirical measurements previous computations During computation truncation or discretization
More informationMath 471. Numerical methods Introduction
Math 471. Numerical methods Introduction Section 1.1 1.4 of Bradie 1.1 Algorithms Here is an analogy between Numerical Methods and Gastronomy: Calculus, Lin Alg., Diff. eq. Ingredients Algorithm Recipe
More informationRound-off error propagation and non-determinism in parallel applications
Round-off error propagation and non-determinism in parallel applications Vincent Baudoui (Argonne/Total SA) vincent.baudoui@gmail.com Franck Cappello (Argonne/INRIA/UIUC-NCSA) Georges Oppenheim (Paris-Sud
More informationMath 348: Numerical Methods with application in finance and economics. Boualem Khouider University of Victoria
Math 348: Numerical Methods with application in finance and economics Boualem Khouider University of Victoria Lecture notes: Last Updated September 2016 Contents 1 Basics of numerical analysis 10 1.1 Notion
More information1.1 COMPUTER REPRESENTATION OF NUM- BERS, REPRESENTATION ERRORS
Chapter 1 NUMBER REPRESENTATION, ERROR ANALYSIS 1.1 COMPUTER REPRESENTATION OF NUM- BERS, REPRESENTATION ERRORS Floating-point representation x t,r of a number x: x t,r = m t P cr, where: P - base (the
More informationCS 450 Numerical Analysis. Chapter 8: Numerical Integration and Differentiation
Lecture slides based on the textbook Scientific Computing: An Introductory Survey by Michael T. Heath, copyright c 2018 by the Society for Industrial and Applied Mathematics. http://www.siam.org/books/cl80
More informationMidterm Review. Igor Yanovsky (Math 151A TA)
Midterm Review Igor Yanovsky (Math 5A TA) Root-Finding Methods Rootfinding methods are designed to find a zero of a function f, that is, to find a value of x such that f(x) =0 Bisection Method To apply
More information4.1 Exponential Functions
Graduate T.A. Department of Mathematics Dynamical Systems and Chaos San Diego State University April 9, 211 Definitions The functions that involve some combinations of basic arithmetic operations, powers,
More informationIntroduction to Scientific Computing Languages
1 / 19 Introduction to Scientific Computing Languages Prof. Paolo Bientinesi pauldj@aices.rwth-aachen.de Numerical Representation 2 / 19 Numbers 123 = (first 40 digits) 29 4.241379310344827586206896551724137931034...
More informationBinary floating point
Binary floating point Notes for 2017-02-03 Why do we study conditioning of problems? One reason is that we may have input data contaminated by noise, resulting in a bad solution even if the intermediate
More informationIntroduction to Initial Value Problems
Chapter 2 Introduction to Initial Value Problems The purpose of this chapter is to study the simplest numerical methods for approximating the solution to a first order initial value problem (IVP). Because
More informationNumbers. Dr Hammadi Nait-Charif. Senior Lecturer Bournemouth University United Kingdom
Numbers Dr Hammadi Nait-Charif Senior Lecturer Bournemouth University United Kingdom hncharif@bournemouth.ac.uk http://nccastaff.bmth.ac.uk/hncharif/mathscgs/maths.html Dr Hammadi Nait-Charif (BU, UK)
More informationCHAPTER 1 REAL NUMBERS KEY POINTS
CHAPTER 1 REAL NUMBERS 1. Euclid s division lemma : KEY POINTS For given positive integers a and b there exist unique whole numbers q and r satisfying the relation a = bq + r, 0 r < b. 2. Euclid s division
More informationMathematics Pacing. Instruction: 9/7/17 10/31/17 Assessment: 11/1/17 11/8/17. # STUDENT LEARNING OBJECTIVES NJSLS Resources
# STUDENT LEARNING OBJECTIVES NJSLS Resources 1 Describe real-world situations in which (positive and negative) rational numbers are combined, emphasizing rational numbers that combine to make 0. Represent
More informationChapter 1 Mathematical Preliminaries and Error Analysis
Chapter 1 Mathematical Preliminaries and Error Analysis Per-Olof Persson persson@berkeley.edu Department of Mathematics University of California, Berkeley Math 128A Numerical Analysis Limits and Continuity
More informationLecture Notes to Accompany. Scientific Computing An Introductory Survey. by Michael T. Heath. Chapter 9
Lecture Notes to Accompany Scientific Computing An Introductory Survey Second Edition by Michael T. Heath Chapter 9 Initial Value Problems for Ordinary Differential Equations Copyright c 2001. Reproduction
More informationAnalysis of Finite Wordlength Effects
Analysis of Finite Wordlength Effects Ideally, the system parameters along with the signal variables have infinite precision taing any value between and In practice, they can tae only discrete values within
More informationApplied Mathematics 205. Unit 0: Overview of Scientific Computing. Lecturer: Dr. David Knezevic
Applied Mathematics 205 Unit 0: Overview of Scientific Computing Lecturer: Dr. David Knezevic Scientific Computing Computation is now recognized as the third pillar of science (along with theory and experiment)
More informationSeunghee Ye Ma 8: Week 2 Oct 6
Week 2 Summary This week, we will learn about sequences and real numbers. We first define what we mean by a sequence and discuss several properties of sequences. Then, we will talk about what it means
More informationIntroduction to Finite Di erence Methods
Introduction to Finite Di erence Methods ME 448/548 Notes Gerald Recktenwald Portland State University Department of Mechanical Engineering gerry@pdx.edu ME 448/548: Introduction to Finite Di erence Approximation
More information1 Floating point arithmetic
Introduction to Floating Point Arithmetic Floating point arithmetic Floating point representation (scientific notation) of numbers, for example, takes the following form.346 0 sign fraction base exponent
More informationMATH Dr. Halimah Alshehri Dr. Halimah Alshehri
MATH 1101 haalshehri@ksu.edu.sa 1 Introduction To Number Systems First Section: Binary System Second Section: Octal Number System Third Section: Hexadecimal System 2 Binary System 3 Binary System The binary
More informationAn Introduction to Numerical Analysis. James Brannick. The Pennsylvania State University
An Introduction to Numerical Analysis James Brannick The Pennsylvania State University Contents Chapter 1. Introduction 5 Chapter 2. Computer arithmetic and Error Analysis 7 Chapter 3. Approximation and
More informationNUMERICAL METHODS. x n+1 = 2x n x 2 n. In particular: which of them gives faster convergence, and why? [Work to four decimal places.
NUMERICAL METHODS 1. Rearranging the equation x 3 =.5 gives the iterative formula x n+1 = g(x n ), where g(x) = (2x 2 ) 1. (a) Starting with x = 1, compute the x n up to n = 6, and describe what is happening.
More informationCSE 1400 Applied Discrete Mathematics Definitions
CSE 1400 Applied Discrete Mathematics Definitions Department of Computer Sciences College of Engineering Florida Tech Fall 2011 Arithmetic 1 Alphabets, Strings, Languages, & Words 2 Number Systems 3 Machine
More informationFall 2014 MAT 375 Numerical Methods. Numerical Differentiation (Chapter 9)
Fall 2014 MAT 375 Numerical Metods (Capter 9) Idea: Definition of te derivative at x Obviuos approximation: f (x) = lim 0 f (x + ) f (x) f (x) f (x + ) f (x) forward-difference formula? ow good is tis
More informationRound-off Errors and Computer Arithmetic - (1.2)
Round-off Errors and Comuter Arithmetic - (.). Round-off Errors: Round-off errors is roduced when a calculator or comuter is used to erform real number calculations. That is because the arithmetic erformed
More informationWE SAY THAT A SQUARE ROOT RADICAL is simplified, or in its simplest form, when the radicand has no square factors.
SIMPLIFYING RADICALS: 12 th Grade Math & Science Summer Packet WE SAY THAT A SQUARE ROOT RADICAL is simplified, or in its simplest form, when the radicand has no square factors. A radical is also in simplest
More informationHow do computers represent numbers?
How do computers represent numbers? Tips & Tricks Week 1 Topics in Scientific Computing QMUL Semester A 2017/18 1/10 What does digital mean? The term DIGITAL refers to any device that operates on discrete
More informationLecture 5: Random numbers and Monte Carlo (Numerical Recipes, Chapter 7) Motivations for generating random numbers
Lecture 5: Random numbers and Monte Carlo (Numerical Recipes, Chapter 7) Motivations for generating random numbers To sample a function in a statistically controlled manner (i.e. for Monte Carlo integration)
More informationNumerical Differentiation & Integration. Numerical Differentiation III
Numerical Differentiation & Integration Numerical Differentiation III Numerical Analysis (9th Edition) R L Burden & J D Faires Beamer Presentation Slides prepared by John Carroll Dublin City University
More informationApplications of Mathematics MA 794
Foreword Applications of Mathematics MA 794 N. Chernov and I. Knowles In this course, we will discuss various applications of mathematics in sciences, industry, medicine and business. The main objective
More informationAMS 147 Computational Methods and Applications Lecture 17 Copyright by Hongyun Wang, UCSC
Lecture 17 Copyright by Hongyun Wang, UCSC Recap: Solving linear system A x = b Suppose we are given the decomposition, A = L U. We solve (LU) x = b in 2 steps: *) Solve L y = b using the forward substitution
More informationChapter 4 No. 4.0 Answer True or False to the following. Give reasons for your answers.
MATH 434/534 Theoretical Assignment 3 Solution Chapter 4 No 40 Answer True or False to the following Give reasons for your answers If a backward stable algorithm is applied to a computational problem,
More informationScientific Computing: An Introductory Survey
Scientific Computing: An Introductory Survey Chapter 9 Initial Value Problems for Ordinary Differential Equations Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign
More informationNumerical Methods in Physics and Astrophysics
Kostas Kokkotas 2 November 6, 2007 2 kostas.kokkotas@uni-tuebingen.de http://www.tat.physik.uni-tuebingen.de/kokkotas Kostas Kokkotas 3 Error Analysis Definition : Suppose that x is an approximation to
More informationNumerical Analysis. Yutian LI. 2018/19 Term 1 CUHKSZ. Yutian LI (CUHKSZ) Numerical Analysis 2018/19 1 / 41
Numerical Analysis Yutian LI CUHKSZ 2018/19 Term 1 Yutian LI (CUHKSZ) Numerical Analysis 2018/19 1 / 41 Reference Books BF R. L. Burden and J. D. Faires, Numerical Analysis, 9th edition, Thomsom Brooks/Cole,
More informationChapter 1. Numerical Errors. Module No. 1. Errors in Numerical Computations
Numerical Analysis by Dr. Anita Pal Assistant Professor Department of Mathematics National Institute of Technology Durgapur Durgapur-73209 email: anita.buie@gmail.com . Chapter Numerical Errors Module
More informationDay 6: 6.4 Solving Polynomial Equations Warm Up: Factor. 1. x 2-2x x 2-9x x 2 + 6x + 5
Day 6: 6.4 Solving Polynomial Equations Warm Up: Factor. 1. x 2-2x - 15 2. x 2-9x + 14 3. x 2 + 6x + 5 Solving Equations by Factoring Recall the factoring pattern: Difference of Squares:...... Note: There
More informationIntroduction to Numerical Analysis
Introduction to Numerical Analysis S. Baskar and S. Sivaji Ganesh Department of Mathematics Indian Institute of Technology Bombay Powai, Mumbai 400 076. Introduction to Numerical Analysis Lecture Notes
More informationMath 128A Spring 2003 Week 12 Solutions
Math 128A Spring 2003 Week 12 Solutions Burden & Faires 5.9: 1b, 2b, 3, 5, 6, 7 Burden & Faires 5.10: 4, 5, 8 Burden & Faires 5.11: 1c, 2, 5, 6, 8 Burden & Faires 5.9. Higher-Order Equations and Systems
More informationq t = F q x. (1) is a flux of q due to diffusion. Although very complex parameterizations for F q
! Revised Tuesday, December 8, 015! 1 Chapter 7: Diffusion Copyright 015, David A. Randall 7.1! Introduction Diffusion is a macroscopic statistical description of microscopic advection. Here microscopic
More information2tdt 1 y = t2 + C y = which implies C = 1 and the solution is y = 1
Lectures - Week 11 General First Order ODEs & Numerical Methods for IVPs In general, nonlinear problems are much more difficult to solve than linear ones. Unfortunately many phenomena exhibit nonlinear
More information