Umea University Report UMINF Department of Computing Science ISSN S Umea January 21, 1997 Sweden Algorithms and Software for th
|
|
- Curtis Hart
- 5 years ago
- Views:
Transcription
1 Umea University Report UMINF Department of Computing Science ISSN S Umea January 21, 1997 Sweden Algorithms and Software for the Computation of Parameters Occurring in ODE-models Licentiate Thesis Gunilla Wikstrom Submitted to the Department of Computing Science at Umea University in partial fulllment of the requirements for the degree of licentiate of technology.
2 .
3 Abstract One way to describe dynamic systems is to use mathematical models in the form of systems of ordinary dierential equations. These models contain parameters, that must be estimated to obtain the best t to the given data. Nonlinear parameter estimation is often a tedious task, due to integration of dierential equations and calculation of derivatives for the optimization part. It is risky, too, because of the existence of several local minima of the relevant optimization problem. However, it is possible to get around some problems by using short cut methods, i.e. simplied methods that result in approximate parameters. If these approximate parameters are not good enough, they can be used as initial values for more complicated estimation methods, hopefully resulting in more accurate results. When the model parameters appear linearly in the chosen dynamic model, e.g. in applications such as chemical kinetics, theoretical biology and ecology, it is possible to estimate approximate parameters both directly and iteratively. The rst approach includes the use of given data in combination with quadrature formulas. This results in linear least squares problems that can be solved, without iteration, for approximate model parameters. An alternative is to treat the problem as a separable nonlinear least squares problem. In this case, both the dependent variables and the model parameters are unknown. This approach is iterative, but the given data can be used as initial values. In this thesis, approximate methods based on the two previously mentioned approaches are tested and analyzed. It is shown that the direct type of short cut methods, i.e. without iteration, works well and is in agreement with theory in the case of negligible measurement errors and equally spaced values of the independent variable. The dierential equations can be transformed into dierence equations in two ways. Either by using the given model and approximation of derivatives or by integration and approximation of integrals. According to analysis, the latter way is to prefer when errors in the data are dominating. Smoothing can be used to reduce the inuence of errors in the data. However, for these types of short cut methods tests show that the type of cubic smoothing splines used deteriorate the results when truncation errors dominate. By regarding the discretized problem as a constrained separable nonlinear least squares problem, a more advanced approximate method is proposed and it is shown that the results of this iterative method are improved compared to those of the previously mentioned less advanced approximate methods. Furthermore, a Matlab toolbox is developed that can be combined to perform dierent types of tasks: simulation, generation of simulated data, sensitivity analysis, parameter estimation from data (real or generated), statistical analysis of the parameters. Key words: parameter estimation, systems of ordinary dierential equations, short cut methods, linear and separable nonlinear least squares problems, Matlab toolbox (for nonlinear least squares).
4 Short summary in Swedish Modeller, grundade pa matematiska och experimentella principer, ar ett satt att forsoka forsta och beskriva saker i var omgivning. Konstruktionen av denna typ av modeller inkluderar era delmoment, tex forsoksplanering, val av lamplig modellstruktur, numerisk behandling, analys av resultat. I denna rapport behandlas det numeriska delmomentet, dvs hur man pa ett sa bra satt som mojligt ska anvanda datorn som hjalpmedel vid matematiska berakningar samt fa en uppfattning om hur stora fel anvandandet av detta hjalpmedel ger upphov till. De matematiska modeller som studeras ar av generell struktur, dvs de innehaller obekanta parametrar vilka maste bestammas for att man ska fa en praktiskt anvandbar modell motsvarande en specik tillampning. Genom att anpassa den generella modellen till information om den specika tillampningen, dvs valja parametrar sa att skillnaden mellan den generella modellen och motsvarande matdata blir sa liten som mojligt, kan en anvandbar modell bestammas. Tyvarr ar det ibland svart att bestamma de \basta" parametrarna bland ett ertal \acceptabla" dito. Dessutom kan berakningarna, mha dator, av de valda matematiska modellerna vara komplicerade samt resurskravande. I denna rapport studeras darfor satt att komma till ratta med dessa problem. Komplicerade metoder forenklas, vilket som resultat ger approximativa parametrar och darmed approximativa modeller. Ibland kan dock dessa approximativa modeller vara tillrackligt bra, och om inte, kan de anvandas som komplement till mera komplicerade metoder sa att mojligheten att bestamma \ratt" parametrar, och darmed modell, okar samt att tidsatgangen for detta reduceras. Vidare presenteras programvara, innehallande bade forenklade samt mera komplicerade metoder, med vars hjalp man interaktivt kan losa den ovan beskrivna problemtypen.
5 Introduction and Summary v Introduction In applied science it is common to describe dynamic systems by mathematical models in the form of systems of dierential equations (ODEs). These models may contain parameters, that must be estimated to obtain the best t to the given data. The construction of these types of models includes dierent parts, e.g. design of experiments, choice of model structure, numerical treatment and analysis of results. This thesis focuses on the numerical treatment of the problem. Examples of approximate methods, or so called short cut methods, in the case where all parameters enter nonlinearly in the model, can be found in [3]. If some of the parameters enter linearly, then the method described by [5] can be used to reduce the parameter space. Short cut methods are particularly attractive when all the parameters enter linearly in the model, because then the approximate parameter values can be found without iteration, see [2] and [6]. For the type of short cut methods to be studied in this thesis, the model is linear in the parameters. Moreover, the ODEs are approximated by quadrature formulas, resulting in dierence equations. The sum of squared dierences, between the approximate model values and corresponding measurements, is minimized. When both parameters and dependent variables are treated as unknowns, a separable nonlinear least squares (LSQ) problem has to be solved by iteration and the given data can be used as initial values. If only the parameters are considered to be unknown, corresponding approximate values can be found without iteration by solving a linear LSQ problem. This thesis presents some results of a combined research project between the Department of Computing Science, Umea University and the Department of Numerical Analysis and Computing Science, Royal Institute of Technology. As a result, a Matlab toolbox exists called DIFFPAR (DIFFerential equations with unknown PA- Rameters), [1]. This toolbox has now been extended, with a graphical user interface and short cut methods. Summary of papers This thesis consists of four papers. Linear appearance of parameters in the model is assumed in the rst three papers. A special kind of short cut methods, resulting in linear LSQ problems, is analyzed and tested in the rst two papers. In the rst paper, measurement errors are assumed to be negligible and the independent variable equally spaced. In the second paper, both uniformly and normally distributed errors are treated. The third paper presents a short cut method that includes a solution of separable nonlinear LSQ problems. Finally, in the fourth paper, a brief manual for the toolbox DIFFPAR is presented. This toolbox can also be used to solve problems without the restriction of linear appearance of parameters in the model. Scalars are denoted by lower-case letters, vectors by lower-case bold type letters and matrices by upper-case bold type letters.
6 vi Paper II Paper I & II Consider the following parameter estimation problem min k;y(t;k) 1 2 MX (~y i? y(t i ; k)) T W i (~y i? y(t i ; k)) i=1 (1) s:t: _y(t; k) = G(t; y(t)) k y(t0) = y 0 where t is the independent variable. The dependent variable, y(t; k), satises the model at time t. Smoothed or nonsmoothed given data at time t i is denoted by ~y i and W i is diagonal weight matrices with nonnegative elements, where i = 1; : : : ; M. The parameter vector is denoted as k and G(t; y(t)) is a matrix-valued function. By discretization of the ODE-model, e.g. approximate problem is given as min k;y s:t: MX 1 (~y i? y i ) T W i (~y i? y i ) 2 i=1 y i = y 0 + H global;i k = y i?1 + H local;i k by using the Trapeziodal rule, an (2) where y T = (y 1 T ; : : : ; y T M ) is an approximate numerical solution to the constraint. The matrices R H global;i and H local;i are approximations, by use of given data, of the t integrals i R G(; y())d and i G(; y())d; i = 1; : : : ; M. t0 t t i?1 Since H in general is nonlinear in y, because G(t; y(t)) is a function of y(t), we are dealing with a nonlinear parameter estimation problem. However, the purpose of the study in paper I & II is to nd approximate values for the parameters by solving a linear LSQ problem. This is possible to do, when the parameter k enters linearly in the chosen model, by Taylor expansion of the approximate constraint and use of given data. However, these approximations introduce both truncation errors and errors due to errors in the data. In paper I, the eect of truncation errors is studied when errors in the data are assumed to be negligible. It is shown that the two dierent approaches, i.e. \local" and \global" integration by quadrature, give results in agreement with theory. In paper II, also errors in the data are included in the analysis. As a result, it is shown that the \global" approach is to prefer, due to cancellation eects, and that this formulation better corresponds to the original problem (1). It is also shown, by computer simulations, that the use of smoothing, to reduce the eect of errors in the data, is almost negligible when errors in data dominate. When the truncation errors dominate, the special kind of smoothing studied, should not be used. However, when neither of the two types of errors dominate, smoothing can have a positive eect.
7 Introduction and Summary vii Paper III By regarding the discretized problem (2) as a constrained separable nonlinear LSQ problem, when both the parameter k and the dependent variable y are considered unknown, it is possible to construct more advanced short cut methods. In this paper a modied version of L. Kaufman's, [4], algoritm for constrained nonlinear separable LSQ problems is suggested. It is shown that the proposed approximate method works well and is in agreement with theory under \nice" circumstances and satisfyingly under \real" circumstances. Moreover, the results of this method are better than those of the less advanced methods analyzed in paper I & II. Finally, some further improvements and extensions are suggested for the iterative short cut method. Paper IV The toolbox DIF F P AR handles more general problems than (1). It uses the ODEmodel, _y(t; k) = f(t; y(t; k)), and the initial values, y(t0) = y 0, do not have to be exactly known. The toolbox is based on the Gauss-Newton method with local regularization and can handle both non-sti and sti ODE-systems. It also has facilities for 1) iteration in logarithmated values of the parameters (implicit positivity constraint) 2) selection of which parameters that should be estimated 3) giving dierent weights for the measurements 4) handling the situation when the data for some components are missing and 5) facilities for nding initial values for the iteration process (when the parameter vector enters linearly in the model). The graphical user interface (GUI) is based on Matlab's handle graphics, and is mainly coded as one function with separate switches or cases that create user interface elements and dene callbacks. Acknowledgement I am most grateful to Prof. Per-Ake Wedin, my advisor, for giving me the possibility to become a graduate student and for his and Lennart Edsberg's ideas, encouragement and support. I would also like to thank those whom I have had interesting and fruitful discussions with and my family and friends for making me think about other things besides my graduate studies. References [1] Edsberg L. and Wedin P-A. Numerical Tools for Parameter Estimation in ODEsystems, Optimization Methods and Software, Vol. 6, pp , 1995 [2] Foss S. D. Estimates of Chemical Kinetic Rate Constants by Numerical Integration, Chemical Engineering Science, Vol. 26, pp , 1971
8 viii Paper II [3] Hosten L. A. A comparative study of short cut procedures for parameter estimation in dierential equations, Computers & Chemical Engineering, Vol. 3, pp , 1979 [4] Kaufman L. and Pereyra V. A method for separable nonlinear least squares problems with separable nonlinear equality constraints, pp , SIAM J. Numer. Anal., 15, 1978 [5] Lawton W. H. and Sylvestre E. A. Elimination of Linear Parameters in Nonlinear Regression, Technometrics, Vol. 13, pp , 1971 [6] Swartz J. and Bremermann H. Discussion of Parameter Estimation in Biological Modeling: Algorithms for Estimation and Evaluation of the Estimates, Journal of Mathematical Biology, Vol. 1, pp , 1975 "Although this may seem a paradox, all exact science is dominated by the idea of approximation.". - Bertrand Russel
MODELING OF ROCK GROUTING IN SATURATED VARIABLE APERTURE FRACTURES Injekteringsmodellering av vattenfyllda bergsprickor med varierande apertur
MODELING OF ROCK GROUTING IN SATURATED VARIABLE APERTURE FRACTURES Injekteringsmodellering av vattenfyllda bergsprickor med varierande apertur Liangchao Zou, Division of resources, energy and infrastructure,
More informationProject: Vibration Damping
Mekanik GK för I (FMEA10) 2018 Project: Vibration Damping Project team: Name: Personal id-number: Mekanik www.mek.lth.se. 1 Project: Vibration damping Project Specification 1. Introduction In this project
More informationAutomatic Control II: Summary and comments
Automatic Control II: Summary and comments Hints for what is essential to understand the course, and to perform well at the exam. You should be able to distinguish between continuous-time (c-t) and discrete-time
More informationMulti-Adaptive Galerkin Methods for ODEs
Multi-Adaptive Galerkin Methods for ODEs ANDERS LOGG Licentiatuppsats i tillämpad matematik som presenteras vid seminarium i sal HA2 den 6 juni 2001, klockan 13.15. Diskussionsledare är Professor Gustaf
More informationModeling & Simulation 2018, Fö 1
Modeling & Simulation 2018, Fö 1 Claudio Altafini Automatic Control, ISY Linköping University, Sweden Course information Lecturer & examiner Claudio Altafini (claudio.altafini@liu.se) Teaching assistants
More informationComputational Fluid Dynamics F7018T. Part II: Finite volume methods
Computational Fluid Dynamics F7018T Part II: Finite volume methods Questions to be answered Why numerical solutions of fluid mechanical problems? What is CFD? Why is it wrong to compare CFD with FEM? Can
More informationGravitationsfält. Uppdaterad: [1] Gravitation ett märkligt fenomen [2] Gravitationsfält [3] Gravitationsfält
Gravitationsfält Uppdaterad: 180112 [1] Gravitation ett märkligt fenomen [2] Gravitationsfält [3] Gravitationsfält Har jag använt någon bild som jag inte får använda? Låt mig veta så tar jag bort den.
More informationP Swedish National Seismic Network (SNSN) A short report on recorded earthquakes during the third quarter of the year 2006
P-06-235 Swedish National Seismic Network (SNSN) A short report on recorded earthquakes during the third quarter of the year 2006 Reynir Böðvarsson Uppsala University, Department of Earth Sciences October
More informationP Swedish National Seismic Network (SNSN) A short report on recorded earthquakes during the second quarter of the year 2007
P-07-163 Swedish National Seismic Network (SNSN) A short report on recorded earthquakes during the second quarter of the year 2007 Reynir Böðvarsson Uppsala University, Department of Earth Sciences July
More informationP Swedish National Seismic Network (SNSN) A short report on recorded earthquakes during the third quarter of the year 2009
P-09-61 Swedish National Seismic Network (SNSN) A short report on recorded earthquakes during the third quarter of the year 2009 Reynir Böðvarsson Uppsala University, Department of Earth Sciences October
More informationOutcome regression methods in causal inference: The difference LASSO and selection of effect modifiers
Outcome regression methods in causal inference: The difference LASSO and selection of effect modifiers Moa Edin Master thesis, 15 hp One Year Master Thesis, 15 hp Spring term 2018 Abstract In causal inference,
More informationÖvningar i FUNKTIONALANALYS
Matematiska vetenskaper 1. Consider the space X = C 1 [0, 1] of continuously dierentiable functions on [0, 1] with one-sided derivatives at the endpoints. Show that X is not a Banach spaces if it is given
More informationVibration, stöt och tillståndskontroll Ordlista (ISO 2041:2009, IDT)
SVENSK STANDARD SS-ISO 2041:2009 Fastställd/Approved: 2009-09-14 Publicerad/Published: 2009-10-13 Utgåva/Edition: 3 Språk/Language: engelska/english ICS: 01.040.17; 17.160 Vibration, stöt och tillståndskontroll
More informationModeling & Simulation 2017, Fö 1
Modeling & Simulation 2017, Fö 1 Claudio Altafini Automatic Control, ISY Linköping University, Sweden Course information Lecturer & examiner Claudio Altafini (claudio.altafini@liu.se) Teaching assistants
More informationExamining Handovers in a Telecommunications Network Using Markov Chains and Dissimilarity Matrices
DEGREE PROJECT IN MATHEMATICS, SECOND CYCLE, 30 CREDITS STOCKHOLM, SWEDEN 2018 Examining Handovers in a Telecommunications Network Using Markov Chains and Dissimilarity Matrices PONTUS RESARE KTH ROYAL
More informationExempel variationsräkning 2, SI1142 Fysikens matematiska metoder, vt08.
Fysik KTH Exempel variationsräkning 2, SI1142 Fysikens matematiska metoder, vt8. These problems demonstrate various applications of variational calculus as used in physics. Problems (1) (3) illustrate
More informationP Swedish National Seismic Network (SNSN) A short report on recorded earthquakes during the second quarter of the year 2011
P-11-35 Swedish National Seismic Network (SNSN) A short report on recorded earthquakes during the second quarter of the year 2011 Reynir Böðvarsson Uppsala University, Department of Earth Sciences July
More informationTaylor series based nite dierence approximations of higher-degree derivatives
Journal of Computational and Applied Mathematics 54 (3) 5 4 www.elsevier.com/locate/cam Taylor series based nite dierence approximations of higher-degree derivatives Ishtiaq Rasool Khan a;b;, Ryoji Ohba
More information1. For which values of the parameters α and β has the linear system. periodic solutions? Which are the values if the period equals 4π?
MÄLARDALEN UNIVERSITY School of Education, Culture and Communication Department of Applied Mathematics Examiner: Lars-Göran Larsson EXAMINATION IN MATHEMATICS MAA316 Differential Equations, foundation
More informationEXAMINATION IN TSRT14 SENSOR FUSION
EXAMINATION IN TSRT14 SENSOR FUSION ROOM: ISY:s computer rooms TIME: 2015-06-03 at 14:00 18:00 COURSE: TSRT14 Sensor Fusion PROVKOD: DAT1 DEPARTMENT: ISY NUMBER OF EXERCISES: 4 RESPONSIBLE TEACHER: Gustaf
More informationCS 450 Numerical Analysis. Chapter 8: Numerical Integration and Differentiation
Lecture slides based on the textbook Scientific Computing: An Introductory Survey by Michael T. Heath, copyright c 2018 by the Society for Industrial and Applied Mathematics. http://www.siam.org/books/cl80
More informationTR Technical Report. Buffer homogenisation, status report. Ann Dueck, Reza Goudarzi, Lennart Börgesson Clay Technology AB.
Technical Report TR-12-2 Buffer homogenisation, status report Ann Dueck, Reza Goudarzi, Lennart Börgesson Clay Technology AB October 211 Svensk Kärnbränslehantering AB Swedish Nuclear Fuel and Waste Management
More informationShannon dekomposition
Shannon dekomposition Claude Shannon matematiker/elektrotekniker 96 William Sandqvist illiam@kth.se ÖH 8.6 Visa hur en 4-to- multipleor kan användas som funktionsgenerator för att te. Generera OR-funktionen.
More informationMultiscale timestepping technique for MD RAJIBUL ISLAM
Multiscale timestepping technique for ODEs and PDEs MD RAJIBUL ISLAM Master of Science Thesis Stockholm, Sweden 2014 Multiscale timestepping technique for ODEs and PDEs MD RAJIBUL ISLAM Master s Thesis
More informationDiscovery of Neptune
DEGREE PROJECT IN TECHNOLOGY, FIRST CYCLE, 15 CREDITS STOCKHOLM, SWEDEN 2018 Discovery of Neptune GUSTAV ERIKSSON KEVIN GARCIA MARTIN KTH ROYAL INSTITUTE OF TECHNOLOGY SCHOOL OF ENGINEERING SCIENCES EXAMENSARBETE
More informationEvaluating model selection criteria for nuisance models in causal inference
Evaluating model selection criteria for nuisance models in causal inference (when the true models are finite mixtures) Samuel Hellman 2016-06-21 Student Vt 2016 Examensarbete, 15 hp Magisteruppsats i statistik,
More informationCS 257: Numerical Methods
CS 57: Numerical Methods Final Exam Study Guide Version 1.00 Created by Charles Feng http://www.fenguin.net CS 57: Numerical Methods Final Exam Study Guide 1 Contents 1 Introductory Matter 3 1.1 Calculus
More informationMATHEMATICAL METHODS INTERPOLATION
MATHEMATICAL METHODS INTERPOLATION I YEAR BTech By Mr Y Prabhaker Reddy Asst Professor of Mathematics Guru Nanak Engineering College Ibrahimpatnam, Hyderabad SYLLABUS OF MATHEMATICAL METHODS (as per JNTU
More informationNumerical Methods for Engineers
Numerical Methods for Engineers SEVENTH EDITION Steven C Chopra Berger Chair in Computing and Engineering Tufts University Raymond P. Canal Professor Emeritus of Civil Engineering of Michiaan University
More informationSolutions Preliminary Examination in Numerical Analysis January, 2017
Solutions Preliminary Examination in Numerical Analysis January, 07 Root Finding The roots are -,0, a) First consider x 0 > Let x n+ = + ε and x n = + δ with δ > 0 The iteration gives 0 < ε δ < 3, which
More informationFysik 1 Kompendium: Del 2 Standard Modellen samt Ljus
Fysik 1 Kompendium: Del 2 Standard Modellen samt Ljus Klass: Na2 Lärare: VT14 Relativitet: Heureka Kapitel 13 (s.282-291) samt Ergo 393-401 Formel Skriv ner här alla formel som du kommer i kontakt med
More informationNumerical Methods of Approximation
Contents 31 Numerical Methods of Approximation 31.1 Polynomial Approximations 2 31.2 Numerical Integration 28 31.3 Numerical Differentiation 58 31.4 Nonlinear Equations 67 Learning outcomes In this Workbook
More informationEXAM IN MODELING AND SIMULATION (TSRT62)
EXAM IN MODELING AND SIMULATION (TSRT62) SAL: ISY:s datorsalar TID: Friday 5th January 2018, kl. 8.00 12.00 KURS: TSRT62 Modeling and Simulation PROVKOD: DAT1 INSTITUTION: ISY ANTAL UPPGIFTER: 5 ANTAL
More informationDeskription. Exempel 1. Exempel 1 (lösning) Normalfördelningsmodellen (forts.)
Deskription Normalfördelningsmodellen (forts.) 1 Exempel 1 En datorleverantör har en stödfunktion dit kunder med krånglande datorer kan ringa. Tiden det tar att svara på inkommande samtal varierar, och
More informationRäkneövningar Empirisk modellering
Räkneövningar Empirisk modellering Bengt Carlsson Systems and Control Dept of Information Technology, Uppsala University 5th February 009 Abstract Räkneuppgifter samt lite kompletterande teori. Contents
More informationKurskod: TAMS28 MATEMATISK STATISTIK Provkod: TEN1 18 August 2017, 08:00-12:00. English Version
Kurskod: TAMS28 MATEMATISK STATISTIK Provkod: TEN1 18 August 2017, 08:00-12:00 Examiner: Zhenxia Liu (Tel: 070 0895208). Please answer in ENGLISH if you can. a. You are allowed to use a calculator, the
More informationEXAM IN MODELING AND SIMULATION (TSRT62)
EXAM IN MODELING AND SIMULATION (TSRT62) SAL: ISY:s datorsalar TID: Wednesday 4th January 2017, kl. 8.00 12.00 KURS: TSRT62 Modeling and Simulation PROVKOD: DAT1 INSTITUTION: ISY ANTAL UPPGIFTER: 5 ANTAL
More informationTR Technical Report. AFM study of montmorillonite
Technical Report TR-1-27 AFM study of montmorillonite Torbjörn Pettersson, Esben Thormann, Per Claesson Department of Chemistry, Surface Chemistry Royal Institute of Technology February 21 Svensk Kärnbränslehantering
More information2. This system of two second-order differential equations can be simplified to a system of four first-order differential equations by introducing two
UPPSALA UNIVERSITET Inst. för informationsteknologi Avd. för teknisk databehandling Jonas Nilsson Tekniska beräkningar EI1 Miniprojekt: ODE De uppgifter som beskrivs nedan har karaktären av (förhoppningsvis
More informationOptimization Methods. Lecture 18: Optimality Conditions and. Gradient Methods. for Unconstrained Optimization
5.93 Optimization Methods Lecture 8: Optimality Conditions and Gradient Methods for Unconstrained Optimization Outline. Necessary and sucient optimality conditions Slide. Gradient m e t h o d s 3. The
More informationAdaptive Finite Element Methods for Multiphysics Problems
Adaptive Finite Element Methods for Multiphysics Problems Adaptive Finite Element Methods for Multiphysics Problems Fredrik Bengzon Doctoral Thesis No. 44, 2009, Department of Mathematics and Mathematical
More informationTABLE OF CONTENTS INTRODUCTION, APPROXIMATION & ERRORS 1. Chapter Introduction to numerical methods 1 Multiple-choice test 7 Problem set 9
TABLE OF CONTENTS INTRODUCTION, APPROXIMATION & ERRORS 1 Chapter 01.01 Introduction to numerical methods 1 Multiple-choice test 7 Problem set 9 Chapter 01.02 Measuring errors 11 True error 11 Relative
More informationMAT 22B - Lecture Notes
MAT 22B - Lecture Notes 2 September 2015 Systems of ODEs This is some really cool stu. Systems of ODEs are a natural and powerful way to model how multiple dierent interrelated quantities change through
More informationContents. TAMS38 - Lecture 10 Response surface. Lecturer: Jolanta Pielaszkiewicz. Response surface 3. Response surface, cont. 4
Contents TAMS38 - Lecture 10 Response surface Lecturer: Jolanta Pielaszkiewicz Matematisk statistik - Matematiska institutionen Linköpings universitet Look beneath the surface; let not the several quality
More informationPARTIAL DIFFERENTIAL EQUATIONS
MATHEMATICAL METHODS PARTIAL DIFFERENTIAL EQUATIONS I YEAR B.Tech By Mr. Y. Prabhaker Reddy Asst. Professor of Mathematics Guru Nanak Engineering College Ibrahimpatnam, Hyderabad. SYLLABUS OF MATHEMATICAL
More informationAnt Colony Algorithms and its applications to Autonomous Agents Systems
DEGREE PROJECT IN MATHEMATICS, SECOND CYCLE, 30 CREDITS STOCKHOLM, SWEDEN 2017 Ant Colony Algorithms and its applications to Autonomous Agents Systems DANIEL JARNE ORNIA KTH ROYAL INSTITUTE OF TECHNOLOGY
More informationQuantum Compmutational Speedup For The Minesweeper Problem
TVE-F 17 05 juni. Examensarbete 15 hp Juni 017 Quantum Compmutational Speedup For The Minesweeper Problem Olof Terner Villhelm Urpi Hedbjörk Abstract Quantum Computational Speedup For The Minesweeper Problem
More informationA general theory of discrete ltering. for LES in complex geometry. By Oleg V. Vasilyev AND Thomas S. Lund
Center for Turbulence Research Annual Research Briefs 997 67 A general theory of discrete ltering for ES in complex geometry By Oleg V. Vasilyev AND Thomas S. und. Motivation and objectives In large eddy
More informationMAT300/500 Programming Project Spring 2019
MAT300/500 Programming Project Spring 2019 Please submit all project parts on the Moodle page for MAT300 or MAT500. Due dates are listed on the syllabus and the Moodle site. You should include all neccessary
More informationPart 1: Overview of Ordinary Dierential Equations 1 Chapter 1 Basic Concepts and Problems 1.1 Problems Leading to Ordinary Dierential Equations Many scientic and engineering problems are modeled by systems
More informationA First Course on Kinetics and Reaction Engineering Supplemental Unit S4. Numerically Fitting Models to Data
Supplemental Unit S4. Numerically Fitting Models to Data Defining the Problem Many software routines for fitting a model to experimental data can only be used when the model is of a pre-defined mathematical
More informationChapter 5 HIGH ACCURACY CUBIC SPLINE APPROXIMATION FOR TWO DIMENSIONAL QUASI-LINEAR ELLIPTIC BOUNDARY VALUE PROBLEMS
Chapter 5 HIGH ACCURACY CUBIC SPLINE APPROXIMATION FOR TWO DIMENSIONAL QUASI-LINEAR ELLIPTIC BOUNDARY VALUE PROBLEMS 5.1 Introduction When a physical system depends on more than one variable a general
More informationPRESENTATION. Goldore Sweden AB (publ) har Archelon AB (publ), Capensor Capital AB och Anders West som huvudägare.
PRESENTATION September 2018 SAMMANFATTNING Goldore Sweden AB (publ) har Archelon AB (publ), Capensor Capital AB och Anders West som huvudägare. Bolagets fokus ligger på guld i Skelleftefältet, som har
More informationOrder Results for Mono-Implicit Runge-Kutta Methods. K. Burrage, F. H. Chipman, and P. H. Muir
Order Results for Mono-Implicit Runge-Kutta Methods K urrage, F H hipman, and P H Muir bstract The mono-implicit Runge-Kutta methods are a subclass of the wellknown family of implicit Runge-Kutta methods
More informationLinear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space
Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) Contents 1 Vector Spaces 1 1.1 The Formal Denition of a Vector Space.................................. 1 1.2 Subspaces...................................................
More informationNumerical Methods for Engineers. and Scientists. Applications using MATLAB. An Introduction with. Vish- Subramaniam. Third Edition. Amos Gilat.
Numerical Methods for Engineers An Introduction with and Scientists Applications using MATLAB Third Edition Amos Gilat Vish- Subramaniam Department of Mechanical Engineering The Ohio State University Wiley
More informationMAT 22B - Lecture Notes
MAT 22B - Lecture Notes 4 September 205 Solving Systems of ODE Last time we talked a bit about how systems of ODE arise and why they are nice for visualization. Now we'll talk about the basics of how to
More informationLie Groups for 2D and 3D Transformations
Lie Groups for 2D and 3D Transformations Ethan Eade Updated May 20, 2017 * 1 Introduction This document derives useful formulae for working with the Lie groups that represent transformations in 2D and
More informationMath Camp Notes: Everything Else
Math Camp Notes: Everything Else Systems of Dierential Equations Consider the general two-equation system of dierential equations: Steady States ẋ = f(x, y ẏ = g(x, y Just as before, we can nd the steady
More informationFundamental Estimation and Detection Limits in Linear Non-Gaussian Systems
Linköping Studies in Science and Technology Thesis No. 1199 Fundamental Estimation and Detection Limits in Linear Non-Gaussian Systems Gustaf Hendeby REGLERTEKNIK AUTOMATIC CONTROL LINKÖPING Division of
More informationSome Results On Optimal Control for Nonlinear Descriptor Systems
Linköping Studies in Science and Technology Thesis No. 1227 Some Results On Optimal Control for Nonlinear Descriptor Systems Johan Sjöberg REGLERTEKNIK AUTOMATIC CONTROL LINKÖPING Division of Automatic
More informationAnalyses and Applications of the Peaceman--Rachford and Douglas--Rachford Splitting Schemes
Analyses and Applications of the Peaceman--Rachford and Douglas--Rachford Splitting Schemes Henningsson, Erik 2014 Link to publication Citation for published version (APA): Henningsson, E. (2014). Analyses
More informationNon-linear least squares
Non-linear least squares Concept of non-linear least squares We have extensively studied linear least squares or linear regression. We see that there is a unique regression line that can be determined
More informationGDP growth rate nowcasting and forecasting
GDP growth rate nowcasting and forecasting A system averaging model implementation Author: Fredrik Björnfot Supervisor: Øystein Børsum Examiner: Markus Ådahl Umeå univesity February 2017 Abstract English
More informationMath 1270 Honors ODE I Fall, 2008 Class notes # 14. x 0 = F (x; y) y 0 = G (x; y) u 0 = au + bv = cu + dv
Math 1270 Honors ODE I Fall, 2008 Class notes # 1 We have learned how to study nonlinear systems x 0 = F (x; y) y 0 = G (x; y) (1) by linearizing around equilibrium points. If (x 0 ; y 0 ) is an equilibrium
More informationLinear Regression and Its Applications
Linear Regression and Its Applications Predrag Radivojac October 13, 2014 Given a data set D = {(x i, y i )} n the objective is to learn the relationship between features and the target. We usually start
More informationCoupled waves as a model to describe chaotic turbulence pumped by radio waves in the ionosphere
Coupled waves as a model to describe chaotic turbulence pumped by radio waves in the ionosphere Axel Hahlin Author Thomas Leyser Supervisor Jan Bergman Subject Reader July 20, 2018 1 Abstract Experimental
More informationNew concepts: Span of a vector set, matrix column space (range) Linearly dependent set of vectors Matrix null space
Lesson 6: Linear independence, matrix column space and null space New concepts: Span of a vector set, matrix column space (range) Linearly dependent set of vectors Matrix null space Two linear systems:
More informationOrdinary Differential Equations
Ordinary Differential Equations Introduction: first order ODE We are given a function f(t,y) which describes a direction field in the (t,y) plane an initial point (t 0,y 0 ) We want to find a function
More informationBERGMEKANIKDAGEN 20 MARS
NUMERICAL ANALYSIS OF THE LARGE SCALE DYNAMIC TESTS OF ROCK SUPPORT AT LKAB KIIRUNAVAARA MINE Numeriska analyser av storskaliga dynamiska tester av bergförstärkning i LKABs Kiirunavaaragruva Shahin Shirzadegan,
More information3.3. SYSTEMS OF ODES 1. y 0 " 2y" y 0 + 2y = x1. x2 x3. x = y(t) = c 1 e t + c 2 e t + c 3 e 2t. _x = A x + f; x(0) = x 0.
.. SYSTEMS OF ODES. Systems of ODEs MATH 94 FALL 98 PRELIM # 94FA8PQ.tex.. a) Convert the third order dierential equation into a rst oder system _x = A x, with y " y" y + y = x = @ x x x b) The equation
More informationModeling & Simulation 2018 Lecture 12. Simulations
Modeling & Simulation 2018 Lecture 12. Simulations Claudio Altafini Automatic Control, ISY Linköping University, Sweden Summary of lecture 7-11 1 / 32 Models of complex systems physical interconnections,
More informationChiral effective field theory with machine learning
Chiral effective field theory with machine learning Bachelor of Science Thesis for the Engineering Physics Program JOHANNES ASPMAN, EMIL EJBYFELDT, ANTON KOLLMATS, MAXIMILIAN LEYMAN Department of Physics
More information1.2 Derivation. d p f = d p f(x(p)) = x fd p x (= f x x p ). (1) Second, g x x p + g p = 0. d p f = f x g 1. The expression f x gx
PDE-constrained optimization and the adjoint method Andrew M. Bradley November 16, 21 PDE-constrained optimization and the adjoint method for solving these and related problems appear in a wide range of
More informationSection 7.4 Runge-Kutta Methods
Section 7.4 Runge-Kutta Methods Key terms: Taylor methods Taylor series Runge-Kutta; methods linear combinations of function values at intermediate points Alternatives to second order Taylor methods Fourth
More information1 Vectors. Notes for Bindel, Spring 2017 Numerical Analysis (CS 4220)
Notes for 2017-01-30 Most of mathematics is best learned by doing. Linear algebra is no exception. You have had a previous class in which you learned the basics of linear algebra, and you will have plenty
More informationLuleå Tekniska Universitet Kurskod SMD098 Tentamensdatum
Luleå Tekniska Universitet Kurskod SMD098 Tentamensdatum 991215 Skrivtid 4 timmar Tentamen i Beräkningsstrukturer Antal uppgifter: 6 Max poäng: 30 Betygsgränser: >20 poäng 4 >25 poäng 5 Betygsgränser kan
More informationNumerical Methods with MATLAB
Numerical Methods with MATLAB A Resource for Scientists and Engineers G. J. BÖRSE Lehigh University PWS Publishing Company I(T)P AN!NTERNATIONAL THOMSON PUBLISHING COMPANY Boston Albany Bonn Cincinnati
More informationLösning: Tenta Numerical Analysis för D, L. FMN011,
Lösning: Tenta Numerical Analysis för D, L. FMN011, 090527 This exam starts at 8:00 and ends at 12:00. To get a passing grade for the course you need 35 points in this exam and an accumulated total (this
More information1. Introduction Let the least value of an objective function F (x), x2r n, be required, where F (x) can be calculated for any vector of variables x2r
DAMTP 2002/NA08 Least Frobenius norm updating of quadratic models that satisfy interpolation conditions 1 M.J.D. Powell Abstract: Quadratic models of objective functions are highly useful in many optimization
More informationOutline Introduction: Problem Description Diculties Algebraic Structure: Algebraic Varieties Rank Decient Toeplitz Matrices Constructing Lower Rank St
Structured Lower Rank Approximation by Moody T. Chu (NCSU) joint with Robert E. Funderlic (NCSU) and Robert J. Plemmons (Wake Forest) March 5, 1998 Outline Introduction: Problem Description Diculties Algebraic
More informationThe distribution of characters, bi- and trigrams in the Uppsala 70 million words Swedish newspaper corpus
Uppsala University Department of Linguistics The distribution of characters, bi- and trigrams in the Uppsala 70 million words Swedish newspaper corpus Bengt Dahlqvist Abstract The paper describes some
More informationDipolar interactions of trapped dipolar molecular ions. Anna Filipsson
Dipolar interactions of trapped dipolar molecular ions Anna Filipsson i Abstract The topic of this thesis is the development of a numerical model of trapped dipolar molecular ions forming a Coulomb crystal,
More informationConsider the following example of a linear system:
LINEAR SYSTEMS Consider the following example of a linear system: Its unique solution is x + 2x 2 + 3x 3 = 5 x + x 3 = 3 3x + x 2 + 3x 3 = 3 x =, x 2 = 0, x 3 = 2 In general we want to solve n equations
More informationSimulation of a Bayard-Alpert ionization gauge with the PIC code Warp
DEGREE PROJECT IN MATHEMATICS, SECOND CYCLE, 30 CREDITS STOCKHOLM, SWEDEN 2018 Simulation of a Bayard-Alpert ionization gauge with the PIC code Warp ALEXANDER TEGERUP KTH ROYAL INSTITUTE OF TECHNOLOGY
More informationIE 5531: Engineering Optimization I
IE 5531: Engineering Optimization I Lecture 15: Nonlinear optimization Prof. John Gunnar Carlsson November 1, 2010 Prof. John Gunnar Carlsson IE 5531: Engineering Optimization I November 1, 2010 1 / 24
More informationDo not turn over until you are told to do so by the Invigilator.
UNIVERSITY OF EAST ANGLIA School of Mathematics Main Series UG Examination 216 17 INTRODUCTION TO NUMERICAL ANALYSIS MTHE612B Time allowed: 3 Hours Attempt QUESTIONS 1 and 2, and THREE other questions.
More informationMethods of Solution of Linear Simultaneous Equations
Methods of Solution of Linear Simultaneous Equations ET151 Circuits 1 Professor Fiore, jfiore@mvcc.edu Several circuit analysis methods such as branch current analysis, mesh analysis and nodal analysis,
More informationNumerical Methods for Engineers and Scientists
Numerical Methods for Engineers and Scientists Second Edition Revised and Expanded Joe D. Hoffman Department of Mechanical Engineering Purdue University West Lafayette, Indiana m MARCEL D E К К E R MARCEL
More information19.2 Mathematical description of the problem. = f(p; _p; q; _q) G(p; q) T ; (II.19.1) g(p; q) + r(t) _p _q. f(p; v. a p ; q; v q ) + G(p; q) T ; a q
II-9-9 Slider rank 9. General Information This problem was contributed by Bernd Simeon, March 998. The slider crank shows some typical properties of simulation problems in exible multibody systems, i.e.,
More informationHIGH ACCURACY NUMERICAL METHODS FOR THE SOLUTION OF NON-LINEAR BOUNDARY VALUE PROBLEMS
ABSTRACT Of The Thesis Entitled HIGH ACCURACY NUMERICAL METHODS FOR THE SOLUTION OF NON-LINEAR BOUNDARY VALUE PROBLEMS Submitted To The University of Delhi In Partial Fulfillment For The Award of The Degree
More informationModelling of Heat Transfer for Convection-boosted Flat Vertical Radiator Surfaces
DEGREE PROJECT, DEGREE PROGRAMME IN CIVIL ENGINEERING AND URBAN MANAGEMENT CIVIL AND ARCHITECTURAL ENGINEERING MASTER OF SCIENCE, 30 CREDITS, SECOND LEVEL STOCKHOLM, SWEDEN 2017 Modelling of Heat Transfer
More informationKonstruktion av Vippor och Latchar
Konstruktion av Vippor och Latchar Datorarkitektur 1 (1DT038) Fördjupning November 2009 karl.marklund@it.uu.se Om du läser IT (1DT038) är detta material överkurs du bör dock redan vara bekant med hur det
More informationNUMERICAL MATHEMATICS AND COMPUTING
NUMERICAL MATHEMATICS AND COMPUTING Fourth Edition Ward Cheney David Kincaid The University of Texas at Austin 9 Brooks/Cole Publishing Company I(T)P An International Thomson Publishing Company Pacific
More informationChapter 6 - Ordinary Differential Equations
Chapter 6 - Ordinary Differential Equations 7.1 Solving Initial-Value Problems In this chapter, we will be interested in the solution of ordinary differential equations. Ordinary differential equations
More informationParametric Spline Method for Solving Bratu s Problem
ISSN 749-3889 print, 749-3897 online International Journal of Nonlinear Science Vol4202 No,pp3-0 Parametric Spline Metod for Solving Bratu s Problem M Zarebnia, Z Sarvari 2,2 Department of Matematics,
More informationA Glimpse at Scipy FOSSEE. June Abstract This document shows a glimpse of the features of Scipy that will be explored during this course.
A Glimpse at Scipy FOSSEE June 010 Abstract This document shows a glimpse of the features of Scipy that will be explored during this course. 1 Introduction SciPy is open-source software for mathematics,
More informationLECTURE NOTES ELEMENTARY NUMERICAL METHODS. Eusebius Doedel
LECTURE NOTES on ELEMENTARY NUMERICAL METHODS Eusebius Doedel TABLE OF CONTENTS Vector and Matrix Norms 1 Banach Lemma 20 The Numerical Solution of Linear Systems 25 Gauss Elimination 25 Operation Count
More informationReview. Numerical Methods Lecture 22. Prof. Jinbo Bi CSE, UConn
Review Taylor Series and Error Analysis Roots of Equations Linear Algebraic Equations Optimization Numerical Differentiation and Integration Ordinary Differential Equations Partial Differential Equations
More informationMathematical Models with Maple
Algebraic Biology 005 151 Mathematical Models with Maple Tetsu YAMAGUCHI Applied System nd Division, Cybernet Systems Co., Ltd., Otsuka -9-3, Bunkyo-ku, Tokyo 11-001, Japan tetsuy@cybernet.co.jp Abstract
More information