Modeling radiocarbon in the Earth System. Radiocarbon summer school 2012

Size: px
Start display at page:

Download "Modeling radiocarbon in the Earth System. Radiocarbon summer school 2012"

Transcription

1 Modeling radiocarbon in the Earth System Radiocarbon summer school 2012

2 Outline Brief introduc9on to mathema9cal modeling Single pool models Mul9ple pool models Model implementa9on Parameter es9ma9on

3 What is a model? A Belgium Netherlands B C MEIO DETRITUS MACRO N H Three examples of models. They have in common that they focus only on the object of interest, ignoring the irrelevant details. What is irrelevant depends on the aim of the model. Soetaert, K. and P.M.J. Herman A prac8cal guide to ecological modelling using R as a simula8on pla?orm. Springer.

4 The global carbon cycle as a conceptual model

5 Why we use models Synthesis and integra9on Predic9on and forecas9ng Observa9on and experimenta9on

6 Problem Conceptual model main components relationships Modelling steps and ingredients. Mathematical model general theory Parameterisation literature measurements Mathematical solution Calibration,sensitivity Verification,validation field data lab measurements OK? Prediction, Analysis Soetaert, K. and P.M.J. Herman A prac8cal guide to ecological modelling using R as a simula8on pla?orm. Springer.

7 Conceptual model: Radioac9ve decay Total number of 14 C atoms (N) Loss by radioac9ve decay

8 Mathema9cal model dc dt =Inputs Outputs

9 Mathema9cal model dn dt = λn Total number of 14 C atoms (N) Loss by radioac9ve decay

10 Mathema9cal solu9on? dn dt = λn

11 Mathema9cal solu9on dn dt = λn N(t) =N0 exp( λt)

12 Parameteriza9on Libby half- life = 5568 years t 1/2 = 5568 yr = ln 2 λ λ = yr 1

13 Predic9on How much radiocarbon would be available arer 10,000 years if the ini9al amount of 14 C atoms N 0 = 100 N(t = 10000) = 100 exp( λ10000) = 28.8

14 Single pool models Useful for integra9on and general understanding Spa9al and temporal averages of reservoirs Ignore heterogeneity and complexity

15 A simple reservoir model Inputs Stock Outputs dc dt = I O dc dt = I kc

16 Analy9cal solu9on dc dt = I kc C = I k I k C 0 e kt I = 10, k = 0.5, C 0 = 0

17 Effect of the ini9al condi9ons C 0 C C0=0 C0=20 C0=40 I = 10, k = 0.5 The system always reaches a steady- state independent on the ini8al condi8ons t

18 Steady State C = I k I k C 0 e kt C = I k

19 Steady State dc dt = I O =0 At steady- state the input flux is equal to the output flux. I = kc C = I k [mass]/[time] 1/[time] = [mass]

20 Turnover 9me How long would it take to empty the reservoir if we suddenly stop the input flux? τ 0 = C O = C I [mass] [mass/time] =[time] τ 0 = 1 k 1 1/[time] =[time]

21 Age and transit 9mes

22 Let s empty the reservoir dc dt = kc, C(t = 0) = C ss Start with a reservoir at steady state and reset time C = C SS exp( kt) Time evolution of the remaining C in reservoir O = kc SS exp( kt) Time evolution of the C leaving the reservoir

23 Let s empty the reservoir Carbon remaining in the reservoir C = C SS exp( kt) Carbon leaving the reservoir O = kc SS exp( kt) C Outputs t t

24 Let s empty the reservoir C = C SS exp( kt) O = kc SS exp( kt) C Mean age of C remaining in the reservoir Outputs Mean age of C leaving the reservoir t t

25 Age and transit 9me distribu9ons Proportion ψ(τ) =φ(τ) ψ(τ) = Age frequency distribution φ(τ) = Transit time frequency distribution E[ψ(τ)] = τ a E[φ(τ)] = τ r Mean age Mean transit time !

26 Mean age and transit 9mes are not always equal Human popula9on Uranium Water vapor, soils Bolin & Rhode (1972).

27 Mul9ple pool models No. Pools Parallel Series Feedback

28 Models as systems of differen9al equa9ons γ I 1 γ C 1 C 2 dc 1 dt dc 2 dt = γi k 1 C 1 =(1 γ)i k 2 C 2

29 Models as systems of differen9al equa9ons I α C 1 C 2 dc 1 dt dc 2 dt = I k 1 C 1 = αk 1 C 1 k 2 C 2

30 Models as systems of differen9al equa9ons I α 1 C 1 C 2 α 2 dc 1 dt dc 2 dt = I + α 2 k 2 C 2 k 1 C 1 = α 1 k 1 C 1 k 2 C 2

31 Turnover time is calculated as the inventory (here, the mass of carbon in soil organic matter) divided by the total flux of C out of the reservoir. Transit (residence) time is the time spent in the reservoir by an individual C atom, which is equivalent to the average age of a molecule leaving the reservoir (assuming its age was 0 when it entered the reservoir). Average age of C atoms in the soil organic matter reservoir is the average time since the atoms entered (whether they are leaving or not). A homogeneous reservoir (one for which the probability of every atom leaving is equal), at steady state, the turnover time, residence time and average age of organic matter in the reservoir are equal.

32 Faster 4 grams τ = 1 years Slower 20 grams τ = 10 years Flux = 4 g/yr Flux = 2 g/yr One Pool (wrong) 24 grams τ = 4 years Flux = 6 g/yr Mean age of C in Reservoir Turnover Time Mass/Flux Mean Age of respired C [ 20 g *10yr + 4g *1yr] 24 g 24g 6g / yr = 4 year [ 4 g/ yr *1yr + 2g / yr *10 yr] 6g/ yr = 8.5 year = 4year [ 24 g * 4yr] 24 g = 4 year 24 g 6g/ yr = 4year 6g/ yr * 4yr = 4year 6g/ yr

33 Model structure, age, and transit 9mes Manzoni et al. (2009). J. Geophys. Res. 114, G04025.

34

35 Modeling radiocarbon Single pool case Inputs Stock Outputs Radioac9ve decay

36 Modeling radiocarbon Single pool case d 14 C dt = df C dt = IF ex kfc λfc = IF ex (k + λ)fc

37 Example: incorpora9on of bomb carbon in the terrestrial biosphere! 14 C ( ) ! 14 C in Atmosphere! 14 C in Terrestrial biosphere df C dt = IF atm (k + λ)fc I = GP P = 120 k = I C = GP P C = Year

38 Steady- state solu9on df C dt = IF ex (k + λ)fc Differential equation IF ex =(k + λ)fc Steady-state solution FC = IF ex k + λ Solve for FC F = k k + λ Assuming F ex = 1 (pre 1950), and I = C*k

39 Model implementa9on Analy9cal vs. numerical solu9ons Spreadsheets vs programing language

40 Analy9cal solu9on dc dt = I kc C = I k I k C 0 e kt Gives the exact solution to the differential equation Can give insights into the properties and long-term behavior of the system Not always possible to compute

41 Numerical solu9on df C dt = IF atm (k + λ)fc Most practical approach to model radiocarbon! 14 C ( ) ! 14 C in Atmosphere! 14 C in Terrestrial biosphere The calibration curve is not a function but a set of numbers Is prone to approximation (numerical) errors Year

42 Numerical approxima9on of an ODE The idea is to break the problem in small pieces and approximate a solution to the ODE at each interval

43 A Explicit euler method B Runge-Kutta method 4 f(t2) df f(t1) +! t (t1) dt f(t1) C df f(t1) +! t (t2) dt f(t2) f(t1) tangent line! t t1 t2 Implicit euler method true value estimated D estimated 3 2 1! t 2! t t1 t2 Semi-Implicit euler method A. The explicit Euler integration method. The function value at time t2 is estimated based on the value at time t1 and the rate of change (as denoted by the tangent line). It is assumed that the rate of change remains constant in the time step between t1 and t2. As this is not the case, the estimated value considerably underestimates the true value. B. The 4- th order Runge-Kutta method. One function evaluation at the start point (1), two evaluations at the mid-point (2,3), and one evaluation at the end point (4) are combined to provide the final projected value (grey dot). C. The implicit Euler integration method uses the estimate of the rate of change at the next time step, t2. D. The semi-implicit method combines both the explicit and implicit approach t1 t2 t1 t2 Soetaert, K. and P.M.J. Herman A prac8cal guide to ecological modelling using R as a simula8on pla?orm. Springer.

44 Explicit or forward Euler method

45 Explicit or forward Euler method

46 Applica9on radiocarbon model: spreadsheet implementa9on df C dt = IF atm (k + λ)fc Differen9al equa9on (FC) t+1 =(FC) t + (FC) t =(FC) t + h((if atm ) t (k + λ)(fc) t ) Numerical solu9on F t+1 = IF atm +(FC) t (1 k λ) C t+1 Simplifica9on for annual 9me step

47 ODE solvers Accurate solu9ons to ODEs Requires some level of programming Excel can do it, but befer try something different Matlab, Mathema9ca, and R have really good and easy to implement ODE solvers For large computa9ons C, C++, or Fortran are recommended

48 How to implement models in R Use the desolve package to solve systems of ODEs. It can handle linear and nonlinear problems. For linear models in soil applica9ons, use SoilR!

49 desolve Reading the first 5 pages of package vignefe Solving Ini8al Value Differen8al Equa8ons in R is enough to implement linear and nonlinear systems in R. You can get it here: hfp://cran.r- project.org/ web/packages/desolve//vignefes/ desolve.pdf

50 SoilR Can be used to implement linear soil organic mafer decomposi9on models Includes a radiocarbon module and facilitates parameter es9ma9on To install simply type inside R: install.packages("soilr", repos= c("h9p://r- Forge.R- project.org", getop@on("repos"))

51 Stocks and fluxes of radiocarbon in bulk soil and respired CO 2

52 How to do it in SoilR? example( ThreepSeriesModel, package= SoilR " See also: example( ThreepParallelModel, package= SoilR " example( ThreepFeedbackModel, package= SoilR "

53 Model structure and mean transit 9mes

54 Parameter es9ma9on Numerical op9miza9on Bayesian parameter es9ma9on

55 Numerical op9miza9on Minimize or maximize an objective function Set some constraints Find optimal solution

56 Numerical op9miza9on Objective or cost function Constraints

57 Numerical op9miza9on Commonly, Residual sum of squares RSS = n (y i f(x i )) 2 i=1

58 Local versus global minima In radiocarbon problems we ooen find two local minima

59 Example! 14 C ( ) We are interested in finding the turnover 8me that minimizes the difference between the observa8on and the predic8on of a one pool model min f(τ) =(O τ R n t=2004 FC t=2004 ) 2 df C dt = IF atm (1/τ + λ)fc Year Δ 14 C = 200 (per mil) in 1998

60 Difference between observed and possible values of 14C in Single pool Squared Residual Turnover time

61 14C trajectories for the two possible solutions! 14 C ( ) ! 14 C in Atmosphere 13 yrs turnover time 36 yrs turnover time In radiocarbon we usually get two optimal solutions without constraints Year

62 Possible solutions for the two pool model, with τ 1 < τ 2

63 Two pool solution Addi8onal informa8on such as the Δ 14 C of different pools or fluxes are helpful constraints in the op8miza8on problem

64 Bayesian parameter es9ma9on Powerful method for parameter es9ma9on Parameters are assumed to be random variables instead of fixed values Bayesian methods seek to es9mate a posterior probability distribu9on given some prior knowledge and some observed data.

65 Bayesian inference Likelihood P (θ D) =P (θ) P (D θ) P (D) Posterior Prior Posterior distribu8on provides knowledge about the mean and variance of the parameters. Can be used to es8mate uncertainty of the predic8ons

66 How to implement Bayesian techniques? R is a powerful environment for finng Bayesian models Package FME provides func9ons to fit models to data using Bayesian techniques SoilR provides an interface to FME for Bayesian parameter es9ma9on

67 14 CO 2 efflux from soils at Harvard Forest

68

69 In summary Models are helpful tools to understand system behavior They can help you es9ma9ng mean ages, transit 9mes, and uncertain9es in radiocarbon applica9ons However, beware of the assump9ons of the modeling techniques you use (e.g. steady- state, negligible numerical errors)

Least Squares Parameter Es.ma.on

Least Squares Parameter Es.ma.on Least Squares Parameter Es.ma.on Alun L. Lloyd Department of Mathema.cs Biomathema.cs Graduate Program North Carolina State University Aims of this Lecture 1. Model fifng using least squares 2. Quan.fica.on

More information

CS 6140: Machine Learning Spring What We Learned Last Week. Survey 2/26/16. VS. Model

CS 6140: Machine Learning Spring What We Learned Last Week. Survey 2/26/16. VS. Model Logis@cs CS 6140: Machine Learning Spring 2016 Instructor: Lu Wang College of Computer and Informa@on Science Northeastern University Webpage: www.ccs.neu.edu/home/luwang Email: luwang@ccs.neu.edu Assignment

More information

CS 6140: Machine Learning Spring 2016

CS 6140: Machine Learning Spring 2016 CS 6140: Machine Learning Spring 2016 Instructor: Lu Wang College of Computer and Informa?on Science Northeastern University Webpage: www.ccs.neu.edu/home/luwang Email: luwang@ccs.neu.edu Logis?cs Assignment

More information

Bellman s Curse of Dimensionality

Bellman s Curse of Dimensionality Bellman s Curse of Dimensionality n- dimensional state space Number of states grows exponen

More information

DART Tutorial Sec'on 1: Filtering For a One Variable System

DART Tutorial Sec'on 1: Filtering For a One Variable System DART Tutorial Sec'on 1: Filtering For a One Variable System UCAR The Na'onal Center for Atmospheric Research is sponsored by the Na'onal Science Founda'on. Any opinions, findings and conclusions or recommenda'ons

More information

Introduction to Particle Filters for Data Assimilation

Introduction to Particle Filters for Data Assimilation Introduction to Particle Filters for Data Assimilation Mike Dowd Dept of Mathematics & Statistics (and Dept of Oceanography Dalhousie University, Halifax, Canada STATMOS Summer School in Data Assimila5on,

More information

CS 6140: Machine Learning Spring What We Learned Last Week 2/26/16

CS 6140: Machine Learning Spring What We Learned Last Week 2/26/16 Logis@cs CS 6140: Machine Learning Spring 2016 Instructor: Lu Wang College of Computer and Informa@on Science Northeastern University Webpage: www.ccs.neu.edu/home/luwang Email: luwang@ccs.neu.edu Sign

More information

Modelling of Equipment, Processes, and Systems

Modelling of Equipment, Processes, and Systems 1 Modelling of Equipment, Processes, and Systems 2 Modelling Tools Simple Programs Spreadsheet tools like Excel Mathema7cal Tools MatLab, Mathcad, Maple, and Mathema7ca Special Purpose Codes Macroflow,

More information

Bias/variance tradeoff, Model assessment and selec+on

Bias/variance tradeoff, Model assessment and selec+on Applied induc+ve learning Bias/variance tradeoff, Model assessment and selec+on Pierre Geurts Department of Electrical Engineering and Computer Science University of Liège October 29, 2012 1 Supervised

More information

WRF- Hydro Development and Performance Tes9ng

WRF- Hydro Development and Performance Tes9ng WRF- Hydro Development and Performance Tes9ng Wei Yu, David Gochis, David Yates Research Applica9ons Laboratory Na9onal Center for Atmospheric Research Boulder, CO USA Scien9fic Mo9va9on How does terrain

More information

Pseudospectral Methods For Op2mal Control. Jus2n Ruths March 27, 2009

Pseudospectral Methods For Op2mal Control. Jus2n Ruths March 27, 2009 Pseudospectral Methods For Op2mal Control Jus2n Ruths March 27, 2009 Introduc2on Pseudospectral methods arose to find solu2ons to Par2al Differen2al Equa2ons Recently adapted for Op2mal Control Key Ideas

More information

Exponen'al growth and differen'al equa'ons

Exponen'al growth and differen'al equa'ons Exponen'al growth and differen'al equa'ons But first.. Thanks for the feedback! Feedback about M102 Which of the following do you find useful? 70 60 50 40 30 20 10 0 How many resources students typically

More information

Machine Learning and Data Mining. Linear regression. Prof. Alexander Ihler

Machine Learning and Data Mining. Linear regression. Prof. Alexander Ihler + Machine Learning and Data Mining Linear regression Prof. Alexander Ihler Supervised learning Notation Features x Targets y Predictions ŷ Parameters θ Learning algorithm Program ( Learner ) Change µ Improve

More information

Modelling Time- varying effec3ve Brain Connec3vity using Mul3regression Dynamic Models. Thomas Nichols University of Warwick

Modelling Time- varying effec3ve Brain Connec3vity using Mul3regression Dynamic Models. Thomas Nichols University of Warwick Modelling Time- varying effec3ve Brain Connec3vity using Mul3regression Dynamic Models Thomas Nichols University of Warwick Dynamic Linear Model Bayesian 3me series model Predictors {X 1,,X p } Exogenous

More information

Introduc)on to Ar)ficial Intelligence

Introduc)on to Ar)ficial Intelligence Introduc)on to Ar)ficial Intelligence Lecture 13 Approximate Inference CS/CNS/EE 154 Andreas Krause Bayesian networks! Compact representa)on of distribu)ons over large number of variables! (OQen) allows

More information

Research Article Bayesian Analysis of the Survival Function and Failure Rate of Weibull Distribution with Censored Data

Research Article Bayesian Analysis of the Survival Function and Failure Rate of Weibull Distribution with Censored Data Hindawi Publishing Corporaon Mathemacal Problems in Engineering Volume 2012 Arcle ID 329489 18 pages doi:10.1155/2012/329489 Research Arcle Bayesian Analysis of the Survival Funcon and Failure Rate of

More information

(5.5) Multistep Methods

(5.5) Multistep Methods (5.5) Mulstep Metods Consider te inial-value problem for te ordinary differenal equaon: y t f t, y, a t b, y a. Let y t be te unique soluon. In Secons 5., 5. and 5.4, one-step numerical metods: Euler Metod,

More information

Parallelizing Gaussian Process Calcula1ons in R

Parallelizing Gaussian Process Calcula1ons in R Parallelizing Gaussian Process Calcula1ons in R Christopher Paciorek UC Berkeley Sta1s1cs Joint work with: Benjamin Lipshitz Wei Zhuo Prabhat Cari Kaufman Rollin Thomas UC Berkeley EECS (formerly) IBM

More information

Sta$s$cal sequence recogni$on

Sta$s$cal sequence recogni$on Sta$s$cal sequence recogni$on Determinis$c sequence recogni$on Last $me, temporal integra$on of local distances via DP Integrates local matches over $me Normalizes $me varia$ons For cts speech, segments

More information

Nonlinear ensemble data assimila/on in high- dimensional spaces. Peter Jan van Leeuwen Javier Amezcua, Mengbin Zhu, Melanie Ades

Nonlinear ensemble data assimila/on in high- dimensional spaces. Peter Jan van Leeuwen Javier Amezcua, Mengbin Zhu, Melanie Ades Nonlinear ensemble data assimila/on in high- dimensional spaces Peter Jan van Leeuwen Javier Amezcua, Mengbin Zhu, Melanie Ades Data assimila/on: general formula/on Bayes theorem: The solu/on is a pdf!

More information

Experimental Designs for Planning Efficient Accelerated Life Tests

Experimental Designs for Planning Efficient Accelerated Life Tests Experimental Designs for Planning Efficient Accelerated Life Tests Kangwon Seo and Rong Pan School of Compu@ng, Informa@cs, and Decision Systems Engineering Arizona State University ASTR 2015, Sep 9-11,

More information

Least Square Es?ma?on, Filtering, and Predic?on: ECE 5/639 Sta?s?cal Signal Processing II: Linear Es?ma?on

Least Square Es?ma?on, Filtering, and Predic?on: ECE 5/639 Sta?s?cal Signal Processing II: Linear Es?ma?on Least Square Es?ma?on, Filtering, and Predic?on: Sta?s?cal Signal Processing II: Linear Es?ma?on Eric Wan, Ph.D. Fall 2015 1 Mo?va?ons If the second-order sta?s?cs are known, the op?mum es?mator is given

More information

Ensemble Data Assimila.on and Uncertainty Quan.fica.on

Ensemble Data Assimila.on and Uncertainty Quan.fica.on Ensemble Data Assimila.on and Uncertainty Quan.fica.on Jeffrey Anderson, Alicia Karspeck, Tim Hoar, Nancy Collins, Kevin Raeder, Steve Yeager Na.onal Center for Atmospheric Research Ocean Sciences Mee.ng

More information

Numerical Methods in Physics

Numerical Methods in Physics Numerical Methods in Physics Numerische Methoden in der Physik, 515.421. Instructor: Ass. Prof. Dr. Lilia Boeri Room: PH 03 090 Tel: +43-316- 873 8191 Email Address: l.boeri@tugraz.at Room: TDK Seminarraum

More information

CSCI 360 Introduc/on to Ar/ficial Intelligence Week 2: Problem Solving and Op/miza/on. Professor Wei-Min Shen Week 8.1 and 8.2

CSCI 360 Introduc/on to Ar/ficial Intelligence Week 2: Problem Solving and Op/miza/on. Professor Wei-Min Shen Week 8.1 and 8.2 CSCI 360 Introduc/on to Ar/ficial Intelligence Week 2: Problem Solving and Op/miza/on Professor Wei-Min Shen Week 8.1 and 8.2 Status Check Projects Project 2 Midterm is coming, please do your homework!

More information

Modeling the Land Carbon Cycle. Please see h5p://biocycle.atmos.colostate.edu/shiny/land/

Modeling the Land Carbon Cycle. Please see h5p://biocycle.atmos.colostate.edu/shiny/land/ Modeling the and Carbon Cycle Please see h5p://biocycle.atmos.colostate.edu/shiny/and/ What is a Model? Models are simplifica?ons of reality which we use to organize and make sense of what we see in the

More information

Predic've Analy'cs for Energy Systems State Es'ma'on

Predic've Analy'cs for Energy Systems State Es'ma'on 1 Predic've Analy'cs for Energy Systems State Es'ma'on Presenter: Team: Yingchen (YC) Zhang Na/onal Renewable Energy Laboratory (NREL) Andrey Bernstein, Rui Yang, Yu Xie, Anthony Florita, Changfu Li, ScoD

More information

Introduc)on to the Design and Analysis of Experiments. Violet R. Syro)uk School of Compu)ng, Informa)cs, and Decision Systems Engineering

Introduc)on to the Design and Analysis of Experiments. Violet R. Syro)uk School of Compu)ng, Informa)cs, and Decision Systems Engineering Introduc)on to the Design and Analysis of Experiments Violet R. Syro)uk School of Compu)ng, Informa)cs, and Decision Systems Engineering 1 Complex Engineered Systems What makes an engineered system complex?

More information

CSCI 360 Introduc/on to Ar/ficial Intelligence Week 2: Problem Solving and Op/miza/on

CSCI 360 Introduc/on to Ar/ficial Intelligence Week 2: Problem Solving and Op/miza/on CSCI 360 Introduc/on to Ar/ficial Intelligence Week 2: Problem Solving and Op/miza/on Professor Wei-Min Shen Week 13.1 and 13.2 1 Status Check Extra credits? Announcement Evalua/on process will start soon

More information

Ensemble of Climate Models

Ensemble of Climate Models Ensemble of Climate Models Claudia Tebaldi Climate Central and Department of Sta7s7cs, UBC Reto Knu>, Reinhard Furrer, Richard Smith, Bruno Sanso Outline Mul7 model ensembles (MMEs) a descrip7on at face

More information

Last Lecture Recap UVA CS / Introduc8on to Machine Learning and Data Mining. Lecture 3: Linear Regression

Last Lecture Recap UVA CS / Introduc8on to Machine Learning and Data Mining. Lecture 3: Linear Regression UVA CS 4501-001 / 6501 007 Introduc8on to Machine Learning and Data Mining Lecture 3: Linear Regression Yanjun Qi / Jane University of Virginia Department of Computer Science 1 Last Lecture Recap q Data

More information

An Introduc+on to Sta+s+cs and Machine Learning for Quan+ta+ve Biology. Anirvan Sengupta Dept. of Physics and Astronomy Rutgers University

An Introduc+on to Sta+s+cs and Machine Learning for Quan+ta+ve Biology. Anirvan Sengupta Dept. of Physics and Astronomy Rutgers University An Introduc+on to Sta+s+cs and Machine Learning for Quan+ta+ve Biology Anirvan Sengupta Dept. of Physics and Astronomy Rutgers University Why Do We Care? Necessity in today s labs Principled approach:

More information

S#ff ODEs and Systems of ODEs

S#ff ODEs and Systems of ODEs S#ff ODEs and Systems of ODEs Popula#on Growth Modeling Let the number of individuals in a given area at time t be. At time the number is so that is the number of individuals that have arrived in the area

More information

DART Tutorial Sec'on 9: More on Dealing with Error: Infla'on

DART Tutorial Sec'on 9: More on Dealing with Error: Infla'on DART Tutorial Sec'on 9: More on Dealing with Error: Infla'on UCAR The Na'onal Center for Atmospheric Research is sponsored by the Na'onal Science Founda'on. Any opinions, findings and conclusions or recommenda'ons

More information

Par$cle Filters Part I: Theory. Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading

Par$cle Filters Part I: Theory. Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading Par$cle Filters Part I: Theory Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading Reading July 2013 Why Data Assimila$on Predic$on Model improvement: - Parameter es$ma$on

More information

Mixture Models. Michael Kuhn

Mixture Models. Michael Kuhn Mixture Models Michael Kuhn 2017-8-26 Objec

More information

Bayesian networks Lecture 18. David Sontag New York University

Bayesian networks Lecture 18. David Sontag New York University Bayesian networks Lecture 18 David Sontag New York University Outline for today Modeling sequen&al data (e.g., =me series, speech processing) using hidden Markov models (HMMs) Bayesian networks Independence

More information

A Framework for Protec/ng Worker Loca/on Privacy in Spa/al Crowdsourcing

A Framework for Protec/ng Worker Loca/on Privacy in Spa/al Crowdsourcing A Framework for Protec/ng Worker Loca/on Privacy in Spa/al Crowdsourcing Nov 12 2014 Hien To, Gabriel Ghinita, Cyrus Shahabi VLDB 2014 1 Mo/va/on Ubiquity of mobile users 6.5 billion mobile subscrip/ons,

More information

Introduction to ecosystem modelling (continued)

Introduction to ecosystem modelling (continued) NGEN02 Ecosystem Modelling 2015 Introduction to ecosystem modelling (continued) Uses of models in science and research System dynamics modelling The modelling process Recommended reading: Smith & Smith

More information

Definition of differential equations and their classification. Methods of solution of first-order differential equations

Definition of differential equations and their classification. Methods of solution of first-order differential equations Introduction to differential equations: overview Definition of differential equations and their classification Solutions of differential equations Initial value problems Existence and uniqueness Mathematical

More information

Lecture 42 Determining Internal Node Values

Lecture 42 Determining Internal Node Values Lecture 42 Determining Internal Node Values As seen in the previous section, a finite element solution of a boundary value problem boils down to finding the best values of the constants {C j } n, which

More information

Founda'ons of Large- Scale Mul'media Informa'on Management and Retrieval. Lecture #3 Machine Learning. Edward Chang

Founda'ons of Large- Scale Mul'media Informa'on Management and Retrieval. Lecture #3 Machine Learning. Edward Chang Founda'ons of Large- Scale Mul'media Informa'on Management and Retrieval Lecture #3 Machine Learning Edward Y. Chang Edward Chang Founda'ons of LSMM 1 Edward Chang Foundations of LSMM 2 Machine Learning

More information

MA/CS 109 Lecture 7. Back To Exponen:al Growth Popula:on Models

MA/CS 109 Lecture 7. Back To Exponen:al Growth Popula:on Models MA/CS 109 Lecture 7 Back To Exponen:al Growth Popula:on Models Homework this week 1. Due next Thursday (not Tuesday) 2. Do most of computa:ons in discussion next week 3. If possible, bring your laptop

More information

Class Notes. Examining Repeated Measures Data on Individuals

Class Notes. Examining Repeated Measures Data on Individuals Ronald Heck Week 12: Class Notes 1 Class Notes Examining Repeated Measures Data on Individuals Generalized linear mixed models (GLMM) also provide a means of incorporang longitudinal designs with categorical

More information

COMP 562: Introduction to Machine Learning

COMP 562: Introduction to Machine Learning COMP 562: Introduction to Machine Learning Lecture 20 : Support Vector Machines, Kernels Mahmoud Mostapha 1 Department of Computer Science University of North Carolina at Chapel Hill mahmoudm@cs.unc.edu

More information

Quan&fying Uncertainty. Sai Ravela Massachuse7s Ins&tute of Technology

Quan&fying Uncertainty. Sai Ravela Massachuse7s Ins&tute of Technology Quan&fying Uncertainty Sai Ravela Massachuse7s Ins&tute of Technology 1 the many sources of uncertainty! 2 Two days ago 3 Quan&fying Indefinite Delay 4 Finally 5 Quan&fying Indefinite Delay P(X=delay M=

More information

Moist convec+on in models (and observa+ons)

Moist convec+on in models (and observa+ons) Moist convec+on in models (and observa+ons) Cathy Hohenegger Moist convec+on in models (and observa+ons) Cathy Hohenegger How do we parameterize convec+on? Precipita)on response to soil moisture Increase

More information

Euler s Method, Taylor Series Method, Runge Kutta Methods, Multi-Step Methods and Stability.

Euler s Method, Taylor Series Method, Runge Kutta Methods, Multi-Step Methods and Stability. Euler s Method, Taylor Series Method, Runge Kutta Methods, Multi-Step Methods and Stability. REVIEW: We start with the differential equation dy(t) dt = f (t, y(t)) (1.1) y(0) = y 0 This equation can be

More information

Eirik Endeve. Simula'ons of SASI, turbulence, and magne'c field amplifica'on

Eirik Endeve. Simula'ons of SASI, turbulence, and magne'c field amplifica'on Simula'ons of SASI, turbulence, and magne'c field amplifica'on INT Program INT- 12-2a: Core- Collapse Supernovae: Models and Observable Signals Eirik Endeve Funding: DoE Office of Advanced Scien'fic Compu'ng

More information

Computer Vision. Pa0ern Recogni4on Concepts Part I. Luis F. Teixeira MAP- i 2012/13

Computer Vision. Pa0ern Recogni4on Concepts Part I. Luis F. Teixeira MAP- i 2012/13 Computer Vision Pa0ern Recogni4on Concepts Part I Luis F. Teixeira MAP- i 2012/13 What is it? Pa0ern Recogni4on Many defini4ons in the literature The assignment of a physical object or event to one of

More information

Ordinary differentiall equations

Ordinary differentiall equations Ordinary differentiall equations Finite element method Divide macroscopic object into small pieces Can investigate real-size objects in real world time regimes Disregarding of atomic nature of matter

More information

Example 3.3 Moving-average filter

Example 3.3 Moving-average filter 3.3 Difference Equa/ons for Discrete-Time Systems A Discrete-/me system can be modeled with difference equa3ons involving current, past, or future samples of input and output signals Example 3.3 Moving-average

More information

DART Tutorial Part IV: Other Updates for an Observed Variable

DART Tutorial Part IV: Other Updates for an Observed Variable DART Tutorial Part IV: Other Updates for an Observed Variable UCAR The Na'onal Center for Atmospheric Research is sponsored by the Na'onal Science Founda'on. Any opinions, findings and conclusions or recommenda'ons

More information

CSE 473: Ar+ficial Intelligence. Hidden Markov Models. Bayes Nets. Two random variable at each +me step Hidden state, X i Observa+on, E i

CSE 473: Ar+ficial Intelligence. Hidden Markov Models. Bayes Nets. Two random variable at each +me step Hidden state, X i Observa+on, E i CSE 473: Ar+ficial Intelligence Bayes Nets Daniel Weld [Most slides were created by Dan Klein and Pieter Abbeel for CS188 Intro to AI at UC Berkeley. All CS188 materials are available at hnp://ai.berkeley.edu.]

More information

Scott Gaudi The Ohio State University Sagan Summer Workshop August 9, 2017

Scott Gaudi The Ohio State University Sagan Summer Workshop August 9, 2017 Single Lens Lightcurve Modeling Scott Gaudi The Ohio State University Sagan Summer Workshop August 9, 2017 Outline. Basic Equations. Limits. Derivatives. Degeneracies. Fitting. Linear Fits. Multiple Observatories.

More information

GEOG 401 Climate Change

GEOG 401 Climate Change GEOG 401 Climate Change Climate Downscaling GCMs have coarse resolu/on Spa

More information

Priors in Dependency network learning

Priors in Dependency network learning Priors in Dependency network learning Sushmita Roy sroy@biostat.wisc.edu Computa:onal Network Biology Biosta2s2cs & Medical Informa2cs 826 Computer Sciences 838 hbps://compnetbiocourse.discovery.wisc.edu

More information

Introduc)on to MATLAB for Control Engineers. EE 447 Autumn 2008 Eric Klavins

Introduc)on to MATLAB for Control Engineers. EE 447 Autumn 2008 Eric Klavins Introduc)on to MATLAB for Control Engineers EE 447 Autumn 28 Eric Klavins Part I Matrices and Vectors Whitespace separates entries and a semicolon separates rows. >> A=[1 2 3; 4 5 6; 7 8 9]; # A 3x3 matrix

More information

Gene Regulatory Networks II Computa.onal Genomics Seyoung Kim

Gene Regulatory Networks II Computa.onal Genomics Seyoung Kim Gene Regulatory Networks II 02-710 Computa.onal Genomics Seyoung Kim Goal: Discover Structure and Func;on of Complex systems in the Cell Identify the different regulators and their target genes that are

More information

Printone: Interac:ve Resonance Simula:on for Free-form Print-wind Instrument Design. Nobuyuki Umetani Athina Panotopoulou Ryan Schmidt Emily Whi:ng

Printone: Interac:ve Resonance Simula:on for Free-form Print-wind Instrument Design. Nobuyuki Umetani Athina Panotopoulou Ryan Schmidt Emily Whi:ng Printone: Interac:ve Resonance Simula:on for Free-form Print-wind Instrument Design Nobuyuki Umetani Athina Panotopoulou Ryan Schmidt Emily Whi:ng Free-form Wind-musical Instruments Simula:on & op:miza:on

More information

Applied Time Series Analysis FISH 507. Eric Ward Mark Scheuerell Eli Holmes

Applied Time Series Analysis FISH 507. Eric Ward Mark Scheuerell Eli Holmes Applied Time Series Analysis FISH 507 Eric Ward Mark Scheuerell Eli Holmes Introduc;ons Who are we? Who & why you re here? What are you looking to get from this class? Days and Times Lectures When: Tues

More information

Reduced Models for Process Simula2on and Op2miza2on

Reduced Models for Process Simula2on and Op2miza2on Reduced Models for Process Simulaon and Opmizaon Yidong Lang, Lorenz T. Biegler and David Miller ESI annual meeng March, 0 Models are mapping Equaon set or Module simulators Input space Reduced model Surrogate

More information

CHAPTER 3 : MATHEMATICAL MODELLING PRINCIPLES

CHAPTER 3 : MATHEMATICAL MODELLING PRINCIPLES CHAPTER 3 : MATHEMATICAL MODELLING PRINCIPLES When I complete this chapter, I want to be able to do the following. Formulate dynamic models based on fundamental balances Solve simple first-order linear

More information

Fundamentals of Data Assimila1on

Fundamentals of Data Assimila1on 2015 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO August 11-14, 2015 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University

More information

CSE 473: Ar+ficial Intelligence

CSE 473: Ar+ficial Intelligence CSE 473: Ar+ficial Intelligence Hidden Markov Models Luke Ze@lemoyer - University of Washington [These slides were created by Dan Klein and Pieter Abbeel for CS188 Intro to AI at UC Berkeley. All CS188

More information

Transient Heat Conduction in a Circular Cylinder

Transient Heat Conduction in a Circular Cylinder Transient Heat Conduction in a Circular Cylinder The purely radial 2-D heat equation will be solved in cylindrical coordinates using variation of parameters. Assuming radial symmetry the solution is represented

More information

Slides modified from: PATTERN RECOGNITION AND MACHINE LEARNING CHRISTOPHER M. BISHOP

Slides modified from: PATTERN RECOGNITION AND MACHINE LEARNING CHRISTOPHER M. BISHOP Slides modified from: PATTERN RECOGNITION AND MACHINE LEARNING CHRISTOPHER M. BISHOP Predic?ve Distribu?on (1) Predict t for new values of x by integra?ng over w: where The Evidence Approxima?on (1) The

More information

ODEs + Singulari0es + Monodromies + Boundary condi0ons. Kerr BH ScaRering: a systema0c study. Schwarzschild BH ScaRering: Quasi- normal modes

ODEs + Singulari0es + Monodromies + Boundary condi0ons. Kerr BH ScaRering: a systema0c study. Schwarzschild BH ScaRering: Quasi- normal modes Outline Introduc0on Overview of the Technique ODEs + Singulari0es + Monodromies + Boundary condi0ons Results Kerr BH ScaRering: a systema0c study Schwarzschild BH ScaRering: Quasi- normal modes Collabora0on:

More information

Some thoughts on linearity, nonlinearity, and partial separability

Some thoughts on linearity, nonlinearity, and partial separability Some thoughts on linearity, nonlinearity, and partial separability Paul Hovland Argonne Na0onal Laboratory Joint work with Boyana Norris, Sri Hari Krishna Narayanan, Jean Utke, Drew Wicke Argonne Na0onal

More information

Lecture 12 The Level Set Approach for Turbulent Premixed Combus=on

Lecture 12 The Level Set Approach for Turbulent Premixed Combus=on Lecture 12 The Level Set Approach for Turbulent Premixed Combus=on 12.- 1 A model for premixed turbulent combus7on, based on the non- reac7ng scalar G rather than on progress variable, has been developed

More information

Regression.

Regression. Regression www.biostat.wisc.edu/~dpage/cs760/ Goals for the lecture you should understand the following concepts linear regression RMSE, MAE, and R-square logistic regression convex functions and sets

More information

Stochas(c Dual Ascent Linear Systems, Quasi-Newton Updates and Matrix Inversion

Stochas(c Dual Ascent Linear Systems, Quasi-Newton Updates and Matrix Inversion Stochas(c Dual Ascent Linear Systems, Quasi-Newton Updates and Matrix Inversion Peter Richtárik (joint work with Robert M. Gower) University of Edinburgh Oberwolfach, March 8, 2016 Part I Stochas(c Dual

More information

Sensi&vity Analysis and Least Squares Parameter Es&ma&on for an Epidemic Model. Alun L. Lloyd

Sensi&vity Analysis and Least Squares Parameter Es&ma&on for an Epidemic Model. Alun L. Lloyd Sensi&vity Analysis and Least Squares Parameter Es&ma&on for an Epidemic Model Alun L. Lloyd Department of Mathema&cs Biomathema&cs Graduate Program Center for Quan&ta&ve Sciences in Biomedicine North

More information

7. Quantum Monte Carlo (QMC)

7. Quantum Monte Carlo (QMC) Molecular Simulations with Chemical and Biological Applications (Part I) 7. Quantum Monte Carlo (QMC) Dr. Mar(n Steinhauser 1 HS 2014 Molecular Simula(ons with Chemical and Biological Applica(ons 1 Introduc5on

More information

Temporal Models.

Temporal Models. Temporal Models www.cs.wisc.edu/~page/cs760/ Goals for the lecture (with thanks to Irene Ong, Stuart Russell and Peter Norvig, Jakob Rasmussen, Jeremy Weiss, Yujia Bao, Charles Kuang, Peggy Peissig, and

More information

Introduction to ecosystem modelling Stages of the modelling process

Introduction to ecosystem modelling Stages of the modelling process NGEN02 Ecosystem Modelling 2018 Introduction to ecosystem modelling Stages of the modelling process Recommended reading: Smith & Smith Environmental Modelling, Chapter 2 Models in science and research

More information

Compe&&ve Kine&c Isotope Effects

Compe&&ve Kine&c Isotope Effects Compe&&ve Kine&c Isotope Effects Absolute Rates: - - - measure rate of H vs. D in separate flasks observa&on of primary KIE is unambiguous evidence for rate- determining C- H cleavage subject to rela&vely

More information

Latent Dirichlet Alloca/on

Latent Dirichlet Alloca/on Latent Dirichlet Alloca/on Blei, Ng and Jordan ( 2002 ) Presented by Deepak Santhanam What is Latent Dirichlet Alloca/on? Genera/ve Model for collec/ons of discrete data Data generated by parameters which

More information

Mul$- model ensemble challenge ini$al/model uncertain$es

Mul$- model ensemble challenge ini$al/model uncertain$es Mul$- model ensemble challenge ini$al/model uncertain$es Yuejian Zhu Ensemble team leader Environmental Modeling Center NCEP/NWS/NOAA Acknowledgments: EMC ensemble team staffs Presenta$on for WMO/WWRP

More information

Checking the Radioactive Decay Euler Algorithm

Checking the Radioactive Decay Euler Algorithm Lecture 2: Checking Numerical Results Review of the first example: radioactive decay The radioactive decay equation dn/dt = N τ has a well known solution in terms of the initial number of nuclei present

More information

Logistic Map, Euler & Runge-Kutta Method and Lotka-Volterra Equations

Logistic Map, Euler & Runge-Kutta Method and Lotka-Volterra Equations Logistic Map, Euler & Runge-Kutta Method and Lotka-Volterra Equations S. Y. Ha and J. Park Department of Mathematical Sciences Seoul National University Sep 23, 2013 Contents 1 Logistic Map 2 Euler and

More information

Basic Analysis of Data

Basic Analysis of Data Basic Analysis of Data Department of Chemical Engineering Prof. Geoff Silcox Fall 008 1.0 Reporting the Uncertainty in a Measured Quantity At the request of your supervisor, you have ventured out into

More information

CSE446: Linear Regression Regulariza5on Bias / Variance Tradeoff Winter 2015

CSE446: Linear Regression Regulariza5on Bias / Variance Tradeoff Winter 2015 CSE446: Linear Regression Regulariza5on Bias / Variance Tradeoff Winter 2015 Luke ZeElemoyer Slides adapted from Carlos Guestrin Predic5on of con5nuous variables Billionaire says: Wait, that s not what

More information

Molecular Dynamics. Molecules in motion

Molecular Dynamics. Molecules in motion Molecular Dynamics Molecules in motion 1 Molecules in mo1on Molecules are not sta1c, but move all the 1me Source: h9p://en.wikipedia.org/wiki/kine1c_theory 2 Gasses, liquids and solids Gasses, liquids

More information

Advanced Protein Models again: adding regulation

Advanced Protein Models again: adding regulation Advanced Protein Models again: adding regulation James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University April 1, 2014 Outline 1 Simple Regulations

More information

One- factor ANOVA. F Ra5o. If H 0 is true. F Distribu5on. If H 1 is true 5/25/12. One- way ANOVA: A supersized independent- samples t- test

One- factor ANOVA. F Ra5o. If H 0 is true. F Distribu5on. If H 1 is true 5/25/12. One- way ANOVA: A supersized independent- samples t- test F Ra5o F = variability between groups variability within groups One- factor ANOVA If H 0 is true random error F = random error " µ F =1 If H 1 is true random error +(treatment effect)2 F = " µ F >1 random

More information

Parameter Es*ma*on: Cracking Incomplete Data

Parameter Es*ma*on: Cracking Incomplete Data Parameter Es*ma*on: Cracking Incomplete Data Khaled S. Refaat Collaborators: Arthur Choi and Adnan Darwiche Agenda Learning Graphical Models Complete vs. Incomplete Data Exploi*ng Data for Decomposi*on

More information

Numerical Algorithms for ODEs/DAEs (Transient Analysis)

Numerical Algorithms for ODEs/DAEs (Transient Analysis) Numerical Algorithms for ODEs/DAEs (Transient Analysis) Slide 1 Solving Differential Equation Systems d q ( x(t)) + f (x(t)) + b(t) = 0 dt DAEs: many types of solutions useful DC steady state: state no

More information

1. Introduc9on 2. Bivariate Data 3. Linear Analysis of Data

1. Introduc9on 2. Bivariate Data 3. Linear Analysis of Data Lecture 3: Bivariate Data & Linear Regression 1. Introduc9on 2. Bivariate Data 3. Linear Analysis of Data a) Freehand Linear Fit b) Least Squares Fit c) Interpola9on/Extrapola9on 4. Correla9on 1. Introduc9on

More information

Solution of ordinary Differential Equations

Solution of ordinary Differential Equations 42 Chapter 4 Solution of ordinary Differential Equations Highly suggested Reading Press et al., 1992. Numerical Recipes, 2nd Edition. Chapter 16. (Good description). See also chapter 17. And Matlab help

More information

Alfred University Dept. of Physics and Astronomy

Alfred University Dept. of Physics and Astronomy Lecture 16:he ool- Narayanaswamy- Moynihan Equa;on Part II and DSC March 11, 21 Dr. Roger Loucks Alfred University Dept. of Physics and Astronomy loucks@alfred.edu First, let s review! Narayanaswamy assumed

More information

Miscellaneous Thoughts on Ocean Data Assimilation

Miscellaneous Thoughts on Ocean Data Assimilation Miscellaneous Thoughts on Ocean Data Assimilation Mike Dowd Dept of Mathematics & Statistics (and Dept of Oceanography) Dalhousie University, Halifax, Canada STATMOS Summer School in Data Assimila5on,

More information

Week 3 Lecture 1 Ages from Isotope Ra7os

Week 3 Lecture 1 Ages from Isotope Ra7os Week 3 Lecture 1 Ages from Isotope Ra7os Nuclear Decay - - Decay Law - - Simplest form of kine7cs - - Sequen7al Decay (three groups) - - Radioac7ve da7ng, Ages & Natural Ac7vi7es The Persistence of Memory,

More information

Announcements. Topics: Work On: - sec0ons 1.2 and 1.3 * Read these sec0ons and study solved examples in your textbook!

Announcements. Topics: Work On: - sec0ons 1.2 and 1.3 * Read these sec0ons and study solved examples in your textbook! Announcements Topics: - sec0ons 1.2 and 1.3 * Read these sec0ons and study solved examples in your textbook! Work On: - Prac0ce problems from the textbook and assignments from the coursepack as assigned

More information

Causal Inference and Response Surface Modeling. Inference and Representa6on DS- GA Fall 2015 Guest lecturer: Uri Shalit

Causal Inference and Response Surface Modeling. Inference and Representa6on DS- GA Fall 2015 Guest lecturer: Uri Shalit Causal Inference and Response Surface Modeling Inference and Representa6on DS- GA- 1005 Fall 2015 Guest lecturer: Uri Shalit What is Causal Inference? source: xkcd.com/552/ 2/53 Causal ques6ons as counterfactual

More information

the gravitational-wave memory Marc Favata

the gravitational-wave memory Marc Favata the gravitational-wave memory Marc Favata Outline of this talk: What is the memory and why is it interes0ng? How do we calculate the memory? Is it observable? Examples of memory: Two- body sca

More information

Aggrega?on of Epistemic Uncertainty

Aggrega?on of Epistemic Uncertainty Aggrega?on of Epistemic Uncertainty - Certainty Factors and Possibility Theory - Koichi Yamada Nagaoka Univ. of Tech. 1 What is Epistemic Uncertainty? Epistemic Uncertainty Aleatoric Uncertainty (Sta?s?cal

More information

Modeling and Experimentation: Compound Pendulum

Modeling and Experimentation: Compound Pendulum Modeling and Experimentation: Compound Pendulum Prof. R.G. Longoria Department of Mechanical Engineering The University of Texas at Austin Fall 2014 Overview This lab focuses on developing a mathematical

More information

ASTRO 310: Galac/c & Extragalac/c Astronomy Prof. Jeff Kenney

ASTRO 310: Galac/c & Extragalac/c Astronomy Prof. Jeff Kenney ASTRO 310: Galac/c & Extragalac/c Astronomy Prof. Jeff Kenney Class 9 September 26, 2018 Introduc/on to Stellar Dynamics: Poten/al Theory & Mass Distribu/ons & Mo/ons Gravity & Stellar Systems ~Only force

More information