Stochastic Mode Reduction in Large Deterministic Systems

Size: px
Start display at page:

Download "Stochastic Mode Reduction in Large Deterministic Systems"

Transcription

1 Stochastic Mode Reduction in Large Deterministic Systems I. Timofeyev University of Houston With A. J. Majda and E. Vanden-Eijnden; NYU Related Publications: ilya

2 Plan Mode-Elimination as a Limit of Infinite Separation of Time-Scales Mode-Elimination for Conservative Systems Example - Truncated Burgers-Hopf Equation Numerical Verification of the Limiting Behavior Conservative Mode-Elimination Comparison with Direct Numerical Simulations Balance of Terms

3 Essence of Mode-Reduction Dynamical Variables: Ż = f(z) Decomposition: Z = (Essential, N on Essential) = (SLOW, F AST ) Goal: Eliminate Fast modes; equation for Slow Dynamics Derive Closed-Form Motivation: Interested Only in Statistical Behavior of the Slow Dynamics Asymptotic Approach: Limit T ime Scale{F AST } T ime Scale{SLOW }

4 Rewrite the Original System Ż = f(z) Decomposition: Z = (SLOW, F AST ) (X, Y ) Quadratic System: Ẋ = {X, X} + {Y, X} + {Y, Y } Ẏ = {X, X} + {Y, X} + {Y, Y } Conservation of Energy: d dt E = d dt ( X 2 + Y 2) = 2XẊ + 2Y Ẏ = {X, X, X}+{X, X, Y }+{Y, Y, X}+{Y, Y, Y } = 0

5 Modify the Original System Main Idea: Introduce ε in the Equations Preserve Conservation of Energy Modified System Ẋ = {X, X} + 1 ε {Y, X} + 1 ε {Y, Y } Ẏ = 1 ε {X, X} + 1 ε {Y, X} + 1 ε 2{Y, Y } Conservation of Energy: Ė = {X, X, X}+ 1 ε {X, X, Y }+1 ε {Y, Y, X}+ 1 ε2{y, Y, Y } = 0 ε = 1 Corresponds to the Original System Conserves Energy Ẏ {Y, Y } Numerical & Analytical Approaches

6 Truncated Burgers-Hopf Model Fourier-Galerkin Projection of u t + uu x = 0 onto a nite number of Fourier modes u = û k e ikx, 1 k Λ 2Λ-dimensional system of ODEs d dtûk = ik 2 û pû q p+q+k=0 with Reality Condition û k = û k Main Features Conservation of Energy û k 2 ; Equipartition Correlation scaling Corr.T ime{û k } k 1 Gaussian distribution in the limit Λ Hamiltonian H = 1 6 u 3 Λ dx

7 û 1 is the Slow Mode Consider: SLOW = û 1, F AST = {û 2... û Λ } Time-Scale Separation: Corr.T ime{slow } Corr.T ime{f AST } = 2 Modified System: d = i dtû1 2ε p+q+1=0 2 p, q Λ û pû q, d = ik dtûk 2ε [û k+1û 1 + û k 1û 1 ] ik 2ε 2 k+p+q=0 2 p, q Λ û pû q

8 Numerical Approach Goal: Verify Existence of the Reduced Dynamics Also: Understand the shape of the Limit Approach: Simulate Modified System with ε = 1, 0.5, 0.25, ε=1 ε=0.5 ε=0.25 ε= Re u 1 PDF of Re û 1

9 Numerical Approach More Severe Test: Behavior of the Two-Point Statistics Re û 1 (t)re û 1 (t + s) ε = 1, 0.5, 0.25, ε=1 ε=0.5 ε=0.25 ε= Lag Corr. Function of Re û 1 Corr.Time ε=1 = 2.64, Corr.Time ε=0.1 = 2.4

10 Numerical Approach Question: How fast the Bump Disappears Approach: Simulate Modified System with ε = 1, 0.9, 0.8, ε=1 ε=0.9 ε=0.8 ε= Corr. Function of Re û 1

11 Analytical Approach Equation: Ẋ = 1 ε f(x, Y ) Ẏ = 1 ε 2g(X, Y ) Effective Equation: dx = ā(x)dt + b(x)dw ā = 0 dt dµ(y )f(x, Y (0)) X f (X, Y (t)) b 2 = 0 dt dµ(y )f(x, Y (0))f (X, Y (t))

12 Overview of the Approach Backward Equation pε s = 1 ε 2L 1p ε + 1 ε L 2p ε Represent formally as Power Series p ε = p 0 + εp 1 + ε 2 p Collect terms and impose solvability condition p 0 s = PL 2L 1 1 L 2Pp 0 PL 2 P = 0

13 Derivation of the Reduced Model Consider a general quadratic system of equations for the variables x = {x i } and y = {y i } ẋ i = ε 1 j,k m xxy ijk x jy k + ε 1 j,k m xyy ijk y jy k ẏ i = ε 1 j,k m yxx ijk x jx k + ε 1 j,k m yxy ijk x jy k + ε 2 j,k m yyy ijk y jy k Volume Preserving => Consider Liouville Equation pε s = 1 ε 2L 1p ε + 1 ε L 2p ε L 2 = i,j,k i,j,k L 1 = i,j,k m xxy ijk x jy k + m yyy ijk y jy k y i m yxx ijk x jx k + m xyy i,j,k m yxy i,j,k ijk y jy k ijk x jy k x i + y i

14 Derivation of the Reduced Model Compute L = PL 2 L 1 1 L 2P P - IM of the fast subsystem on E fast = E x 2 L Shift fast variables in time; Integrate for all times L = i B i (x) x i + i,j D ij (x) x i x j Where D ij (x) = E 1/2 (x) 0 dt dµ N (y)p i (y(0))p j (y(t)) P i (y) = j,k m xxy ijk x jy k + E 1/2 (x) j,k m xyy ijk y jy k E(x) := (E x 2 )/N B i (x) = (1 2N 1 )E 1 (x) j D ij (x)x j

15 Reduced Model for û 1 dû 1 = B( û 1 )û 1 dt + σ( û 1 )dw (t) Additional Assumptions: Correlation Matrix, etc. Ergodicity, Structure of the B( û 1 2 ) = 2 EI 2 I 2 E û 1 2 [ N ] EIf σ 2 ( û 1 2 ) = 2 E û 1 2 I ( E ) 3 If E = E( û 1 2 ) = (E û 1 2 )/N where E - Total Energy of the System N - Number of Fast Modes I 2 - Corr.Time(û 2 ) I f - Corr.Time(RHS of û 1 projected onto Fast Modes)

16 Reduced Model for u 1 Need to Know: Moments of Fast Modes Simplification: Can be Recast as CF of RHS û 1 Approach: Compute Correlations from a single microcanonical realization of the fast subsystem {y k } dû 1 = B( û 1 )û 1 dt + σ( û 1 )dw (t) B = 2 EI 2 I [ 2 û ] EIf E N B( u 1 2 ) u 1 2 Drift Term B( û 1 ); Total Energy E = 0.4 I 2 = 0.14, I f = 4.3

17 Reduced Model for û 1 One Point Statistics: Perfect Agreement Full TBH Reduced PDF of Re û 1 Blue - DNS with 20 Modes Magenta - Reduced Equation

18 Reduced Model for û 1 Two Point Statistics: Cannot Reproduce DNS Exactly Analytical vs Numerical: Should be Identical; It s the same Limit ε Full TBH Reduced ε= Correlation Function of û 1 Blue - DNS with 20 Modes Magenta - Reduced Equation Black - Modified Equation with ε = 0.1

19 û 1 and û 2 are the Slow Modes Consider: SLOW = {û 1, û 2 }, F AST = {û 3... û Λ } Time-Scale Separation: Corr.T ime{slow } Corr.T ime{f AST } = 3 2 Modified System: d = iû 2 û dtû1 1 i 2ε d dtû2 = iû 2 1 i ε p+q+1=0 3 p, q Λ p+q+2=0 3 p, q Λ û pû q, û pû q, d = ik dtûk 2ε (û k+1û 1 + û k 1û 1 ) ik 2ε (û k+2û 2 + û k 2û 2 ) ik 2ε 2 p+q+k=0 3 p, q Λ û pû q

20 Numerical Approach Question: Can we recover Bump Structure with More Modes? Approach: Simulate Modified System with ε = 1, 0.5, 0.25, ε=1 ε=0.5 ε=0.25 ε= Lag Correlation Function of Re û 1

21 Reduced Model for û 1 and û 2 Analytical vs Numerical: Should be Identical; It s the same Limit ε Full TBH Reduced ε= Lag Correlation Function of û 1 Blue - DNS with 20 Modes Magenta - Reduced Equation Black - Modified Equation with ε = 0.1

22 Reduced Model for û 1 and û 2 Include More Modes: Discrepancies are Larger for û Full TBH Reduced ε= Lag Correlation Function of û 2 Blue - DNS with 20 Modes Magenta - Reduced Equation Black - Modified Equation with ε = 0.1

23 Multiplicative Noise vs Additive Noise Ẋ = {X, X} + 1 ε {Y, X} + 1 ε {Y, Y } Ẏ = 1 ε {X, X} + 1 ε {Y, X} + 1 ε 2{Y, Y } Intuition: Y Noise {Y, X} Mult Noise + Cubic Damping {Y, Y } Additive Noise + Linear Damping

24 Reduced Model for û 1 and û 2 Additional Advantage: Can Analyze Balance of Various Terms Mult. Noise: Contribution 6% 0.8 Full TBH Reduced No Mult Noise Lag Correlation Function of û 1 Blue - DNS with 20 Modes Magenta - Reduced Equation Red - Reduced Equation without Mult. Noise Terms

25 Conclusions Effectively computable theory for deriving closed systems of reduced equations for slow variables No ad-hoc assumtions about the fast modes are necessary Parameters are Estimated from a single microcanonical simulation Necessary Information can be recast in terms of correlation functions of the RHS Numerical and Analytical Approaches Analyze the source of discrepancies Better understanding of the Limit Analyze Balance of Various Terms

Introduction to asymptotic techniques for stochastic systems with multiple time-scales

Introduction to asymptotic techniques for stochastic systems with multiple time-scales Introduction to asymptotic techniques for stochastic systems with multiple time-scales Eric Vanden-Eijnden Courant Institute Motivating examples Consider the ODE {Ẋ = Y 3 + sin(πt) + cos( 2πt) X() = x

More information

Stochastic models for selected slow variables in large deterministic systems

Stochastic models for selected slow variables in large deterministic systems INSTITUTE OF PHYSICS PUBLISHING Nonlinearity 19 (26) 769 794 NONLINEARITY doi:1.188/951-7715/19/4/1 Stochastic models for selected slow variables in large deterministic systems A Majda 1,2, I Timofeyev

More information

Low-dimensional chaotic dynamics versus intrinsic stochastic noise: a paradigm model

Low-dimensional chaotic dynamics versus intrinsic stochastic noise: a paradigm model Physica D 199 (2004) 339 368 Low-dimensional chaotic dynamics versus intrinsic stochastic noise: a paradigm model A. Majda a,b, I. Timofeyev c, a Courant Institute of Mathematical Sciences, New York University,

More information

Statistical Mechanics for the Truncated Quasi-Geostrophic Equations

Statistical Mechanics for the Truncated Quasi-Geostrophic Equations Statistical Mechanics for the Truncated Quasi-Geostrophic Equations Di Qi, and Andrew J. Majda Courant Institute of Mathematical Sciences Fall 6 Advanced Topics in Applied Math Di Qi, and Andrew J. Majda

More information

Mathematical Theories of Turbulent Dynamical Systems

Mathematical Theories of Turbulent Dynamical Systems Mathematical Theories of Turbulent Dynamical Systems Di Qi, and Andrew J. Majda Courant Institute of Mathematical Sciences Fall 2016 Advanced Topics in Applied Math Di Qi, and Andrew J. Majda (CIMS) Mathematical

More information

SUBGRID-SCALE CLOSURE FOR THE INVISCID BURGERS-HOPF EQUATION

SUBGRID-SCALE CLOSURE FOR THE INVISCID BURGERS-HOPF EQUATION SUBGRID-SCALE CLOSURE FOR THE INVISCID BURGERS-HOPF EQUATION S. I. DOLAPTCHIEV, I. TIMOFEYEV, AND U. ACHATZ Abstract. A method is presented for constructing effective stochastic models for the timeevolution

More information

1. Introduction Systems evolving on widely separated time-scales represent a challenge for numerical simulations. A generic example is

1. Introduction Systems evolving on widely separated time-scales represent a challenge for numerical simulations. A generic example is COMM. MATH. SCI. Vol. 1, No. 2, pp. 385 391 c 23 International Press FAST COMMUNICATIONS NUMERICAL TECHNIQUES FOR MULTI-SCALE DYNAMICAL SYSTEMS WITH STOCHASTIC EFFECTS ERIC VANDEN-EIJNDEN Abstract. Numerical

More information

Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows

Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows SP and DSS for Filtering Sparse Geophysical Flows Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows Presented by Nan Chen, Michal Branicki and Chenyue

More information

Uncertainty Quantification in Computational Science

Uncertainty Quantification in Computational Science DTU 2010 - Lecture I Uncertainty Quantification in Computational Science Jan S Hesthaven Brown University Jan.Hesthaven@Brown.edu Objective of lectures The main objective of these lectures are To offer

More information

Introduction to multiscale modeling and simulation. Explicit methods for ODEs : forward Euler. y n+1 = y n + tf(y n ) dy dt = f(y), y(0) = y 0

Introduction to multiscale modeling and simulation. Explicit methods for ODEs : forward Euler. y n+1 = y n + tf(y n ) dy dt = f(y), y(0) = y 0 Introduction to multiscale modeling and simulation Lecture 5 Numerical methods for ODEs, SDEs and PDEs The need for multiscale methods Two generic frameworks for multiscale computation Explicit methods

More information

Equilibrium Statistical Mechanics for the Truncated Burgers-Hopf Equations

Equilibrium Statistical Mechanics for the Truncated Burgers-Hopf Equations Equilibrium Statistical Mechanics for the Truncated Burgers-Hopf Equations Di Qi, and Andrew J. Majda Courant Institute of Mathematical Sciences Fall 2016 Advanced Topics in Applied Math Di Qi, and Andrew

More information

DATA-DRIVEN TECHNIQUES FOR ESTIMATION AND STOCHASTIC REDUCTION OF MULTI-SCALE SYSTEMS

DATA-DRIVEN TECHNIQUES FOR ESTIMATION AND STOCHASTIC REDUCTION OF MULTI-SCALE SYSTEMS DATA-DRIVEN TECHNIQUES FOR ESTIMATION AND STOCHASTIC REDUCTION OF MULTI-SCALE SYSTEMS A Dissertation Presented to the Faculty of the Department of Mathematics University of Houston In Partial Fulfillment

More information

A priori tests of a stochastic mode reduction strategy

A priori tests of a stochastic mode reduction strategy Physica D 170 (2002) 206 252 A priori tests of a stochastic mode reduction strategy A. Majda a,b, I. Timofeyev a,b, E. Vanden-Eijnden a, a Courant Institute of Mathematical Sciences, New Yor University,

More information

Controlled Diffusions and Hamilton-Jacobi Bellman Equations

Controlled Diffusions and Hamilton-Jacobi Bellman Equations Controlled Diffusions and Hamilton-Jacobi Bellman Equations Emo Todorov Applied Mathematics and Computer Science & Engineering University of Washington Winter 2014 Emo Todorov (UW) AMATH/CSE 579, Winter

More information

SUB-SAMPLING AND PARAMETRIC ESTIMATION FOR MULTISCALE DYNAMICS

SUB-SAMPLING AND PARAMETRIC ESTIMATION FOR MULTISCALE DYNAMICS SUB-SAMPLING AND PARAMETRIC ESTIMATION FOR MULTISCALE DYNAMICS R. AZENCOTT, A. BERI, A. JAIN, AND I. TIMOFEYEV Abstract. We study the problem of adequate data sub-sampling for consistent parametric estimation

More information

1 Phase Spaces and the Liouville Equation

1 Phase Spaces and the Liouville Equation Phase Spaces and the Liouville Equation emphasize the change of language from deterministic to probablistic description. Under the dynamics: ½ m vi = F i ẋ i = v i with initial data given. What is the

More information

MARKOV CHAIN AND TIME-DELAY REDUCED MODELING OF NONLINEAR SYSTEMS

MARKOV CHAIN AND TIME-DELAY REDUCED MODELING OF NONLINEAR SYSTEMS MARKOV CHAIN AND TIME-DELAY REDUCED MODELING OF NONLINEAR SYSTEMS A Dissertation Presented to the Faculty of the Department of Mathematics University of Houston In Partial Fulfillment of the Requirements

More information

SPDEs, criticality, and renormalisation

SPDEs, criticality, and renormalisation SPDEs, criticality, and renormalisation Hendrik Weber Mathematics Institute University of Warwick Potsdam, 06.11.2013 An interesting model from Physics I Ising model Spin configurations: Energy: Inverse

More information

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random

More information

Method 1: Geometric Error Optimization

Method 1: Geometric Error Optimization Method 1: Geometric Error Optimization we need to encode the constraints ŷ i F ˆx i = 0, rank F = 2 idea: reconstruct 3D point via equivalent projection matrices and use reprojection error equivalent projection

More information

UNIVERSITY OF SOUTHAMPTON. A foreign language dictionary (paper version) is permitted provided it contains no notes, additions or annotations.

UNIVERSITY OF SOUTHAMPTON. A foreign language dictionary (paper version) is permitted provided it contains no notes, additions or annotations. UNIVERSITY OF SOUTHAMPTON MATH055W SEMESTER EXAMINATION 03/4 MATHEMATICS FOR ELECTRONIC & ELECTRICAL ENGINEERING Duration: 0 min Solutions Only University approved calculators may be used. A foreign language

More information

Lecture 42 Determining Internal Node Values

Lecture 42 Determining Internal Node Values Lecture 42 Determining Internal Node Values As seen in the previous section, a finite element solution of a boundary value problem boils down to finding the best values of the constants {C j } n, which

More information

Kernel Method: Data Analysis with Positive Definite Kernels

Kernel Method: Data Analysis with Positive Definite Kernels Kernel Method: Data Analysis with Positive Definite Kernels 2. Positive Definite Kernel and Reproducing Kernel Hilbert Space Kenji Fukumizu The Institute of Statistical Mathematics. Graduate University

More information

Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows

Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows June 2013 Outline 1 Filtering Filtering: obtaining the best statistical estimation of a nature

More information

Systematic stochastic modeling. of atmospheric variability. Christian Franzke

Systematic stochastic modeling. of atmospheric variability. Christian Franzke Systematic stochastic modeling of atmospheric variability Christian Franzke Meteorological Institute Center for Earth System Research and Sustainability University of Hamburg Daniel Peavoy and Gareth Roberts

More information

Feedback Control of Turbulent Wall Flows

Feedback Control of Turbulent Wall Flows Feedback Control of Turbulent Wall Flows Dipartimento di Ingegneria Aerospaziale Politecnico di Milano Outline Introduction Standard approach Wiener-Hopf approach Conclusions Drag reduction A model problem:

More information

Stabilization and Passivity-Based Control

Stabilization and Passivity-Based Control DISC Systems and Control Theory of Nonlinear Systems, 2010 1 Stabilization and Passivity-Based Control Lecture 8 Nonlinear Dynamical Control Systems, Chapter 10, plus handout from R. Sepulchre, Constructive

More information

Stochastic Gradient Descent in Continuous Time

Stochastic Gradient Descent in Continuous Time Stochastic Gradient Descent in Continuous Time Justin Sirignano University of Illinois at Urbana Champaign with Konstantinos Spiliopoulos (Boston University) 1 / 27 We consider a diffusion X t X = R m

More information

Characteristic Functions in Radar and Sonar. Southeastern Symposium on System Theory

Characteristic Functions in Radar and Sonar. Southeastern Symposium on System Theory Characteristic Functions in Radar and Sonar Southeastern Symposium on System Theory March 18,2002 Stephen R. Addison Department of Physics and Astronomy University of Central Arkansas Conway, AR 72035

More information

Math 4263 Homework Set 1

Math 4263 Homework Set 1 Homework Set 1 1. Solve the following PDE/BVP 2. Solve the following PDE/BVP 2u t + 3u x = 0 u (x, 0) = sin (x) u x + e x u y = 0 u (0, y) = y 2 3. (a) Find the curves γ : t (x (t), y (t)) such that that

More information

PHY 396 K. Solutions for problems 1 and 2 of set #5.

PHY 396 K. Solutions for problems 1 and 2 of set #5. PHY 396 K. Solutions for problems 1 and of set #5. Problem 1a: The conjugacy relations  k,  k,, Ê k, Ê k, follow from hermiticity of the Âx and Êx quantum fields and from the third eq. 6 for the polarization

More information

Intersection of Ellipsoids

Intersection of Ellipsoids Intersection of Ellipsoids David Eberly, Geometric Tools, Redmond WA 9805 https://www.geometrictools.com/ This work is licensed under the Creative Commons Attribution 4.0 International License. To view

More information

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Kalman Filter Kalman Filter Predict: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Update: K = P k k 1 Hk T (H k P k k 1 Hk T + R) 1 x k k = x k k 1 + K(z k H k x k k 1 ) P k k =(I

More information

x R d, λ R, f smooth enough. Goal: compute ( follow ) equilibrium solutions as λ varies, i.e. compute solutions (x, λ) to 0 = f(x, λ).

x R d, λ R, f smooth enough. Goal: compute ( follow ) equilibrium solutions as λ varies, i.e. compute solutions (x, λ) to 0 = f(x, λ). Continuation of equilibria Problem Parameter-dependent ODE ẋ = f(x, λ), x R d, λ R, f smooth enough. Goal: compute ( follow ) equilibrium solutions as λ varies, i.e. compute solutions (x, λ) to 0 = f(x,

More information

Deterministic. Deterministic data are those can be described by an explicit mathematical relationship

Deterministic. Deterministic data are those can be described by an explicit mathematical relationship Random data Deterministic Deterministic data are those can be described by an explicit mathematical relationship Deterministic x(t) =X cos r! k m t Non deterministic There is no way to predict an exact

More information

A SIMPLE LINEAR RESPONSE CLOSURE APPROXIMATION FOR SLOW DYNAMICS OF A MULTISCALE SYSTEM WITH LINEAR COUPLING

A SIMPLE LINEAR RESPONSE CLOSURE APPROXIMATION FOR SLOW DYNAMICS OF A MULTISCALE SYSTEM WITH LINEAR COUPLING A SIMPLE LINEAR RESPONSE CLOSURE APPROXIMATION FOR SLOW DYNAMICS OF A MULTISCALE SYSTEM WITH LINEAR COUPLING RAFAIL V. ABRAMOV Abstract. Many applications of contemporary science involve multiscale dynamics,

More information

The Helmholtz theorem at last!

The Helmholtz theorem at last! Problem. The Helmholtz theorem at last! Recall in class the Helmholtz theorem that says that if if E =0 then E can be written as E = φ () if B =0 then B can be written as B = A (2) (a) Let n be a unit

More information

MATH 387 ASSIGNMENT 2

MATH 387 ASSIGNMENT 2 MATH 387 ASSIGMET 2 SAMPLE SOLUTIOS BY IBRAHIM AL BALUSHI Problem 4 A matrix A ra ik s P R nˆn is called symmetric if a ik a ki for all i, k, and is called positive definite if x T Ax ě 0 for all x P R

More information

Physics Constrained Nonlinear Regression Models for Time Series

Physics Constrained Nonlinear Regression Models for Time Series Physics Constrained Nonlinear Regression Models for Time Series Andrew J. Majda and John Harlim 2 Department of Mathematics and Center for Atmosphere and Ocean Science, Courant Institute of Mathematical

More information

Advanced Quantum Mechanics

Advanced Quantum Mechanics Advanced Quantum Mechanics Rajdeep Sensarma! sensarma@theory.tifr.res.in Lecture #22 Path Integrals and QM Recap of Last Class Statistical Mechanics and path integrals in imaginary time Imaginary time

More information

Two dimensional manifolds

Two dimensional manifolds Two dimensional manifolds We are given a real two-dimensional manifold, M. A point of M is denoted X and local coordinates are X (x, y) R 2. If we use different local coordinates, (x, y ), we have x f(x,

More information

Interest Rate Models:

Interest Rate Models: 1/17 Interest Rate Models: from Parametric Statistics to Infinite Dimensional Stochastic Analysis René Carmona Bendheim Center for Finance ORFE & PACM, Princeton University email: rcarmna@princeton.edu

More information

Statistical signal processing

Statistical signal processing Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable

More information

The Vlasov equation for cold dark matter and gravity

The Vlasov equation for cold dark matter and gravity The Vlasov equation for cold dark matter and gravity Alaric Erschfeld Ruprecht-Karls-Universität Heidelberg Master seminar, 25.11.2016 1 / 50 Table of Contents 1 Introduction 2 The Vlasov equation 3 Virial

More information

What is Classical Molecular Dynamics?

What is Classical Molecular Dynamics? What is Classical Molecular Dynamics? Simulation of explicit particles (atoms, ions,... ) Particles interact via relatively simple analytical potential functions Newton s equations of motion are integrated

More information

Lecture 4: Least Squares (LS) Estimation

Lecture 4: Least Squares (LS) Estimation ME 233, UC Berkeley, Spring 2014 Xu Chen Lecture 4: Least Squares (LS) Estimation Background and general solution Solution in the Gaussian case Properties Example Big picture general least squares estimation:

More information

The Derivative. Appendix B. B.1 The Derivative of f. Mappings from IR to IR

The Derivative. Appendix B. B.1 The Derivative of f. Mappings from IR to IR Appendix B The Derivative B.1 The Derivative of f In this chapter, we give a short summary of the derivative. Specifically, we want to compare/contrast how the derivative appears for functions whose domain

More information

where r n = dn+1 x(t)

where r n = dn+1 x(t) Random Variables Overview Probability Random variables Transforms of pdfs Moments and cumulants Useful distributions Random vectors Linear transformations of random vectors The multivariate normal distribution

More information

DIFFERENTIAL EQUATIONS

DIFFERENTIAL EQUATIONS DIFFERENTIAL EQUATIONS Chapter 1 Introduction and Basic Terminology Most of the phenomena studied in the sciences and engineering involve processes that change with time. For example, it is well known

More information

. p.1/31. Department Mathematics and Statistics Arizona State University. Don Jones

. p.1/31. Department Mathematics and Statistics Arizona State University. Don Jones Modified-Truncation Finite Difference Schemes. p.1/31 Department Mathematics and Statistics Arizona State University Don Jones dajones@math.asu.edu . p.2/31 Heat Equation t u = λu xx + f . p.2/31 Heat

More information

MATH443 PARTIAL DIFFERENTIAL EQUATIONS Second Midterm Exam-Solutions. December 6, 2017, Wednesday 10:40-12:30, SA-Z02

MATH443 PARTIAL DIFFERENTIAL EQUATIONS Second Midterm Exam-Solutions. December 6, 2017, Wednesday 10:40-12:30, SA-Z02 1 MATH443 PARTIAL DIFFERENTIAL EQUATIONS Second Midterm Exam-Solutions December 6 2017 Wednesday 10:40-12:30 SA-Z02 QUESTIONS: Solve any four of the following five problems [25]1. Solve the initial and

More information

ME3.6 Sheet 2 Answers

ME3.6 Sheet 2 Answers ME36 Sheet 2 Answers (i) We have dx/dt Ý6x 2xy Ý 8 fx,y,dy/dt y 2 Ý x 2 gx,y The critical points satisfy g y x and f Ý6x 2xy Ý 8 Substitute y x to get Ý6x 2x 2 Ý 8 x Ý 4x x 4 or Ý If instead we substitute

More information

Stochastic Processes

Stochastic Processes Elements of Lecture II Hamid R. Rabiee with thanks to Ali Jalali Overview Reading Assignment Chapter 9 of textbook Further Resources MIT Open Course Ware S. Karlin and H. M. Taylor, A First Course in Stochastic

More information

Recall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u u 2 2 = u 2. Geometric Meaning:

Recall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u u 2 2 = u 2. Geometric Meaning: Recall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u 2 1 + u 2 2 = u 2. Geometric Meaning: u v = u v cos θ. u θ v 1 Reason: The opposite side is given by u v. u v 2 =

More information

Systematic deviations from Gaussianity in models of quasigeostrophic turbulence

Systematic deviations from Gaussianity in models of quasigeostrophic turbulence PHYSICS OF FLUIDS 19, 116603 2007 Systematic deviations from Gaussianity in models of quasigeostrophic turbulence I. Timofeyev a Department of Mathematics, University of Houston, Houston, Texas 77204,

More information

6 The Fourier transform

6 The Fourier transform 6 The Fourier transform In this presentation we assume that the reader is already familiar with the Fourier transform. This means that we will not make a complete overview of its properties and applications.

More information

NONLOCAL DIFFUSION EQUATIONS

NONLOCAL DIFFUSION EQUATIONS NONLOCAL DIFFUSION EQUATIONS JULIO D. ROSSI (ALICANTE, SPAIN AND BUENOS AIRES, ARGENTINA) jrossi@dm.uba.ar http://mate.dm.uba.ar/ jrossi 2011 Non-local diffusion. The function J. Let J : R N R, nonnegative,

More information

Logistic Map, Euler & Runge-Kutta Method and Lotka-Volterra Equations

Logistic Map, Euler & Runge-Kutta Method and Lotka-Volterra Equations Logistic Map, Euler & Runge-Kutta Method and Lotka-Volterra Equations S. Y. Ha and J. Park Department of Mathematical Sciences Seoul National University Sep 23, 2013 Contents 1 Logistic Map 2 Euler and

More information

Realization theory for systems biology

Realization theory for systems biology Realization theory for systems biology Mihály Petreczky CNRS Ecole Central Lille, France February 3, 2016 Outline Control theory and its role in biology. Realization problem: an abstract formulation. Realization

More information

Problem reduction, memory and renormalization

Problem reduction, memory and renormalization Problem reduction, memory and renormalization Panos Stinis Northwest Institute for Advanced Computing Pacific Northwest National Laboratory A simple example The linear differential system for x(t) and

More information

These slides follow closely the (English) course textbook Pattern Recognition and Machine Learning by Christopher Bishop

These slides follow closely the (English) course textbook Pattern Recognition and Machine Learning by Christopher Bishop Music and Machine Learning (IFT68 Winter 8) Prof. Douglas Eck, Université de Montréal These slides follow closely the (English) course textbook Pattern Recognition and Machine Learning by Christopher Bishop

More information

Derivation of the GENERIC form of nonequilibrium thermodynamics from a statistical optimization principle

Derivation of the GENERIC form of nonequilibrium thermodynamics from a statistical optimization principle Derivation of the GENERIC form of nonequilibrium thermodynamics from a statistical optimization principle Bruce Turkington Univ. of Massachusetts Amherst An optimization principle for deriving nonequilibrium

More information

Stochastic Processes. A stochastic process is a function of two variables:

Stochastic Processes. A stochastic process is a function of two variables: Stochastic Processes Stochastic: from Greek stochastikos, proceeding by guesswork, literally, skillful in aiming. A stochastic process is simply a collection of random variables labelled by some parameter:

More information

Quantum Mechanics for Scientists and Engineers. David Miller

Quantum Mechanics for Scientists and Engineers. David Miller Quantum Mechanics for Scientists and Engineers David Miller Vector spaces, operators and matrices Vector spaces, operators and matrices Vector space Vector space We need a space in which our vectors exist

More information

Finite Difference and Finite Element Methods

Finite Difference and Finite Element Methods Finite Difference and Finite Element Methods Georgy Gimel farb COMPSCI 369 Computational Science 1 / 39 1 Finite Differences Difference Equations 3 Finite Difference Methods: Euler FDMs 4 Finite Element

More information

Homework Solution # 3

Homework Solution # 3 ECSE 644 Optimal Control Feb, 4 Due: Feb 17, 4 (Tuesday) Homework Solution # 3 1 (5%) Consider the discrete nonlinear control system in Homework # For the optimal control and trajectory that you have found

More information

Optimal transportation and optimal control in a finite horizon framework

Optimal transportation and optimal control in a finite horizon framework Optimal transportation and optimal control in a finite horizon framework Guillaume Carlier and Aimé Lachapelle Université Paris-Dauphine, CEREMADE July 2008 1 MOTIVATIONS - A commitment problem (1) Micro

More information

Physics Constrained Nonlinear Regression Models for Time Series

Physics Constrained Nonlinear Regression Models for Time Series Physics Constrained Nonlinear Regression Models for Time Series Andrew J. Majda and John Harlim 2 Department of Mathematics and Center for Atmosphere and Ocean Science, Courant Institute of Mathematical

More information

Scaling Limits of Waves in Convex Scalar Conservation Laws under Random Initial Perturbations

Scaling Limits of Waves in Convex Scalar Conservation Laws under Random Initial Perturbations Scaling Limits of Waves in Convex Scalar Conservation Laws under Random Initial Perturbations Jan Wehr and Jack Xin Abstract We study waves in convex scalar conservation laws under noisy initial perturbations.

More information

Lecture 5 Channel Coding over Continuous Channels

Lecture 5 Channel Coding over Continuous Channels Lecture 5 Channel Coding over Continuous Channels I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw November 14, 2014 1 / 34 I-Hsiang Wang NIT Lecture 5 From

More information

Adaptive timestepping for SDEs with non-globally Lipschitz drift

Adaptive timestepping for SDEs with non-globally Lipschitz drift Adaptive timestepping for SDEs with non-globally Lipschitz drift Mike Giles Wei Fang Mathematical Institute, University of Oxford Workshop on Numerical Schemes for SDEs and SPDEs Université Lille June

More information

Higher order derivative

Higher order derivative 2 Î 3 á Higher order derivative Î 1 Å Iterated partial derivative Iterated partial derivative Suppose f has f/ x, f/ y and ( f ) = 2 f x x x 2 ( f ) = 2 f x y x y ( f ) = 2 f y x y x ( f ) = 2 f y y y

More information

ANSWERS TO PROBLEM SET 1

ANSWERS TO PROBLEM SET 1 CHM1485: Molecular Dynamics and Chemical Dynamics in Liquids ANSWERS TO PROBLEM SET 1 1 Properties of the Liouville Operator a. Give the equations of motion in terms of the Hamiltonian. Show that they

More information

Performance Evaluation of Generalized Polynomial Chaos

Performance Evaluation of Generalized Polynomial Chaos Performance Evaluation of Generalized Polynomial Chaos Dongbin Xiu, Didier Lucor, C.-H. Su, and George Em Karniadakis 1 Division of Applied Mathematics, Brown University, Providence, RI 02912, USA, gk@dam.brown.edu

More information

Math 575-Lecture 26. KdV equation. Derivation of KdV

Math 575-Lecture 26. KdV equation. Derivation of KdV Math 575-Lecture 26 KdV equation We look at the KdV equations and the so-called integrable systems. The KdV equation can be written as u t + 3 2 uu x + 1 6 u xxx = 0. The constants 3/2 and 1/6 are not

More information

Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics. Jiti Gao

Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics. Jiti Gao Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics Jiti Gao Department of Statistics School of Mathematics and Statistics The University of Western Australia Crawley

More information

AN IDENTIFICATION ALGORITHM FOR ARMAX SYSTEMS

AN IDENTIFICATION ALGORITHM FOR ARMAX SYSTEMS AN IDENTIFICATION ALGORITHM FOR ARMAX SYSTEMS First the X, then the AR, finally the MA Jan C. Willems, K.U. Leuven Workshop on Observation and Estimation Ben Gurion University, July 3, 2004 p./2 Joint

More information

Lagrange Multipliers

Lagrange Multipliers Optimization with Constraints As long as algebra and geometry have been separated, their progress have been slow and their uses limited; but when these two sciences have been united, they have lent each

More information

Comparison of stochastic parameterizations in the framework of a coupled ocean atmosphere model

Comparison of stochastic parameterizations in the framework of a coupled ocean atmosphere model https://doi.org/1.5194/npg-25-65-218 Authors 218. This work is distributed under the Creative Commons Attribution 4. License. Comparison of stochastic parameterizations in the framework of a coupled ocean

More information

Review For the Final: Problem 1 Find the general solutions of the following DEs. a) x 2 y xy y 2 = 0 solution: = 0 : homogeneous equation.

Review For the Final: Problem 1 Find the general solutions of the following DEs. a) x 2 y xy y 2 = 0 solution: = 0 : homogeneous equation. Review For the Final: Problem 1 Find the general solutions of the following DEs. a) x 2 y xy y 2 = 0 solution: y y x y2 = 0 : homogeneous equation. x2 v = y dy, y = vx, and x v + x dv dx = v + v2. dx =

More information

Math 4381 / 6378 Symmetry Analysis

Math 4381 / 6378 Symmetry Analysis Math 438 / 6378 Smmetr Analsis Elementar ODE Review First Order Equations Ordinar differential equations of the form = F(x, ( are called first order ordinar differential equations. There are a variet of

More information

Homework 4 will be posted tonight, due Wednesday, May 8.

Homework 4 will be posted tonight, due Wednesday, May 8. Multiscale Computing and Escape Problems Friday, April 26, 2013 2:01 PM Homework 4 will be posted tonight, due Wednesday, May 8. Multiscale computation is a way to use the ideas of asymptotic reductions

More information

New ideas in the non-equilibrium statistical physics and the micro approach to transportation flows

New ideas in the non-equilibrium statistical physics and the micro approach to transportation flows New ideas in the non-equilibrium statistical physics and the micro approach to transportation flows Plenary talk on the conference Stochastic and Analytic Methods in Mathematical Physics, Yerevan, Armenia,

More information

Entrance Exam, Differential Equations April, (Solve exactly 6 out of the 8 problems) y + 2y + y cos(x 2 y) = 0, y(0) = 2, y (0) = 4.

Entrance Exam, Differential Equations April, (Solve exactly 6 out of the 8 problems) y + 2y + y cos(x 2 y) = 0, y(0) = 2, y (0) = 4. Entrance Exam, Differential Equations April, 7 (Solve exactly 6 out of the 8 problems). Consider the following initial value problem: { y + y + y cos(x y) =, y() = y. Find all the values y such that the

More information

3 Applications of partial differentiation

3 Applications of partial differentiation Advanced Calculus Chapter 3 Applications of partial differentiation 37 3 Applications of partial differentiation 3.1 Stationary points Higher derivatives Let U R 2 and f : U R. The partial derivatives

More information

ECE Lecture #9 Part 2 Overview

ECE Lecture #9 Part 2 Overview ECE 450 - Lecture #9 Part Overview Bivariate Moments Mean or Expected Value of Z = g(x, Y) Correlation and Covariance of RV s Functions of RV s: Z = g(x, Y); finding f Z (z) Method : First find F(z), by

More information

Complex system approach to geospace and climate studies. Tatjana Živković

Complex system approach to geospace and climate studies. Tatjana Živković Complex system approach to geospace and climate studies Tatjana Živković 30.11.2011 Outline of a talk Importance of complex system approach Phase space reconstruction Recurrence plot analysis Test for

More information

Econ 623 Econometrics II Topic 2: Stationary Time Series

Econ 623 Econometrics II Topic 2: Stationary Time Series 1 Introduction Econ 623 Econometrics II Topic 2: Stationary Time Series In the regression model we can model the error term as an autoregression AR(1) process. That is, we can use the past value of the

More information

Fast-slow systems with chaotic noise

Fast-slow systems with chaotic noise Fast-slow systems with chaotic noise David Kelly Ian Melbourne Courant Institute New York University New York NY www.dtbkelly.com May 12, 215 Averaging and homogenization workshop, Luminy. Fast-slow systems

More information

Multivariate Regression

Multivariate Regression Multivariate Regression The so-called supervised learning problem is the following: we want to approximate the random variable Y with an appropriate function of the random variables X 1,..., X p with the

More information

Today: Fundamentals of Monte Carlo

Today: Fundamentals of Monte Carlo Today: Fundamentals of Monte Carlo What is Monte Carlo? Named at Los Alamos in 1940 s after the casino. Any method which uses (pseudo)random numbers as an essential part of the algorithm. Stochastic -

More information

Resonant excitation of trapped coastal waves by free inertia-gravity waves

Resonant excitation of trapped coastal waves by free inertia-gravity waves Resonant excitation of trapped coastal waves by free inertia-gravity waves V. Zeitlin 1 Institut Universitaire de France 2 Laboratory of Dynamical Meteorology, University P. and M. Curie, Paris, France

More information

Hamiltonian partial differential equations and Painlevé transcendents

Hamiltonian partial differential equations and Painlevé transcendents The 6th TIMS-OCAMI-WASEDA Joint International Workshop on Integrable Systems and Mathematical Physics March 22-26, 2014 Hamiltonian partial differential equations and Painlevé transcendents Boris DUBROVIN

More information

Model reduction for linear systems by balancing

Model reduction for linear systems by balancing Model reduction for linear systems by balancing Bart Besselink Jan C. Willems Center for Systems and Control Johann Bernoulli Institute for Mathematics and Computer Science University of Groningen, Groningen,

More information

Numerical tensor methods and their applications

Numerical tensor methods and their applications Numerical tensor methods and their applications 8 May 2013 All lectures 4 lectures, 2 May, 08:00-10:00: Introduction: ideas, matrix results, history. 7 May, 08:00-10:00: Novel tensor formats (TT, HT, QTT).

More information

Elements of Positive Definite Kernel and Reproducing Kernel Hilbert Space

Elements of Positive Definite Kernel and Reproducing Kernel Hilbert Space Elements of Positive Definite Kernel and Reproducing Kernel Hilbert Space Statistical Inference with Reproducing Kernel Hilbert Space Kenji Fukumizu Institute of Statistical Mathematics, ROIS Department

More information

One dimensional Maps

One dimensional Maps Chapter 4 One dimensional Maps The ordinary differential equation studied in chapters 1-3 provide a close link to actual physical systems it is easy to believe these equations provide at least an approximate

More information

Lecture No 1 Introduction to Diffusion equations The heat equat

Lecture No 1 Introduction to Diffusion equations The heat equat Lecture No 1 Introduction to Diffusion equations The heat equation Columbia University IAS summer program June, 2009 Outline of the lectures We will discuss some basic models of diffusion equations and

More information

Physics 200 Lecture 4. Integration. Lecture 4. Physics 200 Laboratory

Physics 200 Lecture 4. Integration. Lecture 4. Physics 200 Laboratory Physics 2 Lecture 4 Integration Lecture 4 Physics 2 Laboratory Monday, February 21st, 211 Integration is the flip-side of differentiation in fact, it is often possible to write a differential equation

More information

Path Integral methods for solving stochastic problems. Carson C. Chow, NIH

Path Integral methods for solving stochastic problems. Carson C. Chow, NIH Path Integral methods for solving stochastic problems Carson C. Chow, NIH Why? Often in neuroscience we run into stochastic ODEs of the form dx dt = f(x)+g(x)η(t) η(t) =0 η(t)η(t ) = δ(t t ) Examples Integrate-and-fire

More information