Stochastic Mode Reduction in Large Deterministic Systems

Similar documents
Introduction to asymptotic techniques for stochastic systems with multiple time-scales

Stochastic models for selected slow variables in large deterministic systems

Low-dimensional chaotic dynamics versus intrinsic stochastic noise: a paradigm model

Statistical Mechanics for the Truncated Quasi-Geostrophic Equations

Mathematical Theories of Turbulent Dynamical Systems

SUBGRID-SCALE CLOSURE FOR THE INVISCID BURGERS-HOPF EQUATION

1. Introduction Systems evolving on widely separated time-scales represent a challenge for numerical simulations. A generic example is

Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows

Uncertainty Quantification in Computational Science

Introduction to multiscale modeling and simulation. Explicit methods for ODEs : forward Euler. y n+1 = y n + tf(y n ) dy dt = f(y), y(0) = y 0

Equilibrium Statistical Mechanics for the Truncated Burgers-Hopf Equations

DATA-DRIVEN TECHNIQUES FOR ESTIMATION AND STOCHASTIC REDUCTION OF MULTI-SCALE SYSTEMS

A priori tests of a stochastic mode reduction strategy

Controlled Diffusions and Hamilton-Jacobi Bellman Equations

SUB-SAMPLING AND PARAMETRIC ESTIMATION FOR MULTISCALE DYNAMICS

1 Phase Spaces and the Liouville Equation

MARKOV CHAIN AND TIME-DELAY REDUCED MODELING OF NONLINEAR SYSTEMS

SPDEs, criticality, and renormalisation

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process

Method 1: Geometric Error Optimization

UNIVERSITY OF SOUTHAMPTON. A foreign language dictionary (paper version) is permitted provided it contains no notes, additions or annotations.

Lecture 42 Determining Internal Node Values

Kernel Method: Data Analysis with Positive Definite Kernels

Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows

Systematic stochastic modeling. of atmospheric variability. Christian Franzke

Feedback Control of Turbulent Wall Flows

Stabilization and Passivity-Based Control

Stochastic Gradient Descent in Continuous Time

Characteristic Functions in Radar and Sonar. Southeastern Symposium on System Theory

Math 4263 Homework Set 1

PHY 396 K. Solutions for problems 1 and 2 of set #5.

Intersection of Ellipsoids

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q

x R d, λ R, f smooth enough. Goal: compute ( follow ) equilibrium solutions as λ varies, i.e. compute solutions (x, λ) to 0 = f(x, λ).

Deterministic. Deterministic data are those can be described by an explicit mathematical relationship

A SIMPLE LINEAR RESPONSE CLOSURE APPROXIMATION FOR SLOW DYNAMICS OF A MULTISCALE SYSTEM WITH LINEAR COUPLING

The Helmholtz theorem at last!

MATH 387 ASSIGNMENT 2

Physics Constrained Nonlinear Regression Models for Time Series

Advanced Quantum Mechanics

Two dimensional manifolds

Interest Rate Models:

Statistical signal processing

The Vlasov equation for cold dark matter and gravity

What is Classical Molecular Dynamics?

Lecture 4: Least Squares (LS) Estimation

The Derivative. Appendix B. B.1 The Derivative of f. Mappings from IR to IR

where r n = dn+1 x(t)

DIFFERENTIAL EQUATIONS

. p.1/31. Department Mathematics and Statistics Arizona State University. Don Jones

MATH443 PARTIAL DIFFERENTIAL EQUATIONS Second Midterm Exam-Solutions. December 6, 2017, Wednesday 10:40-12:30, SA-Z02

ME3.6 Sheet 2 Answers

Stochastic Processes

Recall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u u 2 2 = u 2. Geometric Meaning:

Systematic deviations from Gaussianity in models of quasigeostrophic turbulence

6 The Fourier transform

NONLOCAL DIFFUSION EQUATIONS

Logistic Map, Euler & Runge-Kutta Method and Lotka-Volterra Equations

Realization theory for systems biology

Problem reduction, memory and renormalization

These slides follow closely the (English) course textbook Pattern Recognition and Machine Learning by Christopher Bishop

Derivation of the GENERIC form of nonequilibrium thermodynamics from a statistical optimization principle

Stochastic Processes. A stochastic process is a function of two variables:

Quantum Mechanics for Scientists and Engineers. David Miller

Finite Difference and Finite Element Methods

Homework Solution # 3

Optimal transportation and optimal control in a finite horizon framework

Physics Constrained Nonlinear Regression Models for Time Series

Scaling Limits of Waves in Convex Scalar Conservation Laws under Random Initial Perturbations

Lecture 5 Channel Coding over Continuous Channels

Adaptive timestepping for SDEs with non-globally Lipschitz drift

Higher order derivative

ANSWERS TO PROBLEM SET 1

Performance Evaluation of Generalized Polynomial Chaos

Math 575-Lecture 26. KdV equation. Derivation of KdV

Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics. Jiti Gao

AN IDENTIFICATION ALGORITHM FOR ARMAX SYSTEMS

Lagrange Multipliers

Comparison of stochastic parameterizations in the framework of a coupled ocean atmosphere model

Review For the Final: Problem 1 Find the general solutions of the following DEs. a) x 2 y xy y 2 = 0 solution: = 0 : homogeneous equation.

Math 4381 / 6378 Symmetry Analysis

Homework 4 will be posted tonight, due Wednesday, May 8.

New ideas in the non-equilibrium statistical physics and the micro approach to transportation flows

Entrance Exam, Differential Equations April, (Solve exactly 6 out of the 8 problems) y + 2y + y cos(x 2 y) = 0, y(0) = 2, y (0) = 4.

3 Applications of partial differentiation

ECE Lecture #9 Part 2 Overview

Complex system approach to geospace and climate studies. Tatjana Živković

Econ 623 Econometrics II Topic 2: Stationary Time Series

Fast-slow systems with chaotic noise

Multivariate Regression

Today: Fundamentals of Monte Carlo

Resonant excitation of trapped coastal waves by free inertia-gravity waves

Hamiltonian partial differential equations and Painlevé transcendents

Model reduction for linear systems by balancing

Numerical tensor methods and their applications

Elements of Positive Definite Kernel and Reproducing Kernel Hilbert Space

One dimensional Maps

Lecture No 1 Introduction to Diffusion equations The heat equat

Physics 200 Lecture 4. Integration. Lecture 4. Physics 200 Laboratory

Path Integral methods for solving stochastic problems. Carson C. Chow, NIH

Transcription:

Stochastic Mode Reduction in Large Deterministic Systems I. Timofeyev University of Houston With A. J. Majda and E. Vanden-Eijnden; NYU Related Publications: http://www.math.uh.edu/ ilya

Plan Mode-Elimination as a Limit of Infinite Separation of Time-Scales Mode-Elimination for Conservative Systems Example - Truncated Burgers-Hopf Equation Numerical Verification of the Limiting Behavior Conservative Mode-Elimination Comparison with Direct Numerical Simulations Balance of Terms

Essence of Mode-Reduction Dynamical Variables: Ż = f(z) Decomposition: Z = (Essential, N on Essential) = (SLOW, F AST ) Goal: Eliminate Fast modes; equation for Slow Dynamics Derive Closed-Form Motivation: Interested Only in Statistical Behavior of the Slow Dynamics Asymptotic Approach: Limit T ime Scale{F AST } T ime Scale{SLOW }

Rewrite the Original System Ż = f(z) Decomposition: Z = (SLOW, F AST ) (X, Y ) Quadratic System: Ẋ = {X, X} + {Y, X} + {Y, Y } Ẏ = {X, X} + {Y, X} + {Y, Y } Conservation of Energy: d dt E = d dt ( X 2 + Y 2) = 2XẊ + 2Y Ẏ = {X, X, X}+{X, X, Y }+{Y, Y, X}+{Y, Y, Y } = 0

Modify the Original System Main Idea: Introduce ε in the Equations Preserve Conservation of Energy Modified System Ẋ = {X, X} + 1 ε {Y, X} + 1 ε {Y, Y } Ẏ = 1 ε {X, X} + 1 ε {Y, X} + 1 ε 2{Y, Y } Conservation of Energy: Ė = {X, X, X}+ 1 ε {X, X, Y }+1 ε {Y, Y, X}+ 1 ε2{y, Y, Y } = 0 ε = 1 Corresponds to the Original System Conserves Energy Ẏ {Y, Y } Numerical & Analytical Approaches

Truncated Burgers-Hopf Model Fourier-Galerkin Projection of u t + uu x = 0 onto a nite number of Fourier modes u = û k e ikx, 1 k Λ 2Λ-dimensional system of ODEs d dtûk = ik 2 û pû q p+q+k=0 with Reality Condition û k = û k Main Features Conservation of Energy û k 2 ; Equipartition Correlation scaling Corr.T ime{û k } k 1 Gaussian distribution in the limit Λ Hamiltonian H = 1 6 u 3 Λ dx

û 1 is the Slow Mode Consider: SLOW = û 1, F AST = {û 2... û Λ } Time-Scale Separation: Corr.T ime{slow } Corr.T ime{f AST } = 2 Modified System: d = i dtû1 2ε p+q+1=0 2 p, q Λ û pû q, d = ik dtûk 2ε [û k+1û 1 + û k 1û 1 ] ik 2ε 2 k+p+q=0 2 p, q Λ û pû q

Numerical Approach Goal: Verify Existence of the Reduced Dynamics Also: Understand the shape of the Limit Approach: Simulate Modified System with ε = 1, 0.5, 0.25, 0.1 4.5 4 3.5 ε=1 ε=0.5 ε=0.25 ε=0.1 3 2.5 2 1.5 1 0.5 0 0.5 0.4 0.3 0.2 0.1 0 0.1 0.2 0.3 0.4 0.5 Re u 1 PDF of Re û 1

Numerical Approach More Severe Test: Behavior of the Two-Point Statistics Re û 1 (t)re û 1 (t + s) ε = 1, 0.5, 0.25, 0.1 1 0.8 ε=1 ε=0.5 ε=0.25 ε=0.1 0.6 0.4 0.2 0 0.2 0 5 10 15 Lag Corr. Function of Re û 1 Corr.Time ε=1 = 2.64, Corr.Time ε=0.1 = 2.4

Numerical Approach Question: How fast the Bump Disappears Approach: Simulate Modified System with ε = 1, 0.9, 0.8, 0.6 1 0.9 0.8 ε=1 ε=0.9 ε=0.8 ε=0.6 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 0 5 10 15 Corr. Function of Re û 1

Analytical Approach Equation: Ẋ = 1 ε f(x, Y ) Ẏ = 1 ε 2g(X, Y ) Effective Equation: dx = ā(x)dt + b(x)dw ā = 0 dt dµ(y )f(x, Y (0)) X f (X, Y (t)) b 2 = 0 dt dµ(y )f(x, Y (0))f (X, Y (t))

Overview of the Approach Backward Equation pε s = 1 ε 2L 1p ε + 1 ε L 2p ε Represent formally as Power Series p ε = p 0 + εp 1 + ε 2 p 2 +... Collect terms and impose solvability condition p 0 s = PL 2L 1 1 L 2Pp 0 PL 2 P = 0

Derivation of the Reduced Model Consider a general quadratic system of equations for the variables x = {x i } and y = {y i } ẋ i = ε 1 j,k m xxy ijk x jy k + ε 1 j,k m xyy ijk y jy k ẏ i = ε 1 j,k m yxx ijk x jx k + ε 1 j,k m yxy ijk x jy k + ε 2 j,k m yyy ijk y jy k Volume Preserving => Consider Liouville Equation pε s = 1 ε 2L 1p ε + 1 ε L 2p ε L 2 = i,j,k i,j,k L 1 = i,j,k m xxy ijk x jy k + m yyy ijk y jy k y i m yxx ijk x jx k + m xyy i,j,k m yxy i,j,k ijk y jy k ijk x jy k x i + y i

Derivation of the Reduced Model Compute L = PL 2 L 1 1 L 2P P - IM of the fast subsystem on E fast = E x 2 L 1 1 - Shift fast variables in time; Integrate for all times L = i B i (x) x i + i,j D ij (x) x i x j Where D ij (x) = E 1/2 (x) 0 dt dµ N (y)p i (y(0))p j (y(t)) P i (y) = j,k m xxy ijk x jy k + E 1/2 (x) j,k m xyy ijk y jy k E(x) := (E x 2 )/N B i (x) = (1 2N 1 )E 1 (x) j D ij (x)x j

Reduced Model for û 1 dû 1 = B( û 1 )û 1 dt + σ( û 1 )dw (t) Additional Assumptions: Correlation Matrix, etc. Ergodicity, Structure of the B( û 1 2 ) = 2 EI 2 I 2 E û 1 2 [ 1 + 2 N ] EIf σ 2 ( û 1 2 ) = 2 E û 1 2 I 2 + 2 ( E ) 3 If E = E( û 1 2 ) = (E û 1 2 )/N where E - Total Energy of the System N - Number of Fast Modes I 2 - Corr.Time(û 2 ) I f - Corr.Time(RHS of û 1 projected onto Fast Modes)

Reduced Model for u 1 Need to Know: Moments of Fast Modes Simplification: Can be Recast as CF of RHS û 1 Approach: Compute Correlations from a single microcanonical realization of the fast subsystem {y k } dû 1 = B( û 1 )û 1 dt + σ( û 1 )dw (t) B = 2 EI 2 I [ 2 û 1 2 1 + 2 ] EIf E N 0 1 2 B( u 1 2 ) 3 4 5 6 0 0.1 0.2 0.3 0.4 u 1 2 Drift Term B( û 1 ); Total Energy E = 0.4 I 2 = 0.14, I f = 4.3

Reduced Model for û 1 One Point Statistics: Perfect Agreement 4.5 4 Full TBH Reduced 3.5 3 2.5 2 1.5 1 0.5 0 0.5 0.4 0.3 0.2 0.1 0 0.1 0.2 0.3 0.4 0.5 PDF of Re û 1 Blue - DNS with 20 Modes Magenta - Reduced Equation

Reduced Model for û 1 Two Point Statistics: Cannot Reproduce DNS Exactly Analytical vs Numerical: Should be Identical; It s the same Limit ε 0 1 0.9 Full TBH Reduced ε=0.1 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 0 5 10 15 Correlation Function of û 1 Blue - DNS with 20 Modes Magenta - Reduced Equation Black - Modified Equation with ε = 0.1

û 1 and û 2 are the Slow Modes Consider: SLOW = {û 1, û 2 }, F AST = {û 3... û Λ } Time-Scale Separation: Corr.T ime{slow } Corr.T ime{f AST } = 3 2 Modified System: d = iû 2 û dtû1 1 i 2ε d dtû2 = iû 2 1 i ε p+q+1=0 3 p, q Λ p+q+2=0 3 p, q Λ û pû q, û pû q, d = ik dtûk 2ε (û k+1û 1 + û k 1û 1 ) ik 2ε (û k+2û 2 + û k 2û 2 ) ik 2ε 2 p+q+k=0 3 p, q Λ û pû q

Numerical Approach Question: Can we recover Bump Structure with More Modes? Approach: Simulate Modified System with ε = 1, 0.5, 0.25, 0.1 0.8 ε=1 ε=0.5 ε=0.25 ε=0.1 0.6 0.4 0.2 0 0.2 0 5 10 15 Lag Correlation Function of Re û 1

Reduced Model for û 1 and û 2 Analytical vs Numerical: Should be Identical; It s the same Limit ε 0 0.8 Full TBH Reduced ε=0.1 0.6 0.4 0.2 0 0.2 0 5 10 15 Lag Correlation Function of û 1 Blue - DNS with 20 Modes Magenta - Reduced Equation Black - Modified Equation with ε = 0.1

Reduced Model for û 1 and û 2 Include More Modes: Discrepancies are Larger for û 2 0.8 Full TBH Reduced ε=0.1 0.6 0.4 0.2 0 0.2 0 1 2 3 4 5 6 7 Lag Correlation Function of û 2 Blue - DNS with 20 Modes Magenta - Reduced Equation Black - Modified Equation with ε = 0.1

Multiplicative Noise vs Additive Noise Ẋ = {X, X} + 1 ε {Y, X} + 1 ε {Y, Y } Ẏ = 1 ε {X, X} + 1 ε {Y, X} + 1 ε 2{Y, Y } Intuition: Y Noise {Y, X} Mult Noise + Cubic Damping {Y, Y } Additive Noise + Linear Damping

Reduced Model for û 1 and û 2 Additional Advantage: Can Analyze Balance of Various Terms Mult. Noise: Contribution 6% 0.8 Full TBH Reduced No Mult Noise 0.6 0.4 0.2 0 0.2 0 5 10 15 Lag Correlation Function of û 1 Blue - DNS with 20 Modes Magenta - Reduced Equation Red - Reduced Equation without Mult. Noise Terms

Conclusions Effectively computable theory for deriving closed systems of reduced equations for slow variables No ad-hoc assumtions about the fast modes are necessary Parameters are Estimated from a single microcanonical simulation Necessary Information can be recast in terms of correlation functions of the RHS Numerical and Analytical Approaches Analyze the source of discrepancies Better understanding of the Limit Analyze Balance of Various Terms