Mathematical Theories of Turbulent Dynamical Systems

Size: px
Start display at page:

Download "Mathematical Theories of Turbulent Dynamical Systems"

Transcription

1 Mathematical Theories of Turbulent Dynamical Systems Di Qi, and Andrew J. Majda Courant Institute of Mathematical Sciences Fall 2016 Advanced Topics in Applied Math Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

2 Lecture 11 & 12: Mathematical Theories of Turbulent Dynamical Systems 1 Nontrivial turbulent dynamical systems with a Gaussian invariant measure 2 Exact equations for the mean and covariance of the fluctuations Turbulent dynamical systems with nontrivial third-order moments Statistical dynamics in the L-96 model and statistical energy conservation 3 A statistical energy conservation principle for turbulent dynamical systems Details about deterministic triad energy conservation symmetry A generalized statistical energy identity Enhanced dissipation of the statistical mean energy, the statistical energy principle, and Eddy viscosity Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

3 Outline 1 Nontrivial turbulent dynamical systems with a Gaussian invariant measure 2 Exact equations for the mean and covariance of the fluctuations Turbulent dynamical systems with nontrivial third-order moments Statistical dynamics in the L-96 model and statistical energy conservation 3 A statistical energy conservation principle for turbulent dynamical systems Details about deterministic triad energy conservation symmetry A generalized statistical energy identity Enhanced dissipation of the statistical mean energy, the statistical energy principle, and Eddy viscosity Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

4 Turbulent systems with special forms of damping and noise The system setup will be a finite-dimensional system of, u R N, with linear dynamics, an energy preserving quadratic part, and random white noise forcing du dt = L [u] = B (u, u) + Lu dλu + Λ1 /2 σẇ (t; ω). Properties in the operators u B (u, u) = 0, Energy Conservation, u Lu = 0, Skew Symmetry for L, div u (B (u, u)) = 0, Liouville Property. The scalar d and σ satisfy σ 2 eq = σ 2 /2d, and Λ 0 (positive-definite) controls the linear damping rate and the noise amplitude. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

5 Turbulent systems with special forms of damping and noise The system setup will be a finite-dimensional system of, u R N, with linear dynamics, an energy preserving quadratic part, and random white noise forcing du dt = L [u] = B (u, u) + Lu dλu + Λ1 /2 σẇ (t; ω). Properties in the operators u B (u, u) = 0, Energy Conservation, u Lu = 0, Skew Symmetry for L, div u (B (u, u)) = 0, Liouville Property. The scalar d and σ satisfy σ 2 eq = σ 2 /2d, and Λ 0 (positive-definite) controls the linear damping rate and the noise amplitude. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

6 General setup of turbulent systems Examples: du dt = L [u] = B (u, u) + Lu dλu + Λ1 /2 σẇ (t; ω). General 3 3 triad system model; Truncated Burgers-Hopf (TBH) equation, and inviscid L-96; Quasi-geostrophic flow with topography, mean flow in pseudo-energy metric; Inviscid Boussinesq or modified shallow water equation. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

7 Gaussian invariant measure Proposition du dt = L [u] = B (u, u) + Lu dλu + Λ1 /2 σẇ (t; ω). (1) Associated with SDE in (1), with the structural properties, then (1) has the Gaussian invariant measure defined as in p eq ; The invariant measure has equipartition of energy in each component of u, p eq = C 1 N exp ( 1 2 σ 2 eq u u ), with σeq 2 = σ 2 /2d. Proof. The Fokker-Planck Equation for (1), using the properties, is given by ( dp Λσ 2 ) = div u [(B (u, u) + Lu) p] + div u (dλup) + div u dt 2 p ( ) = (B (u, u) + Lu) p + div u dλup + Λσ2 2 p. Insert p eq dλupeq + Λσ2 Λσ2 upeq = dλupeq 2 2 σ 2 eq up eq 0. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

8 Gaussian invariant measure Proposition du dt = L [u] = B (u, u) + Lu dλu + Λ1 /2 σẇ (t; ω). (1) Associated with SDE in (1), with the structural properties, then (1) has the Gaussian invariant measure defined as in p eq ; The invariant measure has equipartition of energy in each component of u, p eq = C 1 N exp ( 1 2 σ 2 eq u u ), with σeq 2 = σ 2 /2d. Proof. The Fokker-Planck Equation for (1), using the properties, is given by ( dp Λσ 2 ) = div u [(B (u, u) + Lu) p] + div u (dλup) + div u dt 2 p ( ) = (B (u, u) + Lu) p + div u dλup + Λσ2 2 p. Insert p eq dλupeq + Λσ2 Λσ2 upeq = dλupeq 2 2 σ 2 eq up eq 0. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

9 Example: a simplified 57-mode testing model 12 In the numerical experiments, the truncation k 2 Λ, with Λ = 17 are utilized with 57 degrees of freedom d ˆω k dt dv dt = = ( ) ψ q k ) + ik 1 (β/ k 2 V ˆω k ik 1 ĥ k V ( dλ k ω k + σ 1 + µ/ k 2) 1/2 1/2 λ k Ẇ k, ik 1 k 2 ĥ k ˆω k dλ 0V + σµ 1/2 λ 1/2 0 Ẇ 0. 1 k Λ The pseudo-energy metric induces p eq (V, ω) = C 1 exp µ 2 σ 2 eq ( V V ) σ 1 eq ( ) 1 + µ k 2 (ω k ω k ) 2. 1 k 2 Λ So the steady state large and small scale variables reach the equilibrium mean and variance V = β µ, ψ k = h k µ + k 2, V 2 = σ2 eq µ, ψ 2 = σeq 2 ( ). k 2 k 2 + µ 1 Majda, Timofeyev, and Vanden-Eijnden, JAS, Majda, Franzke, Fischer, and Crommelin, PNAS, 2006 Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

10 Equilibrium steady state data V V 2 ψ (1,0) ψ 2 (1,0) theory i numerics i ψ 2 (0,1) ψ 2 (2,0) ψ 2 (0,2) V ψ (1,0) theory numerics ( i) 10 3 Table: Unperturbed equilibrium statistics of the 57-mode model with damping and forcing term. The parameters µ = 2, σ 2 eq = 1, β = 1, H = 3 2/4, d = 0.5 are used in the model. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

11 Outline 1 Nontrivial turbulent dynamical systems with a Gaussian invariant measure 2 Exact equations for the mean and covariance of the fluctuations Turbulent dynamical systems with nontrivial third-order moments Statistical dynamics in the L-96 model and statistical energy conservation 3 A statistical energy conservation principle for turbulent dynamical systems Details about deterministic triad energy conservation symmetry A generalized statistical energy identity Enhanced dissipation of the statistical mean energy, the statistical energy principle, and Eddy viscosity Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

12 General setup of turbulent systems with quadratic nonlinearities The system setup will be a finite-dimensional system with linear dynamics and an energy preserving quadratic part with u R N du dt = L [u (t; ω) ; ω] = (L + D) u + B (u, u) + F (t) + σ k (t) Ẇ k (t; ω), (3) u (t 0 ; ω) = u 0 (ω). (4) L being a skew-symmetric linear operator L = L, representing the β-effect of Earth s curvature, topography etc. D being a negative definite symmetric operator D = D, representing dissipative processes such as surface drag, radiative damping, viscosity etc. B (u, u) being a quadratic operator which conserves the energy by itself so that it satisfies B (u, u) u = 0. F (t) + σ k (t) Ẇ k (t; ω) being the effects of external forcing, i.e. solar forcing, seasonal cycle, which can be split into a mean component F (t) and a stochastic component with white noise characteristics. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

13 General setup of turbulent systems with quadratic nonlinearities The system setup will be a finite-dimensional system with linear dynamics and an energy preserving quadratic part with u R N du dt = L [u (t; ω) ; ω] = (L + D) u + B (u, u) + F (t) + σ k (t) Ẇ k (t; ω), (3) u (t 0 ; ω) = u 0 (ω). (4) L being a skew-symmetric linear operator L = L, representing the β-effect of Earth s curvature, topography etc. D being a negative definite symmetric operator D = D, representing dissipative processes such as surface drag, radiative damping, viscosity etc. B (u, u) being a quadratic operator which conserves the energy by itself so that it satisfies B (u, u) u = 0. F (t) + σ k (t) Ẇ k (t; ω) being the effects of external forcing, i.e. solar forcing, seasonal cycle, which can be split into a mean component F (t) and a stochastic component with white noise characteristics. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

14 Ideas about Reduced Order Methods (ROMs) Approach: Project dynamics onto a finite-dimensional representation of the stochastic field consisting of fixed-in-time, N-dimensional, orthonormal basis {v i } N i=1 u (t) = ū (t) + u (t), u = N Φ i (t; ω) v i i=1 s Φ i (t; ω) v i ; i=1 Modeling is restricted to subspace V s = span {v i } s i=1 ; Aim is to capture as much of the dynamics as possible with few modes; Attractive for reduced computational cost. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

15 Finite-dimensional representation of the stochastic field Use a finite-dimensional representation of the stochastic field consisting of fixed-in-time, N-dimensional (u R N ), orthonormal basis {v i } u (t) = ū (t) + u (t) = ū (t) + N Z i (t; ω) v i, ū (t) = u (t), u = 0. Constructing the random field v i from equilibrium statistics i=1 C uu (x, y) = E ω [ (u (x; Geometrical ω) u (x; ω)) picture (u (y; ω) of KL u expansion (y; ω)) ] Solve the eigenvalue problem For a stochastic Cfield uu (x, u( y) x ;ωv) we i dx have = λ 2 i v ( i, (y) ). ( ( ; ) ( ; ))( ( ; ) ( ; T C E )) ω uu x y = u x ω u x ω u y ω u y ω Provides principal directions v i spanning Provides principal directions the phase space over which probability is distributed Solution of the eigenvalue problem ui x of the infinite-dimensional space over which probability is distributed For each principal direction For each v i principal the direction ui ( x) the associated eigenvalue λ associated eigenvalue λdefines i defines the spread theof spread i the probability of the probability ( ) ui 2 ( x) 2 C ( x, y) ui( x) dx= λi ui( y) uu ui 1 ( x) Probability measure For infinite-dimensional probability measures (case of stochastic fields) we have Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories Countable of Turbulent infinity Systems of principal directions Nov. 17, / 39 u i 3 ( x)

16 Finite-dimensional representation of the stochastic field Use a finite-dimensional representation of the stochastic field consisting of fixed-in-time, N-dimensional (u R N ), orthonormal basis {v i } u (t) = ū (t) + u (t) = ū (t) + N Z i (t; ω) v i, ū (t) = u (t), u = 0. Constructing the random field v i from equilibrium statistics i=1 C uu (x, y) = E ω [ (u (x; Geometrical ω) u (x; ω)) picture (u (y; ω) of KL u expansion (y; ω)) ] Solve the eigenvalue problem For a stochastic Cfield uu (x, u( y) x ;ωv) we i dx have = λ 2 i v ( i, (y) ). ( ( ; ) ( ; ))( ( ; ) ( ; T C E )) ω uu x y = u x ω u x ω u y ω u y ω Provides principal directions v i spanning Provides principal directions the phase space over which probability is distributed Solution of the eigenvalue problem ui x of the infinite-dimensional space over which probability is distributed For each principal direction For each v i principal the direction ui ( x) the associated eigenvalue λ associated eigenvalue λdefines i defines the spread theof spread i the probability of the probability ( ) ui 2 ( x) 2 C ( x, y) ui( x) dx= λi ui( y) uu ui 1 ( x) Probability measure For infinite-dimensional probability measures (case of stochastic fields) we have Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories Countable of Turbulent infinity Systems of principal directions Nov. 17, / 39 u i 3 ( x)

17 Development of statistical moment dynamics u (t) = ū (t) + u (t) = ū (t) + N Z i (t; ω) v i, u = 0. i=1 Take expectation on both sides of the equations du dt = (L + D) u + B (u, u) + F (t) + σ k (t) Ẇ k (t; ω) (5) Equation for the mean field ū dū dt = (L + D) ū + B (ū, ū) + R ijb (v i, v j ) + F (t), (6) where R ij = Z i Zj, B (u, u) = B (ū + u, ū + u ) = B (ū, ū) + B (ū, u ) + B (u, ū) + B (u, u ), B (u, u ) = B (Z i v i, Z j v j ) = Z i Zj B (vi, v j ). Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

18 Equation for the fluctuation component du dt = (L + D) u + B (ū, u ) + B (u, ū) + B (u, u ) R jk B (v j, v k ) + σ k (t) Ẇ k (t; ω). (7) Equations for the stochastic coefficients dz i dt = Z j [(L + D) v j + B (ū, v j ) + B (v j, ū)] v i + [B (u, u ) R jk B (v j, v k )] v i + Ẇ k σ k v i. (8) Equation for the covariance matrix R ij = Z i Zj dr dt = L v (ū) R + RL v (ū) + Q F + Q σ. (9) Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

19 Covariance Equation dr dt = L v (ū) R + RL v (ū) + Q F + Q σ the linear dynamics operator L v expressing energy transfers between the mean field and the stochastic modes (B), as well as energy dissipation (D), and non-normal dynamics (L) {L v } ij = [ (L + D) v j + B ( ū, v j ) + B ( vj, ū )] v i. the positive definite operator Q σ expressing energy transfer due to external stochastic forcing {Q σ} ij = v i σ k σ kv j. the third-order moments expressing the energy flux between different modes due to non-linear terms Q F = Z mz nz j B (vm, v n) v i + Z mz nz i B (v m, v n) v j. note that energy is still conserved in this nonlinear interaction part Tr [Q F ] = 2 Z mz nz i B (v m, v n) v i = 2 B (Z mv m, Z nv n) Z i v i = 2 B ( u, u ) u = 0. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

20 Energy flow in the quadratic systems Statistical mean and covariance dynamics, u = ū + Z i v i, R ij = Z i Z j, dū dt = (L + D) ū + B (ū, ū) + R ij B ( v i, v j ) + F (t), dr dt = Lv (ū) R + RL v (ū) + Q F + Q σ. Q F = Z mz nz j B (vm, v n) v i + Z mz nz i B (v m, v n) v j (a) perfect model (b) imperfect closure Figure 3: Energy flow in the L-96 system. Energy flows from the mean Figure field to 4: the Energy linearly flow unstable in the MQG UQ scheme. Energy flows from the mean field to the linearly modes and then redistributed through nonlinear, conservative termsunstable to the stable modesmodes. and then Redredistributed through empirical, conservative fluxes to the stable modes. arrows denotes dissipation, while the dashed box indicates terms that Red conserve arrows energy. denotes dissipation, while the dashed box indicates terms that conserve energy. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

21 Turbulent dynamical systems with non-gaussian statistical steady Turbulent states Dynamical Systems with Non-Gaussian Statistical Steady States and Nontrivial Third Moments Consider a turbulent dynamical system without noise, s 0, and assume it has a statistical steady state so that ū eq and R eq are time independent. Since d dt R eq = 0, R eq necessarily satisfies the steady covariance equation (3.6) Lūeq R eq + R eq L ū eq = Q F,eq, (3.11) where Q F,eq are the third moments from (3.9) evaluated at the statistical steady state. Thus a necessary and sufficient condition for a non-gaussian statistical steady state is that the first and second moments satisfy the obvious requirement that the matrix Lūeq R eq + R eq L ū eq 6= 0, (3.12) so the above matrix has some non-zero entries. This elementary remark can be So viewed the above as a sweeping matrix has generalization some non-zero for turbulent entries. dynamical The non-trivial systems third of the moments Karmanplay Howarth a crucial equation dynamical for therole Navier-Stokes in the L-96 equation model and (see forchapter two-layer 6 of ocean [47]). turbulence. The nontrivial third moments play a crucial dynamical role in the L-96 model and for twolayer ocean turbulence [158, 157], and is discussed in later chapters. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

22 Turbulent dynamical systems with non-gaussian statistical steady states In the system with a Gaussian invariant measure du dt = B (u, u) + Lu dλu + Λ1 /2 σẇ (t; ω). There ū eq = 0, R eq = σeqi 2, and Lūeq = L with L skew-symmetric, so LR eq + R eq L 0; The damping with matrix D = dλ exactly balances the stochastic forcing variance σ 2 Λ; For a strictly positive covariance R eq, there is a whitening linear transformation, so that TR eq T 1 = I. Nontrivial third moments are satisfied if TLūeq T 1, is non-zero. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

23 weakly chaotic Lorenz 96 system strongly chaotic fully turbulent L-96Table 2.1 Dynamical properties of L-96 model for weakly chaotic regime (F = 6), strongly chaotic regime (F = 8)and fully turbulent regime (F = 16). Here, l1 denotes the largest Lyapunov exponent, N + denotes the dimension of the expanding subspace of the attractor, KS denotes the dui Kolmogorov-Sinai and Tcorr denotes the decorrelation time ofi energy-rescaled corre= ui 1 (uentropy, = 0, 1,..., Jtime 1, J i+1 ui 2 ) di (t) ui + Fi (t), lation dt function. = 40. uj = u0. F=6 time 20 F= space F = space space Fig. 2.1 Space-time of numerical solutions of L-96 model for weakly chaotic (F = 6), strongly Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

24 Statistical formulation of the L-96 system We use a Fourier basis v k = { } J 1 1 J e 2πık j J because they diagonalize translation invariant systems with spatial homogeneity. Here are the statistical dynamics for L-96 model: j=0, dū (t) dt dr k (t) dt = d (t) ū (t) + 1 J J/2 k= J /2+1 r k (t) Γ k + F (t) =2 [ Γ k ū (t) d (t)] r k (t) + Q F,kk, k = 0, 1,..., J /2. (10) Here we denote Γ k = cos 4πk J cos 2πk J, r k = Z k Z k = Zk Zk = r k, and the nonlinear flux Q F for the third moments becomes diagonal Q F,kk = 2 J with energy conservation trq F = 0. m { ( 2m+k 2πi Re Z m Z m k Z k e J e )} m+2k 2πi J δ kk, Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

25 Statistical energy conservation principle for L-96 model By multiplying ū on both sides of the mean equation and by summing up all the modes in the variance equation in (10), we get dū 2 dt dtrr dt = 2dū 2 + 2ūF + 2 J ( ) = 2 k Γ k r k ū Γ k r k ū k 2dtrR + trq F. It is convenient to define the statistical energy including both mean and total variance as E (t) = J 2 ū2 + 1 trr. (11) 2 With this definition the corresponding dynamical equation for the statistical energy E of the true system can be easily derived as de dt = 2dE + JF ū trq F = 2dE + JF ū, (12) with symmetry of nonlinear energy conservation, trq F = 0, assumed. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

26 Nontrivial third moments for statistical steady state of L-96 model Consider the original L-96 model with constant forcing F and damping d = 1 with the statistical steady states ū eq, R eq, with R eq = {r eq,i δ ij } diagonal. For the L-96 model with homogeneous statistics, { } the linear operator is also block diagonal with the symmetric part L s ū eq = L s ū δ eq,i ij and L s ū eq,i = Γ i ū eq 1, i = 0,, J/2. The third moments are non-zero and the statistical steady state is non-gaussian provided L s ū eq,ir eq,i 0, for some i with 0 i J 2, in which case 2L s ū eq,ir eq,i = Q F,eq,i, 0 i J 2. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

27 Nontrivial third moments for statistical steady state of L-96 mode 14 Predicting Fat-Tailed Intermittent Probability Distributions in Passive Scalar Turbulence k 3 x 3 third order moments in spectral domain, F = State of the 16 Mean u l third order moments in spectal domain, F = x Fig. 2.5: 0 Model prediction of 0the 0 mean 10 state 20 ū30 40 x 1 u M (left upper row) and averaged energy trr M /J (or 1- i K = 120 K = 19 K = 015 K = k k 2 u k time (a) third order moments1-point between variance modes in spectral domain K = third order moments in physical domain, F = 8 third order moments in physical domain, F = 8 K = K = K = time u j (a) Model prediction for the mean and total variance Di Qi and Andrew J. Majda mode on each grid point, left lower row) from Galerkin truncated L-96 models in regime F =8 with numb (b) third order moments between state variables at different physical grid points Fourier modes K =19,15,10, compared with the true model with total number of modes K =20 Fig. Di state Qi, 2.6: andthird spectra Andreworder J. achieved Majda moments (CIMS) through of the flowthese Mathematical variable truncated u in Theories steady models of state Turbulent inare both Systems compared spectral and with physical the state domain Nov. variables in 17, regime 2016 û k 23 from / Energy Spectra N=20 N=19 N=15 N=10 (b) Model prediction for energy spectra

28 Outline 1 Nontrivial turbulent dynamical systems with a Gaussian invariant measure 2 Exact equations for the mean and covariance of the fluctuations Turbulent dynamical systems with nontrivial third-order moments Statistical dynamics in the L-96 model and statistical energy conservation 3 A statistical energy conservation principle for turbulent dynamical systems Details about deterministic triad energy conservation symmetry A generalized statistical energy identity Enhanced dissipation of the statistical mean energy, the statistical energy principle, and Eddy viscosity Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

29 A general statistical energy principle In L-96 system with homogeneous statistics, we have the statistical energy dynamics for the total statistical energy E (t) = J 2 ū trr de dt = 2dE + JF ū. A fundamental issue in UQ is that complex turbulent dynamical systems are highly anisotropic with inhomogeneous forcing and the statistical mean can exchange energy with the fluctuations. There is suitable statistical symmetry so that the energy of the mean plus the tracer of the covariance matrix satisfies an energy conservation principle for the general conservative nonlinear dynamics du dt = (L + D) u + B (u, u) + F (t) + σ k (t) Ẇ k (t; ω), where exact mean statistical field equation and the covariance equation can be calculated as dū dt = (L + D) ū + B (ū, ū) + R ijb (e i, e j ) + F, dr dt =Lv R + RL v + Q F + Q σ. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

30 Detailed symmetry in triad energy conservation Proposition Consider the three dimensional Galerkin projected dynamics spanned by the triad e i, e j, e k for 1 i, j, k N for the pure nonlinear model Assume the following: A) The self interactions vanish, (u Λ ) t = P Λ B (u Λ, u Λ ). (13) B (e i, e i ) 0, 1 i N; (14) B) The dyad interaction coefficients vanish through the symmetry, e i [B (e l, e i ) + B (e i, e l )] = 0, for any i, l. (15) Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

31 Detailed symmetry in triad energy conservation Proposition (continue) Then the three dimensional Galerkin truncation becomes the triad interaction equations for u = (u i, u j, u k ) = (u Λ e i, u Λ e j, u Λ e k ) du i dt =A ijku j u k, with coefficient satisfying du j dt = A jkiu k u i, du k dt = A kij u i u j. (16) A ijk + A jik + A kji = 0, (17) which is the detailed triad energy conservation symmetry, since A ijk + A jki + A kij e i [B (e j, e k ) + B (e k, e j )] + = 0. e j [B (e k, e i ) + B (e i, e k )] + e k [B (e i, e j ) + B (e j, e i )] Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

32 The projected energy conservation law Define Λ as the index set for the resolved modes under the orthonormal basis {e i } N i=1 of full dimensionality N in the truncation model u Λ = P Λ u = i Λ u i e i. The projected energy conservation law for truncated energy E Λ = 1 2 u Λ u Λ is satisfied depending on the proper conserved quantity and the induced inner product de Λ = u Λ P Λ B (u Λ, u Λ ) = 0. (18) dt The second equality holds since u Λ P Λ B (u Λ, u Λ ) = u Λ [e i B (u Λ, u Λ )] e i = j Λ i Λ u j e j N [e i B (u Λ, u Λ )] e i i=1 = u Λ B (u Λ, u Λ ), Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

33 Proof of the Proposition Now consider the triad truncated system about state variable u Λ in a three dimensional subspace. We take the index set with resolved modes as Λ = {i, j, k}. the explicit expressions can thus be calculated along each mode e m, m = i, j, k by applying assumption A) and B) in the Proposition du m dt = e m P Λ B (u Λ, u Λ ) = e m B ( u n e n, n Λ l Λ = u n u l e m B (e n, e l ) = n,l Λ n l Λ {m} u l e l ) u n u l e m B (e n, e l ) = u n u l e m [B (e n, e l ) + B (e l, e n )], n l m. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

34 Proof of the Proposition The interaction coefficients therefore can be defined as A ijk = e i [B (e j, e k ) + B (e k, e j )], with symmetry and vanishing property A ijk = A ikj, A ijk = 0, if two of the index i, j, k coincident. With this explicit definition of the coefficients A ijk, the detailed triad energy conservation symmetry is just direct application of the above formulas, that is for any u i, u j, u k with i j k de Λ dt du i = u i dt + u du j j dt + u du k k dt = (A ijk + A jki + A kij ) u i u k u j 0. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

35 Dynamics for the mean and fluctuation energy Proposition The change of mean energy Ē = 1 2 (ū ū) satisfies ( ) d 1 dt 2 ū 2 = ū Dū + ū F R ijū [B (e i, e j ) + B (e j, e i )]. (19) The last term represents the effect of the fluctuation on the mean, ū. Proposition Under the structure assumption in (14) and (15) on the basis e i, the fluctuating energy, E = 1 2trR, for any turbulent dynamical system satisfies, de dt = 1 2 tr ( DR + R D ) trq σ 1 2 R ijū [B (e i, e j ) + B (e j, e i )], (20) where R satisfies the exact covariance equation. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

36 Statistical energy conservation principle 3 Theorem ( Statistical Energy Conservation Principle) Under the structural assumption (14), (15) on the basis e i, for any turbulent dynamical systems in the form du dt = (L + D) u + B (u, u) + F (t) + σ k (t) Ẇ k (t; ω), the total statistical energy, E = Ē + E = 2ū 1 ū + 1 2trR, satisfies de ( ) dt = ū Dū + ū F + tr DR trq σ, (21) where R satisfies the exact covariance equation. 3 Majda, Statistical energy conservation principle for inhomogeneous turbulent dynamical systems, PNAS, Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

37 Illustration about the proof ˆR is the tensor representation of the covariance matrix with u = Z i e i, ˆR = u u = i,j R ij e i e j ; ( ) the matrix B ū, ˆR is defined as the componentwise interaction with each column of ˆR. Expand ū by ū = ū M e M, and use tr (a b) = a b, we have ( ) ) ] 1 [B tr ū, ˆR + B (ˆR, ū + transpose part 2 = 1 2 R ijū M [e i B (e M, e j ) + B (e i, e M ) e j + e j B (e M, e i ) + B (e j, e M ) e i ]. Now use the detailed triad conservation structure, the formula is given by e i [B (e j, e M ) + B (e M, e j )]+e j [B (e M, e i ) + B (e i, e M )] = e M [B (e i, e j ) + B (e j, e i )]. Now, use ū = ū M e M and get that the sum in (17) for this contribution to the trace is exactly 1 2 R ijū [B (e i, e j ) + B (e j, e i )]. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

38 Illustrative general examples and applications Corollary Under the assumption of the Theorem, assume D = di, with d > 0, then the turbulent dynamical system satisfies the closed statistical energy equation for E = 1 2ū ū trr, de dt = 2dE + ū F trq σ. (22) In particular, if the external forcing vanishes so that F 0, Q σ 0, for random initial conditions, the statistical energy decays exponentially in time and satisfies E (t) = exp ( 2dt) E 0. Assume the symmetric dissipation matrix, D, satisfies the upper and lower bounds, d + u 2 u Du d u 2, with d, d + > 0. Typical general dissipation matrices D are diagonal in basis with Fourier modes or spherical harmonics, any positive symmetric matrix R 0 we have the a priori bounds, ( ) DR + R D d +trr tr d trr. 2 Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

39 Illustrative general examples and applications Corollary Under the assumption of the Theorem, assume D = di, with d > 0, then the turbulent dynamical system satisfies the closed statistical energy equation for E = 1 2ū ū trr, de dt = 2dE + ū F trq σ. (22) In particular, if the external forcing vanishes so that F 0, Q σ 0, for random initial conditions, the statistical energy decays exponentially in time and satisfies E (t) = exp ( 2dt) E 0. Assume the symmetric dissipation matrix, D, satisfies the upper and lower bounds, d + u 2 u Du d u 2, with d, d + > 0. Typical general dissipation matrices D are diagonal in basis with Fourier modes or spherical harmonics, any positive symmetric matrix R 0 we have the a priori bounds, ( ) DR + R D d +trr tr d trr. 2 Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

40 Illustrative general examples and applications Corollary Assume D is diagonal and satisfies the upper and lower bounds, then the statistical energy in (21) in the Theorem, E (t), satisfies the upper and lower bounds E + (t) E (t) E (t) where E ± (t) satisfy the differential equality in Corollary 1 with d d ±. In particular, the statistical energy is a statistical Lyapunov function for the turbulent dynamical system. Also, if the external forcings F, Q σ vanish, the statistical energy decays exponentially with these upper and lower bounds. Consider the Gaussian approximation to the one point statistics; recall that u = ū + Z i e i so at the location x, the mean and variance are given by ū (x) = ū M e M (x), var (u (x)) = Z j Z k e j (x) e k (x). We have control over the variance of the average over the domain, denoted by E x because E xe j (x) e k (x) = δ jk I ; thus, the average of the single point variance is bounded by trr which is controlled by E. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

41 Illustrative general examples and applications Corollary Assume D is diagonal and satisfies the upper and lower bounds, then the statistical energy in (21) in the Theorem, E (t), satisfies the upper and lower bounds E + (t) E (t) E (t) where E ± (t) satisfy the differential equality in Corollary 1 with d d ±. In particular, the statistical energy is a statistical Lyapunov function for the turbulent dynamical system. Also, if the external forcings F, Q σ vanish, the statistical energy decays exponentially with these upper and lower bounds. Consider the Gaussian approximation to the one point statistics; recall that u = ū + Z i e i so at the location x, the mean and variance are given by ū (x) = ū M e M (x), var (u (x)) = Z j Z k e j (x) e k (x). We have control over the variance of the average over the domain, denoted by E x because E xe j (x) e k (x) = δ jk I ; thus, the average of the single point variance is bounded by trr which is controlled by E. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

42 Example with turbulent flow The nonlinear terms define B with dynamics alone ω Λ t = P Λ ( ψ Λ ω Λ ), ψλ = ω Λ, which satisfy both the conservation of Energy, E Λ, and Enstrophy, E Λ with E Λ = 1 ˆ ψ Λ ω Λ dx, and E Λ = 1 ˆ ω Λdx. It is well-known that in a Fourier basis, the symmetry conditions of Proposition are satisfied for either the L 2 inner product for E Λ or with a rescaled version of E Λ ˆ ˆ u 1, u 2 E ω 1 ω 2 dx = ψ 1 ψ 2 dx, u 1, u 2 E ˆ ψ 1 ω 2 dx = ˆ ψ 1 ψ 2 dx, Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

43 Example with a dyad model To check the generalized energy principle, we consider the simplest dyad interaction equation u 1 t u 2 t = γ 1 u 1 u 2 + γ 2 u 2 2, = γ 1 u 2 1 γ 2 u 1 u 2. Take the two-dimensional natural basis e 1 = (1, 0) T and e 2 = (0, 1) T, and the inner product is defined as the standard Euclidean inner product. Then the conservative quadratic interaction becomes B (e 1, e 1 ) = (0, γ 1 ) T, ( 1 B (e 1, e 2 ) = B (e 2, e 1 ) = 2 γ 1, 1 ) T 2 γ 2, B (e 2, e 2 ) = (γ 2, 0) T. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

44 The energy conservation u B (u, u) = 0 is satisfied in this model. Obviously the assumptions in (14) and (15) become non-zero B (e i, e i ) 0, e i [B (e l, e i ) + B (e i, e l )] 0. On the other hand, the dyad interaction balance is satisfied so that e 1 B (e 1, e 2 ) + e 1 B (e 2, e 1 ) + e 2 B (e 1, e 1 ) = γ 1 γ 1 = 0. Therefore the statistical energy conservation law is still valid for this dyad system [ d 1 (ū2 dt ū2) 2 1 ( ) ] + u u 2 2 = 0. Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

45 Questions & Discussions Di Qi, and Andrew J. Majda (CIMS) Mathematical Theories of Turbulent Systems Nov. 17, / 39

Statistical Mechanics for the Truncated Quasi-Geostrophic Equations

Statistical Mechanics for the Truncated Quasi-Geostrophic Equations Statistical Mechanics for the Truncated Quasi-Geostrophic Equations Di Qi, and Andrew J. Majda Courant Institute of Mathematical Sciences Fall 6 Advanced Topics in Applied Math Di Qi, and Andrew J. Majda

More information

Statistical energy conservation principle for inhomogeneous turbulent dynamical systems

Statistical energy conservation principle for inhomogeneous turbulent dynamical systems Statistical energy conservation principle for inhomogeneous turbulent dynamical systems Andrew J. Majda 1 Department of Mathematics and Center for Atmosphere and Ocean Science, Courant Institute of Mathematical

More information

Low-Dimensional Reduced-Order Models for Statistical Response and Uncertainty Quantification

Low-Dimensional Reduced-Order Models for Statistical Response and Uncertainty Quantification Low-Dimensional Reduced-Order Models for Statistical Response and Uncertainty Quantification Andrew J Majda joint work with Di Qi Morse Professor of Arts and Science Department of Mathematics Founder of

More information

PREDICTING EXTREME EVENTS FOR PASSIVE SCALAR TURBULENCE IN TWO-LAYER BAROCLINIC FLOWS THROUGH REDUCED-ORDER STOCHASTIC MODELS

PREDICTING EXTREME EVENTS FOR PASSIVE SCALAR TURBULENCE IN TWO-LAYER BAROCLINIC FLOWS THROUGH REDUCED-ORDER STOCHASTIC MODELS PREDICTING EXTREME EVENTS FOR PASSIVE SCALAR TURBULENCE IN TWO-LAYER BAROCLINIC FLOWS THROUGH REDUCED-ORDER STOCHASTIC MODELS DI QI AND ANDREW J. MAJDA Abstract. The capability of using imperfect stochastic

More information

Equilibrium Statistical Mechanics for the Truncated Burgers-Hopf Equations

Equilibrium Statistical Mechanics for the Truncated Burgers-Hopf Equations Equilibrium Statistical Mechanics for the Truncated Burgers-Hopf Equations Di Qi, and Andrew J. Majda Courant Institute of Mathematical Sciences Fall 2016 Advanced Topics in Applied Math Di Qi, and Andrew

More information

Barotropic geophysical flows and two-dimensional fluid flows: Conserved Quantities

Barotropic geophysical flows and two-dimensional fluid flows: Conserved Quantities Barotropic geophysical flows and two-dimensional fluid flows: Conserved Quantities Di Qi, and Andrew J. Majda Courant Institute of Mathematical Sciences Fall 2016 Advanced Topics in Applied Math Di Qi,

More information

Introduction to Turbulent Dynamical Systems in Complex Systems

Introduction to Turbulent Dynamical Systems in Complex Systems Introduction to Turbulent Dynamical Systems in Complex Systems Di Qi, and Andrew J. Majda Courant Institute of Mathematical Sciences Fall 216 Advanced Topics in Applied Math Di Qi, and Andrew J. Majda

More information

Introduction to asymptotic techniques for stochastic systems with multiple time-scales

Introduction to asymptotic techniques for stochastic systems with multiple time-scales Introduction to asymptotic techniques for stochastic systems with multiple time-scales Eric Vanden-Eijnden Courant Institute Motivating examples Consider the ODE {Ẋ = Y 3 + sin(πt) + cos( 2πt) X() = x

More information

Non-linear Stability of Steady Geophysical Flows

Non-linear Stability of Steady Geophysical Flows Non-linear Stability of Steady Geophysical Flows Di Qi, and Andrew J. Majda Courant Institute of Mathematical Sciences Fall 2016 Advanced Topics in Applied Math Di Qi, and Andrew J. Majda (CIMS) Non-linear

More information

Stochastic Mode Reduction in Large Deterministic Systems

Stochastic Mode Reduction in Large Deterministic Systems Stochastic Mode Reduction in Large Deterministic Systems I. Timofeyev University of Houston With A. J. Majda and E. Vanden-Eijnden; NYU Related Publications: http://www.math.uh.edu/ ilya Plan Mode-Elimination

More information

Low-dimensional chaotic dynamics versus intrinsic stochastic noise: a paradigm model

Low-dimensional chaotic dynamics versus intrinsic stochastic noise: a paradigm model Physica D 199 (2004) 339 368 Low-dimensional chaotic dynamics versus intrinsic stochastic noise: a paradigm model A. Majda a,b, I. Timofeyev c, a Courant Institute of Mathematical Sciences, New York University,

More information

Upon successful completion of MATH 220, the student will be able to:

Upon successful completion of MATH 220, the student will be able to: MATH 220 Matrices Upon successful completion of MATH 220, the student will be able to: 1. Identify a system of linear equations (or linear system) and describe its solution set 2. Write down the coefficient

More information

A priori tests of a stochastic mode reduction strategy

A priori tests of a stochastic mode reduction strategy Physica D 170 (2002) 206 252 A priori tests of a stochastic mode reduction strategy A. Majda a,b, I. Timofeyev a,b, E. Vanden-Eijnden a, a Courant Institute of Mathematical Sciences, New Yor University,

More information

Tutorial School on Fluid Dynamics: Aspects of Turbulence Session I: Refresher Material Instructor: James Wallace

Tutorial School on Fluid Dynamics: Aspects of Turbulence Session I: Refresher Material Instructor: James Wallace Tutorial School on Fluid Dynamics: Aspects of Turbulence Session I: Refresher Material Instructor: James Wallace Adapted from Publisher: John S. Wiley & Sons 2002 Center for Scientific Computation and

More information

EIGENVALUES AND EIGENVECTORS 3

EIGENVALUES AND EIGENVECTORS 3 EIGENVALUES AND EIGENVECTORS 3 1. Motivation 1.1. Diagonal matrices. Perhaps the simplest type of linear transformations are those whose matrix is diagonal (in some basis). Consider for example the matrices

More information

Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows

Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows SP and DSS for Filtering Sparse Geophysical Flows Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows Presented by Nan Chen, Michal Branicki and Chenyue

More information

Linear Algebra. Min Yan

Linear Algebra. Min Yan Linear Algebra Min Yan January 2, 2018 2 Contents 1 Vector Space 7 1.1 Definition................................. 7 1.1.1 Axioms of Vector Space..................... 7 1.1.2 Consequence of Axiom......................

More information

Mathematical Methods wk 2: Linear Operators

Mathematical Methods wk 2: Linear Operators John Magorrian, magog@thphysoxacuk These are work-in-progress notes for the second-year course on mathematical methods The most up-to-date version is available from http://www-thphysphysicsoxacuk/people/johnmagorrian/mm

More information

Chapter 1: Systems of Linear Equations

Chapter 1: Systems of Linear Equations Chapter : Systems of Linear Equations February, 9 Systems of linear equations Linear systems Lecture A linear equation in variables x, x,, x n is an equation of the form a x + a x + + a n x n = b, where

More information

36. TURBULENCE. Patriotism is the last refuge of a scoundrel. - Samuel Johnson

36. TURBULENCE. Patriotism is the last refuge of a scoundrel. - Samuel Johnson 36. TURBULENCE Patriotism is the last refuge of a scoundrel. - Samuel Johnson Suppose you set up an experiment in which you can control all the mean parameters. An example might be steady flow through

More information

Rotational motion of a rigid body spinning around a rotational axis ˆn;

Rotational motion of a rigid body spinning around a rotational axis ˆn; Physics 106a, Caltech 15 November, 2018 Lecture 14: Rotations The motion of solid bodies So far, we have been studying the motion of point particles, which are essentially just translational. Bodies with

More information

Linear Algebra: Matrix Eigenvalue Problems

Linear Algebra: Matrix Eigenvalue Problems CHAPTER8 Linear Algebra: Matrix Eigenvalue Problems Chapter 8 p1 A matrix eigenvalue problem considers the vector equation (1) Ax = λx. 8.0 Linear Algebra: Matrix Eigenvalue Problems Here A is a given

More information

Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows

Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows June 2013 Outline 1 Filtering Filtering: obtaining the best statistical estimation of a nature

More information

MATH 423 Linear Algebra II Lecture 33: Diagonalization of normal operators.

MATH 423 Linear Algebra II Lecture 33: Diagonalization of normal operators. MATH 423 Linear Algebra II Lecture 33: Diagonalization of normal operators. Adjoint operator and adjoint matrix Given a linear operator L on an inner product space V, the adjoint of L is a transformation

More information

FUNDAMENTAL LIMITATIONS OF POLYNOMIAL CHAOS FOR UNCERTAINTY QUANTIFICATION IN SYSTEMS WITH INTERMITTENT INSTABILITIES

FUNDAMENTAL LIMITATIONS OF POLYNOMIAL CHAOS FOR UNCERTAINTY QUANTIFICATION IN SYSTEMS WITH INTERMITTENT INSTABILITIES COMMUN. MATH. SCI. Vol., No., pp. 55 3 3 International Press FUNDAMENTAL LIMITATIONS OF POLYNOMIAL CHAOS FOR UNCERTAINTY QUANTIFICATION IN SYSTEMS WITH INTERMITTENT INSTABILITIES MICHAL BRANICKI AND ANDREW

More information

Lecture Summaries for Linear Algebra M51A

Lecture Summaries for Linear Algebra M51A These lecture summaries may also be viewed online by clicking the L icon at the top right of any lecture screen. Lecture Summaries for Linear Algebra M51A refers to the section in the textbook. Lecture

More information

Principal Component Analysis

Principal Component Analysis Principal Component Analysis Laurenz Wiskott Institute for Theoretical Biology Humboldt-University Berlin Invalidenstraße 43 D-10115 Berlin, Germany 11 March 2004 1 Intuition Problem Statement Experimental

More information

Lecture Notes 1: Vector spaces

Lecture Notes 1: Vector spaces Optimization-based data analysis Fall 2017 Lecture Notes 1: Vector spaces In this chapter we review certain basic concepts of linear algebra, highlighting their application to signal processing. 1 Vector

More information

Towards low-order models of turbulence

Towards low-order models of turbulence Towards low-order models of turbulence Turbulence in Engineering Applications Long Programme in Mathematics of Turbulence IPAM, UCLA Ati Sharma Beverley McKeon + Rashad Moarref + Paco Gomez Ashley Willis

More information

Review of some mathematical tools

Review of some mathematical tools MATHEMATICAL FOUNDATIONS OF SIGNAL PROCESSING Fall 2016 Benjamín Béjar Haro, Mihailo Kolundžija, Reza Parhizkar, Adam Scholefield Teaching assistants: Golnoosh Elhami, Hanjie Pan Review of some mathematical

More information

Continuum Mechanics Fundamentals

Continuum Mechanics Fundamentals Continuum Mechanics Fundamentals James R. Rice, notes for ES 220, 12 November 2009; corrections 9 December 2009 Conserved Quantities Let a conseved quantity have amount F per unit volume. Examples are

More information

A Sufficient Condition for the Kolmogorov 4/5 Law for Stationary Martingale Solutions to the 3D Navier-Stokes Equations

A Sufficient Condition for the Kolmogorov 4/5 Law for Stationary Martingale Solutions to the 3D Navier-Stokes Equations A Sufficient Condition for the Kolmogorov 4/5 Law for Stationary Martingale Solutions to the 3D Navier-Stokes Equations Franziska Weber Joint work with: Jacob Bedrossian, Michele Coti Zelati, Samuel Punshon-Smith

More information

Lecture 10: A (Brief) Introduction to Group Theory (See Chapter 3.13 in Boas, 3rd Edition)

Lecture 10: A (Brief) Introduction to Group Theory (See Chapter 3.13 in Boas, 3rd Edition) Lecture 0: A (Brief) Introduction to Group heory (See Chapter 3.3 in Boas, 3rd Edition) Having gained some new experience with matrices, which provide us with representations of groups, and because symmetries

More information

Math 1553, Introduction to Linear Algebra

Math 1553, Introduction to Linear Algebra Learning goals articulate what students are expected to be able to do in a course that can be measured. This course has course-level learning goals that pertain to the entire course, and section-level

More information

,, rectilinear,, spherical,, cylindrical. (6.1)

,, rectilinear,, spherical,, cylindrical. (6.1) Lecture 6 Review of Vectors Physics in more than one dimension (See Chapter 3 in Boas, but we try to take a more general approach and in a slightly different order) Recall that in the previous two lectures

More information

Physics Constrained Nonlinear Regression Models for Time Series

Physics Constrained Nonlinear Regression Models for Time Series Physics Constrained Nonlinear Regression Models for Time Series Andrew J. Majda and John Harlim 2 Department of Mathematics and Center for Atmosphere and Ocean Science, Courant Institute of Mathematical

More information

A Brief Outline of Math 355

A Brief Outline of Math 355 A Brief Outline of Math 355 Lecture 1 The geometry of linear equations; elimination with matrices A system of m linear equations with n unknowns can be thought of geometrically as m hyperplanes intersecting

More information

Derivation of the GENERIC form of nonequilibrium thermodynamics from a statistical optimization principle

Derivation of the GENERIC form of nonequilibrium thermodynamics from a statistical optimization principle Derivation of the GENERIC form of nonequilibrium thermodynamics from a statistical optimization principle Bruce Turkington Univ. of Massachusetts Amherst An optimization principle for deriving nonequilibrium

More information

Vector spaces. DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis.

Vector spaces. DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis. Vector spaces DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis http://www.cims.nyu.edu/~cfgranda/pages/obda_fall17/index.html Carlos Fernandez-Granda Vector space Consists of: A set V A scalar

More information

MATH 240 Spring, Chapter 1: Linear Equations and Matrices

MATH 240 Spring, Chapter 1: Linear Equations and Matrices MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear

More information

Note the diverse scales of eddy motion and self-similar appearance at different lengthscales of the turbulence in this water jet. Only eddies of size

Note the diverse scales of eddy motion and self-similar appearance at different lengthscales of the turbulence in this water jet. Only eddies of size L Note the diverse scales of eddy motion and self-similar appearance at different lengthscales of the turbulence in this water jet. Only eddies of size 0.01L or smaller are subject to substantial viscous

More information

Mathematical Hydrodynamics

Mathematical Hydrodynamics Mathematical Hydrodynamics Ya G. Sinai 1. Introduction Mathematical hydrodynamics deals basically with Navier-Stokes and Euler systems. In the d-dimensional case and incompressible fluids these are the

More information

Elementary maths for GMT

Elementary maths for GMT Elementary maths for GMT Linear Algebra Part 2: Matrices, Elimination and Determinant m n matrices The system of m linear equations in n variables x 1, x 2,, x n a 11 x 1 + a 12 x 2 + + a 1n x n = b 1

More information

1 9/5 Matrices, vectors, and their applications

1 9/5 Matrices, vectors, and their applications 1 9/5 Matrices, vectors, and their applications Algebra: study of objects and operations on them. Linear algebra: object: matrices and vectors. operations: addition, multiplication etc. Algorithms/Geometric

More information

Tutorial on Principal Component Analysis

Tutorial on Principal Component Analysis Tutorial on Principal Component Analysis Copyright c 1997, 2003 Javier R. Movellan. This is an open source document. Permission is granted to copy, distribute and/or modify this document under the terms

More information

Math 302 Outcome Statements Winter 2013

Math 302 Outcome Statements Winter 2013 Math 302 Outcome Statements Winter 2013 1 Rectangular Space Coordinates; Vectors in the Three-Dimensional Space (a) Cartesian coordinates of a point (b) sphere (c) symmetry about a point, a line, and a

More information

Quantum Computing Lecture 2. Review of Linear Algebra

Quantum Computing Lecture 2. Review of Linear Algebra Quantum Computing Lecture 2 Review of Linear Algebra Maris Ozols Linear algebra States of a quantum system form a vector space and their transformations are described by linear operators Vector spaces

More information

Systematic strategies for real time filtering of turbulent signals in complex systems

Systematic strategies for real time filtering of turbulent signals in complex systems Systematic strategies for real time filtering of turbulent signals in complex systems Statistical inversion theory for Gaussian random variables The Kalman Filter for Vector Systems: Reduced Filters and

More information

Math 4A Notes. Written by Victoria Kala Last updated June 11, 2017

Math 4A Notes. Written by Victoria Kala Last updated June 11, 2017 Math 4A Notes Written by Victoria Kala vtkala@math.ucsb.edu Last updated June 11, 2017 Systems of Linear Equations A linear equation is an equation that can be written in the form a 1 x 1 + a 2 x 2 +...

More information

1. General Vector Spaces

1. General Vector Spaces 1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule

More information

Phase Synchronization

Phase Synchronization Phase Synchronization Lecture by: Zhibin Guo Notes by: Xiang Fan May 10, 2016 1 Introduction For any mode or fluctuation, we always have where S(x, t) is phase. If a mode amplitude satisfies ϕ k = ϕ k

More information

Stochastic Particle Methods for Rarefied Gases

Stochastic Particle Methods for Rarefied Gases CCES Seminar WS 2/3 Stochastic Particle Methods for Rarefied Gases Julian Köllermeier RWTH Aachen University Supervisor: Prof. Dr. Manuel Torrilhon Center for Computational Engineering Science Mathematics

More information

Inviscid 2D flow (periodic boundaries)

Inviscid 2D flow (periodic boundaries) Inviscid 2D flow (periodic boundaries) @ t q + r (vq) =@ t q + J(,q)= S + R advection of potential vorticity @ v = @y, @ @x d dxdyf (q) =0 dt q = r 2 + h, h(x, y) =f H D H D Quadratic Invariants Potential

More information

Stochastic Dynamics of SDOF Systems (cont.).

Stochastic Dynamics of SDOF Systems (cont.). Outline of Stochastic Dynamics of SDOF Systems (cont.). Weakly Stationary Response Processes. Equivalent White Noise Approximations. Gaussian Response Processes as Conditional Normal Distributions. Stochastic

More information

Homogeneous Turbulence Dynamics

Homogeneous Turbulence Dynamics Homogeneous Turbulence Dynamics PIERRE SAGAUT Universite Pierre et Marie Curie CLAUDE CAMBON Ecole Centrale de Lyon «Hf CAMBRIDGE Щ0 UNIVERSITY PRESS Abbreviations Used in This Book page xvi 1 Introduction

More information

On Riesz-Fischer sequences and lower frame bounds

On Riesz-Fischer sequences and lower frame bounds On Riesz-Fischer sequences and lower frame bounds P. Casazza, O. Christensen, S. Li, A. Lindner Abstract We investigate the consequences of the lower frame condition and the lower Riesz basis condition

More information

EXACT SOLUTIONS TO THE NAVIER-STOKES EQUATION FOR AN INCOMPRESSIBLE FLOW FROM THE INTERPRETATION OF THE SCHRÖDINGER WAVE FUNCTION

EXACT SOLUTIONS TO THE NAVIER-STOKES EQUATION FOR AN INCOMPRESSIBLE FLOW FROM THE INTERPRETATION OF THE SCHRÖDINGER WAVE FUNCTION EXACT SOLUTIONS TO THE NAVIER-STOKES EQUATION FOR AN INCOMPRESSIBLE FLOW FROM THE INTERPRETATION OF THE SCHRÖDINGER WAVE FUNCTION Vladimir V. KULISH & José L. LAGE School of Mechanical & Aerospace Engineering,

More information

1 Curvature of submanifolds of Euclidean space

1 Curvature of submanifolds of Euclidean space Curvature of submanifolds of Euclidean space by Min Ru, University of Houston 1 Curvature of submanifolds of Euclidean space Submanifold in R N : A C k submanifold M of dimension n in R N means that for

More information

Chapter III. Quantum Computation. Mathematical preliminaries. A.1 Complex numbers. A.2 Linear algebra review

Chapter III. Quantum Computation. Mathematical preliminaries. A.1 Complex numbers. A.2 Linear algebra review Chapter III Quantum Computation These lecture notes are exclusively for the use of students in Prof. MacLennan s Unconventional Computation course. c 2017, B. J. MacLennan, EECS, University of Tennessee,

More information

A SIMPLE LINEAR RESPONSE CLOSURE APPROXIMATION FOR SLOW DYNAMICS OF A MULTISCALE SYSTEM WITH LINEAR COUPLING

A SIMPLE LINEAR RESPONSE CLOSURE APPROXIMATION FOR SLOW DYNAMICS OF A MULTISCALE SYSTEM WITH LINEAR COUPLING A SIMPLE LINEAR RESPONSE CLOSURE APPROXIMATION FOR SLOW DYNAMICS OF A MULTISCALE SYSTEM WITH LINEAR COUPLING RAFAIL V. ABRAMOV Abstract. Many applications of contemporary science involve multiscale dynamics,

More information

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra. DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1

More information

What is A + B? What is A B? What is AB? What is BA? What is A 2? and B = QUESTION 2. What is the reduced row echelon matrix of A =

What is A + B? What is A B? What is AB? What is BA? What is A 2? and B = QUESTION 2. What is the reduced row echelon matrix of A = STUDENT S COMPANIONS IN BASIC MATH: THE ELEVENTH Matrix Reloaded by Block Buster Presumably you know the first part of matrix story, including its basic operations (addition and multiplication) and row

More information

A scaling limit from Euler to Navier-Stokes equations with random perturbation

A scaling limit from Euler to Navier-Stokes equations with random perturbation A scaling limit from Euler to Navier-Stokes equations with random perturbation Franco Flandoli, Scuola Normale Superiore of Pisa Newton Institute, October 208 Newton Institute, October 208 / Subject of

More information

Before we consider two canonical turbulent flows we need a general description of turbulence.

Before we consider two canonical turbulent flows we need a general description of turbulence. Chapter 2 Canonical Turbulent Flows Before we consider two canonical turbulent flows we need a general description of turbulence. 2.1 A Brief Introduction to Turbulence One way of looking at turbulent

More information

Scattered Data Interpolation with Polynomial Precision and Conditionally Positive Definite Functions

Scattered Data Interpolation with Polynomial Precision and Conditionally Positive Definite Functions Chapter 3 Scattered Data Interpolation with Polynomial Precision and Conditionally Positive Definite Functions 3.1 Scattered Data Interpolation with Polynomial Precision Sometimes the assumption on the

More information

Finite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product

Finite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product Chapter 4 Hilbert Spaces 4.1 Inner Product Spaces Inner Product Space. A complex vector space E is called an inner product space (or a pre-hilbert space, or a unitary space) if there is a mapping (, )

More information

Econ 204 Supplement to Section 3.6 Diagonalization and Quadratic Forms. 1 Diagonalization and Change of Basis

Econ 204 Supplement to Section 3.6 Diagonalization and Quadratic Forms. 1 Diagonalization and Change of Basis Econ 204 Supplement to Section 3.6 Diagonalization and Quadratic Forms De La Fuente notes that, if an n n matrix has n distinct eigenvalues, it can be diagonalized. In this supplement, we will provide

More information

Many contemporary problems in science ranging from protein

Many contemporary problems in science ranging from protein Blended Particle Filters for Large Dimensional Chaotic Dynamical Systems Andrew J. Majda, Di Qi, Themistoklis P. Sapsis Department of Mathematics and Center for Atmosphere and Ocean Science, Courant Institute

More information

Brownian Motion and Langevin Equations

Brownian Motion and Langevin Equations 1 Brownian Motion and Langevin Equations 1.1 Langevin Equation and the Fluctuation- Dissipation Theorem The theory of Brownian motion is perhaps the simplest approximate way to treat the dynamics of nonequilibrium

More information

MATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP)

MATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP) MATH 20F: LINEAR ALGEBRA LECTURE B00 (T KEMP) Definition 01 If T (x) = Ax is a linear transformation from R n to R m then Nul (T ) = {x R n : T (x) = 0} = Nul (A) Ran (T ) = {Ax R m : x R n } = {b R m

More information

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing

More information

Introduction to Group Theory

Introduction to Group Theory Chapter 10 Introduction to Group Theory Since symmetries described by groups play such an important role in modern physics, we will take a little time to introduce the basic structure (as seen by a physicist)

More information

October 25, 2013 INNER PRODUCT SPACES

October 25, 2013 INNER PRODUCT SPACES October 25, 2013 INNER PRODUCT SPACES RODICA D. COSTIN Contents 1. Inner product 2 1.1. Inner product 2 1.2. Inner product spaces 4 2. Orthogonal bases 5 2.1. Existence of an orthogonal basis 7 2.2. Orthogonal

More information

Math 350 Fall 2011 Notes about inner product spaces. In this notes we state and prove some important properties of inner product spaces.

Math 350 Fall 2011 Notes about inner product spaces. In this notes we state and prove some important properties of inner product spaces. Math 350 Fall 2011 Notes about inner product spaces In this notes we state and prove some important properties of inner product spaces. First, recall the dot product on R n : if x, y R n, say x = (x 1,...,

More information

Filtering Sparse Regular Observed Linear and Nonlinear Turbulent System

Filtering Sparse Regular Observed Linear and Nonlinear Turbulent System Filtering Sparse Regular Observed Linear and Nonlinear Turbulent System John Harlim, Andrew J. Majda Department of Mathematics and Center for Atmosphere Ocean Science Courant Institute of Mathematical

More information

An Introduction to Theories of Turbulence. James Glimm Stony Brook University

An Introduction to Theories of Turbulence. James Glimm Stony Brook University An Introduction to Theories of Turbulence James Glimm Stony Brook University Topics not included (recent papers/theses, open for discussion during this visit) 1. Turbulent combustion 2. Turbulent mixing

More information

Linear Algebra 2 Spectral Notes

Linear Algebra 2 Spectral Notes Linear Algebra 2 Spectral Notes In what follows, V is an inner product vector space over F, where F = R or C. We will use results seen so far; in particular that every linear operator T L(V ) has a complex

More information

Lessons in Uncertainty Quantification for Turbulent Dynamical Systems

Lessons in Uncertainty Quantification for Turbulent Dynamical Systems Lessons in Uncertainty Quantification for Turbulent Dynamical Systems Andrew J. Majda and Michal Branicki Department of Mathematics and Center for Atmosphere and Ocean Science, Courant Institute of Mathematical

More information

Systematic deviations from Gaussianity in models of quasigeostrophic turbulence

Systematic deviations from Gaussianity in models of quasigeostrophic turbulence PHYSICS OF FLUIDS 19, 116603 2007 Systematic deviations from Gaussianity in models of quasigeostrophic turbulence I. Timofeyev a Department of Mathematics, University of Houston, Houston, Texas 77204,

More information

Eulerian models. 2.1 Basic equations

Eulerian models. 2.1 Basic equations 2 Eulerian models In this chapter we give a short overview of the Eulerian techniques for modelling turbulent flows, transport and chemical reactions. We first present the basic Eulerian equations describing

More information

L3: Review of linear algebra and MATLAB

L3: Review of linear algebra and MATLAB L3: Review of linear algebra and MATLAB Vector and matrix notation Vectors Matrices Vector spaces Linear transformations Eigenvalues and eigenvectors MATLAB primer CSCE 666 Pattern Analysis Ricardo Gutierrez-Osuna

More information

Chapter 7. Linear Algebra: Matrices, Vectors,

Chapter 7. Linear Algebra: Matrices, Vectors, Chapter 7. Linear Algebra: Matrices, Vectors, Determinants. Linear Systems Linear algebra includes the theory and application of linear systems of equations, linear transformations, and eigenvalue problems.

More information

Vectors. January 13, 2013

Vectors. January 13, 2013 Vectors January 13, 2013 The simplest tensors are scalars, which are the measurable quantities of a theory, left invariant by symmetry transformations. By far the most common non-scalars are the vectors,

More information

Regularization modeling of turbulent mixing; sweeping the scales

Regularization modeling of turbulent mixing; sweeping the scales Regularization modeling of turbulent mixing; sweeping the scales Bernard J. Geurts Multiscale Modeling and Simulation (Twente) Anisotropic Turbulence (Eindhoven) D 2 HFest, July 22-28, 2007 Turbulence

More information

Linear Algebra Notes. Lecture Notes, University of Toronto, Fall 2016

Linear Algebra Notes. Lecture Notes, University of Toronto, Fall 2016 Linear Algebra Notes Lecture Notes, University of Toronto, Fall 2016 (Ctd ) 11 Isomorphisms 1 Linear maps Definition 11 An invertible linear map T : V W is called a linear isomorphism from V to W Etymology:

More information

INSTANTON MODULI AND COMPACTIFICATION MATTHEW MAHOWALD

INSTANTON MODULI AND COMPACTIFICATION MATTHEW MAHOWALD INSTANTON MODULI AND COMPACTIFICATION MATTHEW MAHOWALD () Instanton (definition) (2) ADHM construction (3) Compactification. Instantons.. Notation. Throughout this talk, we will use the following notation:

More information

1 Invariant subspaces

1 Invariant subspaces MATH 2040 Linear Algebra II Lecture Notes by Martin Li Lecture 8 Eigenvalues, eigenvectors and invariant subspaces 1 In previous lectures we have studied linear maps T : V W from a vector space V to another

More information

Linear Algebra (Review) Volker Tresp 2018

Linear Algebra (Review) Volker Tresp 2018 Linear Algebra (Review) Volker Tresp 2018 1 Vectors k, M, N are scalars A one-dimensional array c is a column vector. Thus in two dimensions, ( ) c1 c = c 2 c i is the i-th component of c c T = (c 1, c

More information

Lecture 13 The Fundamental Forms of a Surface

Lecture 13 The Fundamental Forms of a Surface Lecture 13 The Fundamental Forms of a Surface In the following we denote by F : O R 3 a parametric surface in R 3, F(u, v) = (x(u, v), y(u, v), z(u, v)). We denote partial derivatives with respect to the

More information

Eigenvectors and Hermitian Operators

Eigenvectors and Hermitian Operators 7 71 Eigenvalues and Eigenvectors Basic Definitions Let L be a linear operator on some given vector space V A scalar λ and a nonzero vector v are referred to, respectively, as an eigenvalue and corresponding

More information

Stability of Shear Flow

Stability of Shear Flow Stability of Shear Flow notes by Zhan Wang and Sam Potter Revised by FW WHOI GFD Lecture 3 June, 011 A look at energy stability, valid for all amplitudes, and linear stability for shear flows. 1 Nonlinear

More information

Potentially useful reading Sakurai and Napolitano, sections 1.5 (Rotation), Schumacher & Westmoreland chapter 2

Potentially useful reading Sakurai and Napolitano, sections 1.5 (Rotation), Schumacher & Westmoreland chapter 2 Problem Set 2: Interferometers & Random Matrices Graduate Quantum I Physics 6572 James Sethna Due Friday Sept. 5 Last correction at August 28, 2014, 8:32 pm Potentially useful reading Sakurai and Napolitano,

More information

SPECTRAL PROPERTIES OF THE LAPLACIAN ON BOUNDED DOMAINS

SPECTRAL PROPERTIES OF THE LAPLACIAN ON BOUNDED DOMAINS SPECTRAL PROPERTIES OF THE LAPLACIAN ON BOUNDED DOMAINS TSOGTGEREL GANTUMUR Abstract. After establishing discrete spectra for a large class of elliptic operators, we present some fundamental spectral properties

More information

Lecture 1: Systems of linear equations and their solutions

Lecture 1: Systems of linear equations and their solutions Lecture 1: Systems of linear equations and their solutions Course overview Topics to be covered this semester: Systems of linear equations and Gaussian elimination: Solving linear equations and applications

More information

2. Conservation Equations for Turbulent Flows

2. Conservation Equations for Turbulent Flows 2. Conservation Equations for Turbulent Flows Coverage of this section: Review of Tensor Notation Review of Navier-Stokes Equations for Incompressible and Compressible Flows Reynolds & Favre Averaging

More information

DS-GA 1002 Lecture notes 10 November 23, Linear models

DS-GA 1002 Lecture notes 10 November 23, Linear models DS-GA 2 Lecture notes November 23, 2 Linear functions Linear models A linear model encodes the assumption that two quantities are linearly related. Mathematically, this is characterized using linear functions.

More information

Lecture 12: Detailed balance and Eigenfunction methods

Lecture 12: Detailed balance and Eigenfunction methods Miranda Holmes-Cerfon Applied Stochastic Analysis, Spring 2015 Lecture 12: Detailed balance and Eigenfunction methods Readings Recommended: Pavliotis [2014] 4.5-4.7 (eigenfunction methods and reversibility),

More information

dynamical zeta functions: what, why and what are the good for?

dynamical zeta functions: what, why and what are the good for? dynamical zeta functions: what, why and what are the good for? Predrag Cvitanović Georgia Institute of Technology November 2 2011 life is intractable in physics, no problem is tractable I accept chaos

More information

MATH 23a, FALL 2002 THEORETICAL LINEAR ALGEBRA AND MULTIVARIABLE CALCULUS Solutions to Final Exam (in-class portion) January 22, 2003

MATH 23a, FALL 2002 THEORETICAL LINEAR ALGEBRA AND MULTIVARIABLE CALCULUS Solutions to Final Exam (in-class portion) January 22, 2003 MATH 23a, FALL 2002 THEORETICAL LINEAR ALGEBRA AND MULTIVARIABLE CALCULUS Solutions to Final Exam (in-class portion) January 22, 2003 1. True or False (28 points, 2 each) T or F If V is a vector space

More information

Global Maxwellians over All Space and Their Relation to Conserved Quantites of Classical Kinetic Equations

Global Maxwellians over All Space and Their Relation to Conserved Quantites of Classical Kinetic Equations Global Maxwellians over All Space and Their Relation to Conserved Quantites of Classical Kinetic Equations C. David Levermore Department of Mathematics and Institute for Physical Science and Technology

More information