arxiv: v1 [math.na] 21 Feb 2012

Transcription

1 Preserving energy resp. dissipation in numerical PDEs using the Average Vector Field method E. Celledoni a, V. Grimm b, R. I. McLachlan c, D. I. McLaren d, D. O Neale d,e, B. Owren a, G. R. W. Quispel d arxiv:.4555v [math.na] Feb a Department of Mathematical Sciences, NTNU 749 Trondheim, Norway. b Karlsruhe Institute of Technology (KIT), Institut für Angewandte und Numerische Mathematik, D-768 Karlsruhe, Germany. c Institute of Fundamental Sciences, Massey University, Private Bag - Palmerston North, New Zealand. d Department of Mathematics and Statistics, La Trobe University, Victoria 386, Australia. e Industrial Research Ltd, PO Box 33, Lower Hutt 54, New Zealand Abstract We give a systematic method for discretizing Hamiltonian partial differential equations (PDEs) with constant symplectic structure, while preserving their energy exactly. The same method, applied to PDEs with constant dissipative structure, also preserves the correct monotonic decrease of energy. The method is illustrated by many examples. In the Hamiltonian case these include: the sine Gordon, Korteweg de Vries, nonlinear Schrödinger, (linear) -dependent Schrödinger, and Maxwell equations. In the dissipative case the examples are: the Allen Cahn, Cahn Hilliard, Ginzburg Landau, and heat equations. Keywords: Average vector field method, Hamiltonian PDEs, dissipative PDEs, integration. MSC: 65L, 65M6, 65N, 65P. Introduction The opening line of Anna Karenina, All happy families resemble one another, but each unhappy family is unhappy in its own way, is a useful metaphor for the relationship between computational ordinary differential equations (ODEs) and computational partial differential equations (PDEs). ODEs are a happy family perhaps they do not resemble each other, but, at the very least, we can treat them by a relatively small compendium of computational addresses: elenac@math.ntnu.no (E. Celledoni), volker.grimm@kit.edu (V. Grimm), r.mclachlan@massey.ac.nz (R. I. McLachlan), d.mclaren@latrobe.edu.au (D. I. McLaren), d.oneale@irl.cri.nz (D. O Neale), brynjulf.owren@math.ntnu.no (B. Owren), r.quispel@latrobe.edu.au (G. R. W. Quispel) Preprint submitted to Elsevier February,

2 ENERGY CONSERVING PDES techniques... PDEs are a huge and motley collection of problems, each unhappy in its own way (Quote from A. Iserles book [5]). Whereas there is much truth in the above quote, in this paper we set out to convince the reader that, as far as conservation or dissipation of energy is concerned, many PDEs form part of one big happy family (cf. also [7]) that, after a very straightforward and uniform semi-discretization, may actually be solved by a single unique geometric integration method the so-called average vector field method while preserving the correct conservation, respectively, dissipation of energy. The concept of energy has far-reaching importance throughout the physical sciences []. Therefore a single procedure, as presented here, that correctly conserves, resp. dissipates, energy for linear as well as nonlinear, loworder as well as high-order, PDEs would seem to be worth while. Energy-preserving schemes have a long history, going back to Courant, Friedrichs, and Lewy s cunning derivation [6] of a discrete energy conservation law for the 5-point finite difference approximation of the wave equation which they used to prove the scheme s convergence. The conservation law structure of many PDEs is considered fundamental to their derivation, their behaviour, and their discretization. Li and Vu-Quoc [8] give a historical survey of energypreserving methods for PDEs and their applications, especially to nonlinear stability. What is relevant to us here is that many of these methods (e.g. [4, 8, 9,, 9,,, 3, 35]) have an ad-hoc character and are not completely systematic either in their derivation or in their applicability; in contrast, the method discussed here (Eq. (6) below) is completely systematic, applies to a huge class of conservation and dissipative PDEs, and depends functionally only on the PDE itself, not its energy. In some cases it reduces to previously studied methods, for example, it reproduces one of Li and Vu-Quoc s schemes [8] for the nonlinear wave equation. Even in these cases, however, it sheds considerable light on the actual structure of the scheme and the origin of its conservative properties. See also the discussion comparing different constructions of energy-preserving integrators in [7]. We consider evolutionary PDEs with independent variables (x, t) R d R, functions u belonging to a Hilbert space B with values u(x, t) R m, and PDEs of the form u = D δh δu, () where D is a constant linear differential operator, the dot denotes t, and H[u] = H(x; u (n) ) dx () where Ω is a subset of R d R, and dx = dx dx... dx d. δh δu Ω is the variational Although it is generally real-valued, the function u may also be complex-valued, for example, the nonlinear Schrödinger equation.

3 ENERGY CONSERVING PDES 3 derivative of H in the sense that d dɛ H[u + ɛv] ɛ= = δh δu, v (3) for all u, v B (cf. [8]), where, is the inner product in B. For example, if d = m =, B = L (Ω), and H[u] = H(x; u, u x, u xx,... ) dx, (4) then Ω δh δu = H ( ) ( ) H H u x + x, (5) u x u xx when the boundary terms are zero. Similarly, for general d and m, we obtain δh = H δu l u l d k= x k ( H u l,k ) +..., l =,..., m. (6) We consider Hamiltonian systems of the form (), where D is a constant skew symmetric operator (cf. [8]) and H the energy (Hamiltonian). In this case, we prefer to designate the differential operator in () with S instead of D. The PDE preserves the energy because S is skew-adjoint with respect to the L inner product, i.e. usu dx =, u B. (7) Ω The system () has I : B R as an integral if İ = δi Ω δu S δh δu dx =. Integrals C with D δc δu = are called Casimirs. Besides PDEs of type () where D is skew-adjoint, we also consider PDEs of type () where D is a constant negative (semi)definite operator with respect to the L inner product, i.e. udu dx, u B. (8) Ω In this case, we prefer to designate the differential operator D with N and the function H is a Lyapunov function, since then the system (), i.e. u = N δh δu, (9) δh δu N δh has H as a Lyapunov function, i.e. Ḣ = Ω δu dx. We will refer to systems () with a skew-adjoint S and an energy H as conservative and to systems () with a negative (semi)definite operator N and a Lyapunov function H as dissipative. Note that the operator N need not be self-adjoint. (In Example, the Ginzburg Landau equation, N = x + ɛ x is not self-adjoint.)

4 ENERGY CONSERVING PDES 4 Conservative PDEs () can be semi-discretized in skew-gradient form u = S H(u), S T = S, u R k () when D = S is skew-adjoint. Here, and in the following, we will always denote the discretizations with bars. H: R k R is chosen in such a way that H x is an approximation to H. Lemma. Let H[u] = Ω H(x; u (n) )dx, () and let H x be any consistent (finite difference) approximation to H (where x := x x... x d ) with N degrees of freedom. Then in the finite-dimensional Hilbert space R N with the Euclidean inner product, the variational derivative δ (H x) is given by H. δu Proof. We denote the consistent (finite difference) discretization of H[u] = Ω H(x; u(n) ) dx by H (u) = H(u) x where u R N denotes the discrete values of u, in the multidimensional case after choosing an ordering. The variational derivative δh is then given by δu d dε H (u + εv) N (δh ) ε= = v n x () δu n= n ) = (v δh x. δu It holds for the directional derivative that d dε H (u + εv) ε= = (v H ). (3) Since Eqs () and (3) must hold for all vectors v, we have δh δu x H, and hence δh δu H. (4) It is worth noting that the above lemma also applies directly when the approximation to H is obtained by a spectral discretization, since such an approximation can be viewed as a finite difference approximation where the finite difference stencil has the same number of entries as the number of grid points on which it is defined. The operator is the standard gradient, which replaces the variational derivative because we are now working in a finite (although large) number of

5 ENERGY CONSERVING PDES 5 dimensions (cf. e.g. (6)). When dealing with (semi-)discrete systems we use the notation u j,n where the index j corresponds to increments in space and n to increments in. That is, the point u j,n is the discrete equivalent of u(a + j x, t + n t) where x [a, b] and where t is the initial. In most of the equations we present, one of the indices is held constant, in which case, for simplicity, we drop it from the notation. For example, we use u j to refer to the values of u at different points in space and at a fixed level. Theorem. Let S (resp. N ) be any consistent constant skew (resp. negativedefinite) matrix approximation to S (resp. N ). Let H x be any consistent (finite difference) approximation to H. Finally, let f(u) := S H(u) (resp. f(u) := N H(u)), (5) and let u n be the solution of the average vector field (AVF) method u n+ u n t = f(( ξ)u n + ξu n+ ) dξ, (6) applied to equation (5). Then the semidiscrete energy H is preserved exactly (resp. dissipated monotonically): H(u n+ ) = H(u n ) (resp. H(u n+ ) H(u n )). H is preserved by the flow of u = S H(u) since H = ( H ) T S H =. (7) Discretisations of this type can be given for pseudospectral, finite-element, Galerkin and finite-difference methods (cf. [4, 5]); for simplicity s sake, we will concentrate on finite-difference methods, though we include two examples of pseudospectral methods for good measure. We consider only uniform grids; see [6] for finite difference discretizations of this type on nonuniform grids, which require inner products u n, v n = u n (Mv n ) with M I. The AVF method was recently [9] shown to preserve the energy H exactly for any vector field f of the form f(u) = S H(u), where H is an arbitrary function, and S is any constant skew matrix. The AVF method is related to discrete gradient methods (cf. [3]); amongst discrete gradient methods it is distinguished by its features of linear covariance, automatic preservation of linear symmetries, reversibility with respect to linear reversing symmetries, and often by its simplicity. It is one member of the family of Galerkin methods introduced by Betsch and Steinmann [] for the case of canonical classical mechanical systems, although the dependence of the method on f alone (and not H) was not realized there. The relationship of (6) to Runge-Kutta methods was explored in [5].

6 ENERGY CONSERVING PDES 6 We remark that although (6) does not specify the method in a completely closed form (because of the integral), the same is true for implicit methods, whose description needs to be supplemented by an iterative solver in any implementation. Despite this, broadening the class of methods from explicit to implicit is essential for many differential equations and allows new properties such as A-stability and symplecticity. Similarly, a further broadening to include integrals of the vector field allows the new properties of energy conservation and dissipation. In many cases for all linear, polynomial, or scalar terms in f, which includes all the examples in this paper the integral can be evaluated exactly in closed form. In other cases, it can be approximated by quadrature to any desired degree of accuracy. If D is a constant negative-definite operator, then the dissipative PDE () can be discretized in the form u = N H(u), (8) where N is a negative (semi)definite matrix and H is a discretization as above. That is, H is a Lyapunov-function for the semi-discretized system, since H = ( H ) T N H. (9) The AVF method (6) again preserves this structure, i.e. we have H(u n+ ) H(u n ), () and H is a Lyapunov function for the discrete system. Taking the scalar product of (6) with H(( ξ)u n + ξu n+ ) dξ on both sides of the equation yields i.e. t (u n+ u n ) H(( ξ)u n + ξu n+ ) dξ, () d t dξ H(( ξ)u n + ξu n+ ) dξ, () and therefore t (H(u n+) H(u n )). (3) Our purpose is to show that the procedure described above, namely. Discretize the energy functional H using any (consistent) approximation H x. Discretize D by a constant skew-symmetric (resp. negative (semi)definite) matrix 3. Apply the AVF method

7 ENERGY CONSERVING PDES 7 can be generally applied and leads, in a systematic way, to energy-preserving methods for conservative PDEs and energy-dissipating methods for dissipative PDEs. We shall demonstrate the procedure by going through several well-known nonlinear and linear PDEs step by step. In particular we give examples of how to discretize nonlinear conservative PDEs (in subsection.), linear conservative PDEs (in subsection.), nonlinear dissipative PDEs (in subsection 3.), and linear dissipative PDEs (in subsection 3.). Energy dissipation has been much less studied than energy conservation. Stuart and Humphries [33] consider conditions for certain linear methods (such as backward Euler) to be dissipative for gradient systems ẋ = F (x), F (x), lim x F (x) =. This class is however far more restrictive than the dissipative systems (9); the restriction from N negative (semi)definite and not necessarily self-adjoint to N = id alone is substantial [3]. In particular, backward Euler is not dissipative for systems of the form (9) (see Example below). The method (6) is formally second order in. The relationship between accuracy in space and is a complicated one that we cannot explore here. Depending on the PDE and the scientific goals the accuracy in may need to be much less, the same, or much greater than that in space. The temporal order can be increased if necessary by composition [] or by including derivatives of the right hand side [9]. Steps and yield semidiscretizations that are Hamiltonian (or Poisson) in the conservative case and dissipative in the dissipative case. Thus they could be followed by a symplectic integrator, so this procedure unifies symplectic and energy-conserving integration of conservative PDEs and allows for systematic comparisons between the two. Other approaches to energy-conserving integration, e.g. [9,, ], conflate and space discretization and obscure the fundamental role played by the semidiscrete energy and its Euclidean gradient. The choice of a symplectic versus an energy-preserving integrator is an interesting and delicate question that depends on the PDE and the scientific goals. Some factors favour energy conservation:. When the (semidiscretized) energy level sets are compact, conserving energy may (via energy stability) improve performance at large steps; Simo and Gonzalez [3] show that the unresolved high frequencies are controlled by exact energy conservation, whereas they can lead to instability in the symplectic midpoint rule. (See also their comparisons in the context of relative equilibria [] and in nonlinear elastodynamics [3].). If a nonconservative scheme is used for a system of conservation laws and large (e.g.) mass errors result, this is not taken to be a sign that the spatial mesh size should be reduced, or that mass should be globally rescaled back to its original value; rather, it is taken to be a sign that a conservative scheme should have been used. Unitarity in Schrödinger equations and orthogonality in spin chains followed a similar course: their preservation was first discovered to be important; then enforced by projection; eventually, intrinsically-conserving schemes were discovered that are now

8 ENERGY CONSERVING PDES 8 widely used. 3. In fully chaotic dynamics, symplecticity may be irrelevant. It is not used in statistical mechanics (only energy and volume preservation are required). If the flow on an energy level set is Anosov, then it is structurally stable, even to non-hamiltonian perturbations. 4. It is easier to adapt the step in energy-preserving than in symplectic integration. 5. It leads to different constraints on the eigenvalues and bifurcations of orbits than symplecticity; for example, energy preservation leads to periodic orbits occurring in -parameter families (parameterized by the energy), whereas symplecticity does not. Some factors favour symplecticity:. Unlike energy, symplecticity is the defining property of Hamiltonian mechanics. It ensures preservation of many phase space features such as genericity of quasiperiodic orbits.. It can be essential to capture qualitatively correct long- limit sets and long- statistics. 3. In n dimensions, symplecticity provides n(n ) constraints, energy only one. 4. It gives the user a very convenient check on the simulation, namely, the energy error. However, the security this provides may be illusory as neither conservation of energy nor small energy errors in a nonconservative scheme ensure that the simulation is reliable.. Conservative PDEs.. Nonlinear conservative PDEs Example. Sine Gordon equation: Continuous: ϕ t The Sine Gordon equation is of type () with where u := ( ϕ π H = ) and [ π + S = = ϕ α sin ϕ. (4) x ( ) ϕ + α ( cos ϕ)] dx, (5) x ( (Note that it follows that π = ϕ t.) Boundary conditions: periodic, u(, t) = u(, t). ). (6)

9 ENERGY CONSERVING PDES 9 Semi-discrete: finite differences 3 H fd = j [ ] π j + ( x) (ϕ j+ ϕ j ) + α ( cos ϕ j ). (7) S = ( id id ). (8) The resulting system of ordinary differential equations is [ ] [ ] ϕ π = S H π fd =, (9) x Lϕ α sin ϕ where L is the circulant matrix. L = We have used the bold variables ϕ and π for the finite dimensional vectors [ϕ, ϕ,..., ϕ N ], et cetera, which replace the functions π and ϕ in the (semi-) discrete case. Where necessary, we will write ϕ n, et cetera to denote the vector ϕ at t + n t. The integral in the AVF method can be calculated exactly to give 4 t [ ϕn+ ϕ n [ ] = (3) π n+ π n ] (π n+ + π n )/. L(ϕ n+ + ϕ n )/ α(cos ϕ n+ cos ϕ n )/(ϕ n+ ϕ n ) Semi-discrete: spectral discretization Instead of using finite differences for the discretization of the spatial derivative in (5), one may use a spectral discretization. This can be thought of as replacing ϕ with its Fourier series, truncated after N terms, where N is the number of spatial intervals, and differentiating the Fourier series. This can be calculated, using the discrete Fourier transform 5 (DFT), as F N D NF N ϕ where F N is the matrix of DFT coefficients with entries given by [F N ] n,k = ω nk N, 3 Summations of the form j mean N j= unless stated otherwise. 4 For numerical computations, care must be taken to avoid problems when the difference ϕ n+ ϕ n in the denominator of (3) becomes small. We used the sum-to-product identity cos a cos b = sin((a+b)/) sin((a b)/) to give a more numerically amenable expression. In Eq. (3), elementwise division of vectors is used. 5 In practice, one uses the fast Fourier transform algorithm to calculate the DFTs in O(N log N) operations.

10 ENERGY CONSERVING PDES ω N = e iπ/n Additionally, [F N ] n,k = N ω nk N and D N is a diagonal matrix whose (non-zero) entries are the scaled wave-numbers 6 diag(d N ) = πi l [,,,..., N, N ],...,,, (for N odd), where l = b a is the extent of the spatial domain; that is l/n = x. (For more details on properties of the DFT and its application to spectral methods see [3] and [34].) H sp = [ π j + [ F N D N F N ϕ ] ] j + α( cos ϕ j), (3) j S = ( id id The resulting system of ODEs is then given by [ ϕ π ] [ = S H sp = (F N ). (3) π D N F N ) (F D NF N ϕ) α sin ϕ Again, the integral in the AVF method can be calculated exactly to give N ]. (33) ϕ n+ ϕ n t π n+ π n t = (π n+ + π n )/, (34) = (F N D NF N ) (F N D NF N )(ϕ n+ + ϕ n )/ α(cos ϕ n+ cos ϕ n )/(ϕ n+ ϕ n ). (35) Initial conditions and numerical data for both discretizations: Spatial domain, number N of spatial intervals, and -step size t used were 7 x [, ], N =, t =., parameter: α =. Initial conditions: ϕ(x, ) =, π(x, ) = 8 cosh(x). Right-moving kink and left-moving anti-kink solution. (36) 6 Care must be taken with the ordering of the wave numbers since different computer packages use different effective orderings of the DFT/IDFT matrices in their algorithms. Additionally, one must ensure that all modes of the Fourier spectrum are treated symmetrically for N even, this requires replacing the k = N entry with zero to give [,..., N,, N +,..., ]. 7 Here and below, if x [a, b], then x = b a N, and x j = a + j x, j =,,..., N.

11 ENERGY CONSERVING PDES x SG eqn, Nspace=, t =. 3 SG eqn, Nspace=, t =. Energy Error 3 avf Midpoint Global Error 3 avf Midpoint Figure : Sine-Gordon equation with finite differences semi-discretization: Energy error (left) and global error (right) vs, for AVF and implicit midpoint integrators. 4 x SG eqn, Nspace=, t =. 4 SG eqn, Nspace=, t =. avf Midpoint 3 Energy Error Global Error 4 avf Midpoint Figure : Sine-Gordon equation with spectral semi-discretization: Energy error (left) and global error (right) vs, for AVF and implicit midpoint integrators. Numerical comparisons of the AVF method with the well known (symplectic) implicit midpoint integrator 8 are given in figure for the finite differences discretization, and in figure for the spectral discretization. Example. Korteweg de Vries equation: Continuous: u t = 6u u x 3 u x 3, (37) [ ] H = (u x) u 3 dx, (38) 8 Recall that the implicit midpoint integrator is given by u n+ u n t = f ( ) un+un+.

12 ENERGY CONSERVING PDES S = x. (39) Boundary conditions: periodic, u(, t) = u(, t). Semi-discrete: H = [ ] ( x) (u j+ u j ) u 3 j, (4) j S = x Initial conditions and numerical data: x [, ], N = 4, t =... (4) Initial condition: u(x, ) = 6 sech (x) (for two solitons). Numerical comparisons of the AVF and the midpoint rule are give in Figure 3. The global errors are comparable. The AVF is particularly easy to implement here because the integral (6) is evaluated exactly by Simpson s rule. Example 3. Nonlinear Schrödinger equation: Continuous: ( ) ( u i t u = i ) ( δh δu δh δu ), (4) where u denotes the complex conjugate of u. [ ] H = u x + γ u 4 dx, (43) ( ) i S =. i (44) Boundary conditions: periodic, u(, t) = u(, t). Semi-discrete: H = [ ( x) u j+ u j + γ ] u j 4, (45) j ( id S = i id Initial conditions and numerical data: ). (46)

13 ENERGY CONSERVING PDES 3 x 3 KdV equation, Nspace= 4, Δt =. avf Midpoint Energy Error KdV equation, Nspace= 4, Δt =..6 Global Error avf Midpoint Figure 3: Korteweg de Vries equation: Energy error (left) and global error (right) vs, for AVF and implicit midpoint integrators.

14 ENERGY CONSERVING PDES 4 6 x 6 NLS equation, Nspace=, Δt =.5 4 Energy Error avf Midpoint NLS equation, Nspace=, Δt =.5 avf Midpoint Global Error Figure 4: Nonlinear Schrödinger equation: Energy and global error vs, for AVF and implicit midpoint integrators.

15 ENERGY CONSERVING PDES 5 4 x 6 NLS equation, Nspace=, Δt =.5 Probability Error avf Midpt Figure 5: Nonlinear Schrödinger equation: Total probability error vs, for AVF and implicit midpoint integrators. x [, ], N =, t =.5, parameter: γ =. Initial conditions: { Ru(x, ) = exp ( (x ) / ), Iu(x, ) = exp ( x / ). (47) Numerical comparisons of the AVF and the midpoint rule are give in Figures 4, 5. The global errors are comparable. As for the KdV equation, the integral (6) is evaluated exactly by Simpson s rule. The AVF method does not conserve the total probalility because it is not unitary. Example 4. Nonlinear Wave Equation: Continuous: The D wave equation ϕ t V (ϕ) = ϕ, ϕ = ϕ(x, y, t), (x, y) [, ] [, ], t, (48) ϕ is a Hamiltonian PDE with Hamiltonian function [ ] H = (π + ϕ x + ϕ y) + V (ϕ) dx dy, (49) where π = / tϕ and the operator S is the canonical symplectic matrix. Boundary conditions: periodic.

16 ENERGY CONSERVING PDES 6 Semi-discrete: spectral elements We discretize the Hamiltonian in space with a tensor product Lagrange quadrature formula based on p + Gauss-Lobatto-Legendre (GLL) quadrature nodes in each space direction. We obtain ( H = p p p ) ( p ) w j w j π j,j + d j,kϕ k,j + d j,mϕ j,m + ϕ4 j,j, j = j = where d j,k = dl k(x) dx k= m= (5), and l k (x) is the k-th Lagrange basis function based x=xj on the GLL quadrature nodes x,..., x p, and with w,..., w p the corresponding quadrature weights. The numerical approximation is ϕ p (x, y, t) = p k= m= p ϕ k,m (t)l k (x)l m (y), (5) and has the property ϕ p (x j, y j, t) = ϕ j,j (t), so that the data can be stored in the (p + ) (p + ) matrix with entries ϕ j,j. Initial conditions and numerical data: (x, y) [, ], V (ϕ) = ϕ4 4. Initial condition: ϕ(x, y, ) = sech(x)sech(y), π(x, y, ) =. In figure 6 we show some snapshots of the solution. shown in figure 7... Linear conservative PDEs Example 5. (Linear) Time-dependent Schrödinger Equation: Continuous: The energy error is u t = u i iv (x)u. (5) x This equation is bi-hamiltonian, i.e. it has independent symplectic structures. The first Hamiltonian formulation has [ π ] H = u x V (x) u dx (53) and π S = ( i i The second Hamiltonian formulation has H = π π ). (54) u dx (55)

17 ENERGY CONSERVING PDES 7 T = T = 3.5 x 3 x T = T = x 3 x Figure 6: Snapshots of the solution of the D wave equation at different s. AVF method with step-size t =.65. Space discretization with 6 Gauss Lobatto nodes in each space direction. Numerical solution interpolated on a equidistant grid of nodes in each space direction..5 x D Wave equation avf and ode5s.5 Energy error Figure 7: The D wave equation (48). MATLAB routine ode5s with absolute and relative tolerance 4 (dashed line), and AVF method with step size t = /( 5 ) (solid line). Energy error versus. Time interval [, ]. Space discretization with 6 Gauss Lobatto nodes in each space direction.

18 ENERGY CONSERVING PDES 8 and ( S = x V (x) x + V (x) ). (56) Boundary conditions: periodic, u( π, t) = u(π, t). Semi-discrete: H = [ ] ( x) u j+ u j V (x j ) u j, (57) j ( ) id S = i. (58) id The second semi-discretization is H = j u j, (59) where ( A S = i A ), (6) V... V A = (6) V Both discretizations result in the same semi-discrete system and the AVF method (which in the linear case coincides with the midpoint rule) therefore preserves both H and H, as well as the two symplectic structures. Initial conditions and numerical data: x [ π, π], N = 5, t =., V (x) = cos(x). Initial conditions: Ru(x, ) = e ( x ), Iu(x, ) =. (6) Example 6. Maxwell s Equations (d): We first look at the one-dimensional Maxwell equation Continuous: [ ] [ ] [ ] E c δh = x δe t B c, (63) δh x δb H(E, B) = c ( E + B ) dx, (64)

19 ENERGY CONSERVING PDES 9 5 x 5 Energy error Figure 8: Linear Schrödinger equation: Error in energy H x vs, AVF method and S = [ x x ]. (65) S is skew-adjoint on {(E, B) C : E() = E() = } (and therefore on the Sobolev space H ). Boundary conditions: { E(, t) = E(, t) =, B B x (, t) = x (, t) =. (66) Semi-discrete: We now obtain H by discretizing H in a simple way by applying the trapezoidal rule to the integral (64) at the points x j = N j and dividing by x, that is H(E, E N, B,, B N ) = N j= ( c ) E j + c 4 B + N j= where we have already used that E(x, t) = E(x N, t) =. operator S is discretized with central differences yielding [ N,N G S = G T N+,N+ ( c ) B j + c 4 B N, (67) The differential ], (68)

20 ENERGY CONSERVING PDES 6 x 7 4 Energy Error Figure 9: One-dimensional Maxwell equation: energy error vs, AVF integrator. where the (N ) (N + ) matrix G is given by G = x. (69) Initial conditions and numerical data: Note that the Neumann boundary conditions are satisfied at least to order in space, despite the fact that we only intended to somehow approximate the energy H. The numerical experiments confirm that the discrete energy H x is preserved to machine precision. Figure 9 shows the error of the AVF method for the Maxwell equation with N =, t =., c =, and initial value E(x, ) = e (x ), B(x, ) = e (x ). Example 7. Maxwell s Equations (3D): Continuous: We consider Maxwell s equations in CGS units for the electromagnetic field in a vacuum [ ] [ ] [ ] B c B = (7) t E c E

21 ENERGY CONSERVING PDES with the operator := z y z x y x. (7) This equation has two Hamiltonian formulations of type (). The first Hamiltonian formulation has the helicity Hamiltonian ( H = c BT ( B) + c ) ET ( E) dxdydz (7) Q (cf. []) and the operator S = [ I3 I 3 ], (73) where I 3 designates the 3 3 unit matrix. The second Hamiltonian formulation has the Hamiltonian ( H = c BT B + c ) ET E dxdydz (74) Q (cf. [4]) and the operator S = [ ]. (75) Boundary condition: periodic on the unit cube Q. Semi-discrete: On a regular grid with lexicographical ordering in every component of E (resp. B) and concatenating the discretized components gives one discrete vector E h (resp. B h ), the operator is represented by a matrix A. The discretization in the first case is given by H = c ET h AE h + c BT h AB h (76) and the obvious discretization of S. For the quadratic Hamiltonian, and H = c ET h E h + c BT h B h (77) S = [ A A Both discretizations result in the same semi-discrete system [ ] [ ] [ ] Ḃh A Bh = A Ėh ]. (78) E h (79)

22 ENERGY CONSERVING PDES.5.5 Energies Figure : Three-dimensional Maxwell equation: plots of energies H x (dash-dot) and H x (dash) vs. and the average vector field method preserves both H and H. Initial conditions and numerical data: Preservation of H and H is numerically confirmed by an experiment with random initial data on a regular grid with 3 points in every direction and constant c =. The result of the AVF method with t =. can be seen in figure. 3. Dissipative PDEs 3.. Nonlinear dissipative PDEs Example 8. Allen Cahn equation: Continuous: u t = du xx + u u 3, d, (8) [ H = d (u x) u + ] 4 u4 dx, (8) N =. (8) Boundary conditions: Neumann, u x (, t) =, u x (, t) =. Semi-discrete: H = N [ j= d ( x) (u j+ u j ) u j + 4 u4 j ], (83)

23 ENERGY CONSERVING PDES 3 Initial conditions and numerical data: N = id. (84) x [, ], N =, t =., parameter: d =.. Initial condition: u(x, ) = cos(πx). Example 9. Cahn Hilliard equation: Continuous: u t = ( pu + ru 3 ) x + qu xx, (85) [ H = pu + 4 ru4 ] q (u x) dx, (86) N = ( x) N = x. (87) Boundary condition: periodic, u(, t) = u(, t). Semi-discrete: H = [ pu j + 4 ru4 j ] q ( x) (u j+ u j ), (88) j (89) Initial conditions and numerical data: x [, ], N = 5, t = /, parameters: p =, q =., r =. Initial condition: u(x, ) =. sin(πx) +. cos(4πx) +.6 sin(4πx) +. cos(πx). Example. Ginzburg Landau equation: Continuous: A Ginzburg Landau equation arising in a model of traffic flow is given by u t = ( x + ɛ x ) [ 6u + x u u 3], ɛ, (9) and is a slight modification of the model considered in [6] and [7]. The equation can be written as u t = N δh δu, (9)

24 ENERGY CONSERVING PDES 4 7 AC equation, Nspace=, Δt =. avf 8 Global Error AC equation, Nspace=, Δt =. avf.7.8 Energy Figure : Allen Cahn equation: Global error (left) and energy (right) vs, AVF integrator.

25 ENERGY CONSERVING PDES 5 6 CH equation, Nspace= 5, Δt = avf Global Error CH equation, Nspace= 5, Δt = avf..4 Energy Figure : Cahn Hilliard equation: Global error (left) and energy (right) vs, AVF integrator.

26 ENERGY CONSERVING PDES 6 with and H = [ 3u N = x + ɛ x (9) ( ) ] u x 4 u4 dx. (93) Note that N is not self-adjoint. Boundary condition: u(±5, t) = and u xx (±5, t) =. Semi-discrete: and where H = N j= [ 3u j A = x is a discretization of x, and B = ( x) ( uj+ u j x ) ] 4 u4 j, u N =. (94) N = A + ɛb, (95) (96) (97) is a discretization of x. The average vector field method preserves the decay of function H in contrast to some standard integrators. Initial conditions and numerical data: x [ 5, 5], N = 5, t =., parameter: ɛ =.. Initial condition: u(x, ) = e (x ). In figure 3, we compare the AVF method with the backward Euler method. For the latter, H appears to be monotonic increasing instead of monotonic decreasing. This quickly leads to a qualitatively incorrect solution. Since backward Euler is one of the most famous dissipative methods for N = id, this clearly shows that the AVF method is not a trivial extension.

27 ENERGY CONSERVING PDES 7 Lyapunov function Lyapunov function Figure 3: Ginzburg Landau equation: Plots of the energy function H x computed with the AVF method (left) and backward Euler (right). Note that Backward Euler exhibits an increase in the energy instead of the correct decrease. 3.. Linear dissipative PDEs Example. Heat equation: Continuous: The heat equation u t = u xx, (98) is a dissipative PDE and can be written in the form (), i.e. u t = N δh δu, u t = N δh δu, (99) with the Lyapunov functions H (u) = u x dx and H (u) = u dx and the operators N = and N = x, respectively. Boundary conditions: u(, t) = u(, t) =. Semi-discrete: N H = u ( x) + (u j u j ) + u N () j= and as well as N = ( x) H = N j= (u j), () ()

28 ENERGY CONSERVING PDES 8 First Lyapunov function Second Lyapunov function Figure 4: Heat equation: plots of Lyapunov functions H x (left) and H x (right) vs, AVF integrator. and the obvious discretization of N. With these choices, both discretizations yield identical semi-discrete equations of motion and therefore H and H are simultaneously Lyapunov functions of the semi-discrete system and therefore, the AVF integrator preserves both Lyapunov functions. Initial conditions and numerical data: x [, ], N = 5, t =.5. (3) Initial condition: u(x, ) = x( x). This system is numerically illustrated in figure 4, where the monotonic decrease of the Lyapunov functions for the heat equation in () and () is shown. 4. Concluding Remarks The concept of energy, i.e., its preservation or dissipation, has far reaching consequences in the physical sciences. Therefore many methods to preserve energy, and several to preserve the correct dissipation of energy (e.g. [3, 3]), have been proposed for ordinary differential equations. Surprisingly, when partial differential equations are considered, a unified way to discuss the preservation or correct dissipation of energy is missing and similar ideas are often developed from scratch (e.g. [, 9]). In this paper, we have presented a systematic and unified way to discretize partial differential equations and to preserve their correct energy preservation, or dissipation, by the average vector-field method. For the equations treated in this paper, one can replace the average vectorfield method by any energy-preserving B-series method, while retaining the advantageous properties of energy preservation or dissipation. More generally, geometric integrators for Hamiltonian or non-hamiltonian PDEs with non-constant matrix D can be constructed using discrete gradient methods, cf. [3].

29 ENERGY CONSERVING PDES 9 Acknowledgements. This research is supported by the Australian Research Council and by the Marsden Fund of the Royal Society of New Zealand. We are grateful to Will Wright for many useful discussions. References [] N. Anderson and A.M. Arthurs, Helicity and variational principles for Maxwell s equations, Int. J. Electronics 54 (983), [] P. Betsch and P. Steinmann, Inherently energy conserving finite elements for classical mechanics, J. Comput. Phys. 6 (), [3] W.L. Briggs and V.E. Henson, The DFT: An Owner s Manual for the Discrete Fourier Transform, SIAM, 995. [4] E. Celledoni, D. Cohen and B. Owren, Symmetric exponential integrators for the cubic Schrödinger equation, J. FoCM 8 (8) [5] E. Celledoni, R.I. McLachlan, D.I. McLaren, B. Owren, G.R.W. Quispel, and W.M. Wright, Energy-preserving Runge-Kutta methods, Math. Model. Numer. Anal. 43 (9), [6] R. Courant, K. Friedrichs and H. Lewy, Über die partiellen Differenzengleichungen der mathematischen Physik, Math. Annal. (98), 3 74; reprinted and translated in IBM Journal of Research and Development (967), [7] M. Dahlby and B. Owren, A general framework for deriving integral-preserving numerical methods for PDEs, SIAM J. Sci. Comput. 33 (), [8] Z. Fei, V. M. Pérez-García, and L. Vásquez, Numerical simulation of nonlinear Schrödinger systems: A new conservative scheme, Appl. Math. Comput. 7 (995), [9] Z. Fei and L. Vásquez, Two energy conserving numerical schemes for the Sine- Gordon equation, Appl. Math. Comput. 45 (99), 7 3. [] R.P. Feynman. Conservation of energy. Chapter 4, Volume, The Feynman Lectures on Physics, Addison-Wesley Pub. Co., 965. ) α δg δu [] D. Furihata, Finite difference schemes for u = ( that inherit energy t x conservation or dissipation property, J. Comput. Phys. 56 (999), 8 5. [] O. Gonzalez and J. C. Simo, On the stability of symplectic and energy momentum algorithms for nonlinear Hamiltonian systems with symmetry, Comput. Meth. Appl. Mech. Eng. 34 (996), 97. [3] V. Grimm and G.R.W. Quispel Geometric integration methods that preserve Lyapunov functions, BIT 45 (5), [4] T. Hirono, W. Lui, S. Seki and Y. Yoshikuni, A three-dimensional fourth-order Finite-Difference Time-Domain scheme using a symplectic integrator propagator, IEEE Trans. Microwave Theory and Tech. 49 (),

30 ENERGY CONSERVING PDES 3 [5] A. Iserles, A First Course in the Numerical Analysis of Differential Equations, Cambridge University Press, 996. [6] A. Kitson, R. I. McLachlan, and N. Robidoux, Skew-adjoint finite difference methods on nonunform grids, New Zealand J. Math. 3 (3) [7] S. Klainerman, Partial differential equations, in The Princeton Companion to Mathematics, T. Gowers, Ed. Princeton University Press, 8, [8] S. Li and L. Vu-Quoc, Finite difference calculus invariant structure of a class of algorithms for the nonlinear Klein Gordon equation, SIAM J. Numer. Anal., 3 (995), [9] T. Matsuo. New conservative schemes with discrete variational derivatives for nonlinear wave equations, J. Comput. Appl. Math. 3 (7), [] T. Matsuo and D. Furihata, Dissipative or conservative finite-difference schemes for complex-valued nonlinear partial differential equations, J. Comput. Phys. 7 (), [] T. Matsuo and H. Yamaguchi, An energy-conserving Galerkin scheme for a class of nonlinear dispersive equations, J. Comput. Phys. 8 (9), [] R. I. McLachlan and G. R. W. Quispel, Splitting methods, Acta Numerica (), [3] R.I. McLachlan, G.R.W. Quispel, and N. Robidoux. Geometric integration using discrete gradients, Phil. Trans. Roy. Soc. A, 357 (999), 45. [4] R.I. McLachlan and N. Robidoux. Antisymmetry, pseudospectral methods, weighted residual discretizations, and energy conserving partial differential equations, Preprint,. [5] R.I. McLachlan and N. Robidoux. Antisymmetry, pseudospectral methods, and conservative PDEs, in International Conference on Differential Equations, Vol., (Berlin, 999), World Sci. Publ., River Edge, NJ,, [6] Eq(7) in: T. Nagatani. Thermodynamic theory for the jamming transition in traffic flow, Phys. Rev. E 58 (998), [7] T. Nagatani. Time-dependent Ginzburg Landau equation for the jamming transition in traffic flow, Physica A 58 (998), [8] P. Olver, Applications of Lie Groups to Differential Equations, Second Edition, Springer-Verlag, New York, 993. [9] G.R.W. Quispel and D.I. McLaren. A new class of energy-preserving numerical integration methods, J. Phys. A 4 (8), 456 (7pp). [3] T. D. Ringler, J. Thuburn, J. B. Klemp, and W. C. Skamarock, A unified approach to energy conservation and potential vorticity dynamics for arbitrarily-structured C-grids, J. Comput. Phys 9 () [3] J. C. Simo and N. Tarnow, The discrete energy momentum method. Conserving algorithms for nonlinear elastodynamics, ZAMP 43 (99),

31 ENERGY CONSERVING PDES 3 [3] J. C. Simo and O. Gonzalez, Assessment of energy momentum and symplectic schemes for stiff dynamical systems, American Society of Mechanical Engineers, ASME Winter Annual Meeting, New Orleans, Louisiana, 993. [33] A. M. Stuart and A. R. Humphries, Dynamical Systems and Numerical Analysis, Cambridge University Press, Cambridge, 996. [34] L.N. Trefethen, Spectral Methods in MATLAB, SIAM,. [35] T. Yaguchi, T. Matsuo, and M. Sugihara, An extension of the discrete variational method to nonuniform grids, J. Comput. Phys. 9 (),