IMPLICIT-EXPLICIT VARIATIONAL INTEGRATION OF HIGHLY OSCILLATORY PROBLEMS ARI STERN AND EITAN GRINSPUN arxiv:88.39v3 [mat.na] Apr 9 ABSTRACT. In tis paper we derive a variational integrator for certain igly oscillatory problems in mecanics. To do tis we take a new approac to te splitting of fast and slow potential forces: rater tan splitting tese forces at te level of te differential equations or te Hamiltonian we split te two potentials wit respect to te Lagrangian action integral. By using a different quadrature rule to approximate te contribution of eac potential to te action we arrive at a geometric integrator tat is implicit in te fast force and explicit in te slow force. Tis can allow for significantly longer time steps to be taken (compared to standard explicit metods suc as Störmer/Verlet) at te cost of only a linear solve rater tan a full nonlinear solve. We also analyze te stability of tis metod in particular proving tat it eliminates te linear resonance instabilities tat can arise wit explicit multiple-time-stepping metods. Next we perform some numerical experiments studying te beavior of tis integrator for two test problems: a system of coupled linear oscillators for wic we compare against te resonance beavior of te r-respa metod; and slow energy excange in te Fermi Pasta Ulam problem wic couples fast linear oscillators wit slow nonlinear oscillators. Finally we prove tat tis integrator accurately preserves te slow energy excange between te fast oscillatory components wic explains te numerical beavior observed for te Fermi Pasta Ulam problem.. INTRODUCTION.. Problem Background. Many systems in Lagrangian mecanics ave components acting on different time scales posing a callenge for traditional numerical integrators. Examples include: () Elasticity: Several spatial elements of varying stiffness resulting from irregular meses and/or inomogeneous materials (Lew et al. 3). () Planetary Dynamics: N -body problem wit nonlinear gravitational forces arising from pairwise inverse-square potentials. Multiple time scales result from te different distances between te bodies (Farr and Bertscinger 7). (3) Higly Oscillatory Problems: Potential energy can be split into a fast linear oscillatory component and a slow nonlinear component. Tese problems are widely encountered in modeling molecular dynamics (Leimkuler et al. 996) but ave also been used to model oter diverse applications for example in computer animation (Eberardt et al. ; Boxerman and Ascer 4). Matematics Subject Classification. 65P 7K7. First autor s researc partially supported by a Gordon and Betty Moore Foundation fellowsip at Caltec and by NSF grant CCF-58. Second autor s researc partially supported by te NSF (MSPA Award No. IIS-5-84 CSR Award No. CNS-6-477 CAREER Award No. CCF-6-4368).
A. STERN AND E. GRINSPUN Because tese systems eac satisfy a Lagrangian variational principle tey lend temselves readily to variational integrators: a class of geometric numerical integrators designed for simulating Lagrangian mecanical systems. By construction variational integrators preserve a discrete version of tis Lagrangian variational structure; consequently tey are automatically symplectic and momentum-conserving wit good long-time energy beavior (Marsden and West ). Explicit Metods Multiple Time Stepping and Resonance Instability. Te Störmer/Verlet (or leapfrog) metod is one of te canonical examples of a geometric (and variational) numerical integrator (see Hairer et al. 3). Yet it and oter simple explicit time stepping metods do not perform well for problems wit multiple time scales. Te maximum stable time step for tese metods is dictated by te stiffest mode of te underlying system; terefore te fastest force dictates te number of evaluations tat must be taken for all forces despite te fact tat te slow-scale forces may be (and often are) muc more expensive to evaluate. To reduce te number of costly function evaluations associated to te slow force several explicit variational integrators use multiple time stepping wereby different time step sizes are used to advance te fast and slow degrees of freedom. Tese include substepping metods suc as Verlet-I/r-RESPA and mollified impulse were for eac slow time step an integer number of fast substeps are taken (Izaguirre et al. ). More recently asyncronous variational integrators (AVIs) ave been developed removing te restriction for fast and slow time steps to be integer (or even rational) multiples of one anoter (Lew et al. 3). Multiple-time-stepping metods can be more efficient tan single-time-stepping explicit metods like Störmer/Verlet since one can fully resolve te fast oscillations wile taking many fewer evaluations of te slow forces. Tis is especially advantageous for igly oscillatory problems were te slow forces are nonlinear and ence more computationally expensive to evaluate. One drawback of multiple-time-stepping metods owever is tat tey can exibit linear resonance instability. Tis penomenon occurs wen te slow impulses are nearly syncronized in pase wit te te fast oscillations. Tese impulses artificially drive te system at a resonant frequency causing te energy (and ence te numerical error) to increase witout bound. Te problem of numerical resonance is well known for substepping metods (Biesiadecki and Skeel 993) and as also recently been sown for AVIs as well in fact te subset of fast and slow time step size pairs leading to resonance instability is dense in te space of all possible parameters (Fong et al. 7). Resonance instability can terefore be difficult to avoid particularly in igly oscillatory systems wit many degrees of freedom as in molecular dynamics applications. Implicit Metods for Single Time Stepping wit Longer Step Sizes. Because multiple-time-stepping metods ave tese resonance problems a number of single-time-stepping metods ave been developed specifically for igly oscillatory problems. As noted earlier single-time-stepping metods cannot fully resolve te fast oscillations witout serious losses in efficiency. Terefore te goal of tese metods is to take long time steps witout actually resolving te fast oscillations wile still accurately capturing te macroscopic beavior tat emerges from te coupling between fast and slow scales. Te callenge is to design metods tat allow for tese longer time steps witout destroying eiter numerical stability or geometric structure.
IMPLICIT-EXPLICIT VARIATIONAL INTEGRATION OF HIGHLY OSCILLATORY PROBLEMS 3 One obvious candidate integrator is te implicit midpoint metod wic is (linearly) unconditionally stable as well as variational (ence symplectic) and symmetric. Unfortunately te stability of te metod comes at a cost: because te integrator is implicit in te slow force wic is generally nonlinear a nonlinear system of equations must be solved at every time step. Terefore just like te fully-resolved Störmer/Verlet metod tis means tat te implicit midpoint metod requires an excessive number of function evaluations. Implicit-Explicit Integration. For igly oscillatory problems implicit-explicit (IMEX) integrators ave been proposed as a potentially attractive alternative to eiter explicit multiple-time-stepping metods or implicit single-time-stepping metods. Rater tan using separate fast and slow time step sizes IMEX metods combine implicit integration (e.g. backward Euler) for te fast force wit explicit integration (e.g. forward Euler) for te slow force. Because te fast force is linear tis semi-implicit approac requires only a linear solve for te implicit portion as opposed to te expensive nonlinear solve tat would be required for a fully implicit integrator like te implicit midpoint metod. IMEX metods were developed by Crouzeix (98) and ave continued to progress including te introduction of IMEX Runge Kutta scemes for PDEs by Ascer et al. (997). However in all of tese metods te splitting is done at te level of te Euler Lagrange differential equations rater tan at te variational level of te Lagrangian. Consequently a wide variety of IMEX scemes ave been created bot geometric and non-geometric but in general tey cannot guarantee properties suc as symplecticity momentum conservation or good long-time energy beavior wic automatically old for variational integrators. As an example of an IMEX integrator tat is not geometric in te usual sense consider te LI and LIN metods of Zang and Sclick (993) wic combine te backward Euler metod wit explicit Langevin dynamics for molecular systems. In particular to ameliorate te artificial numerical dissipation introduced by using backward Euler tese metods rely on stocastic forcing to inject te missing energy back into te system. In tis paper we develop IMEX numerical integration from a Lagrangian variational point of view. We do tis by splitting te fast and slow potentials at te level of te Lagrangian action integral rater tan wit respect to te differential equations or te Hamiltonian. From tis viewpoint implicit-explicit integration is an automatic consequence of discretizing te action integral using two distinct quadrature rules for te slow and fast potentials. Te resulting discrete Euler Lagrange equations coincide wit a semi-implicit algoritm tat was originally introduced by Zang and Skeel (997) as a ceaper alternative to te implicit midpoint metod; Ascer and Reic (999b) also studied a variant of tis metod for certain problems in molecular dynamics replacing te implicit midpoint step by te energy-conserving (but non-symplectic) Simo Gonzales metod. We also sow tat tis variational IMEX metod is free of resonance instabilities; te proof of tis fact is naturally developed at te level of te Lagrangian and does not require an examination of te associated Euler Lagrange equations. We ten compare te resonance-free beavior of variational IMEX to te multiple-time-stepping metod r-respa in a numerical simulation of coupled slow and fast oscillators. Next we evaluate te stability of te variational IMEX metod
4 A. STERN AND E. GRINSPUN for large time steps in a computation of slow energy excange in te Fermi Pasta Ulam problem. Finally we prove tat te variational IMEX metod accurately preserves tis slow energy excange beavior (as observed in te numerical experiments) by sowing tat it corresponds to a modified impulse metod.. A Brief Review of Variational Integrators. Te idea of variational integrators was studied by Suris (99) and Moser and Veselov (99) among oters and a general teory was developed over te subsequent decade (see Marsden and West for a compreensive survey). Suppose we ave a mecanical system on a configuration manifold Q specified by a Lagrangian L : TQ. Given a set of discrete time points t < < t N wit uniform step size we wis to compute a numerical approximation q n q (t n ) n =... N to te continuous trajectory q(t ). To construct a variational integrator for tis problem we define a discrete Lagrangian L : Q Q replacing tangent vectors by pairs of consecutive configuration points so tat wit respect to some interpolation metod and numerical quadrature rule we ave L qn q n+ tn+ t n L q q d t. Ten te action integral over te wole time interval is approximated by te discrete action sum N tn S [q] = L qn q n+ L q q d t. t n= If we apply Hamilton s principle to tis action sum so tat δs [q] = wen variations are taken over pats wit fixed endpoints ten tis yields te discrete Euler Lagrange equations D L qn q n+ + D L qn q n = n =... N were D and D denote partial differentiation in te first and second arguments respectively. Tis defines a two-step numerical metod on Q Q mapping q n q n qn q n+. Te equivalent one-step metod on te cotangent bundle T Q mapping q n p n qn+ p n+ is defined by te discrete Legendre transform p n = D L qn q n+ pn+ = D L qn q n+ were te first equation updates q and te second updates p. Examples. Consider a Lagrangian of te form L q q = q T M q V (q) were Q = d M is a constant d d mass matrix and V : Q is a potential. If we use linear interpolation of q wit trapezoidal quadrature to approximate te contribution of V to te action integral we get L trap qn+ q T n qn+ q n qn q n+ = M V q n + V qn+ wic we call te trapezoidal discrete Lagrangian. It is straigtforward to see tat te discrete Euler Lagrange equations for L trap correspond to te explicit Störmer/Verlet metod. Alternatively if we use midpoint quadrature to approximate te integral of te potential tis yields te
IMPLICIT-EXPLICIT VARIATIONAL INTEGRATION OF HIGHLY OSCILLATORY PROBLEMS 5 midpoint discrete Lagrangian L mid qn q n+ = qn+ q T n qn+ q n M V for wic te resulting integrator is te implicit midpoint metod. qn + q n+. A VARIATIONAL IMEX METHOD In tis section we sow ow to develop a variational integrator tat combines aspects of te Störmer/Verlet and implicit midpoint metods mentioned above. Te main idea is tat given a splitting of te potential energy into fast and slow components we define te discrete Lagrangian by applying te midpoint quadrature rule to te fast potential and te trapezoidal quadrature rule to te slow potential. Te resulting variational integrator is implicit in te fast force and explicit in te slow force. After tis we focus on te specific case of igly oscillatory problems were te fast potential is quadratic (corresponding to a linear fast force). In tis case we sow tat te IMEX integrator can be understood as Störmer/Verlet wit a modified mass matrix. It sould be noted tat te results in tis section can also be verified directly in terms of te numerical algoritm and do not strictly require making use of te Lagrangian variational structure. However we find te variational perspective to be useful and illustrative bot in arriving at tis particular IMEX algoritm and in interpreting its numerical features... Te IMEX Discrete Lagrangian and Equations of Motion. Suppose tat we ave a Lagrangian of te form L q q = q T M q U(q) W (q) were U is a slow potential and W is a fast potential for te configuration space Q = d. Ten define te IMEX discrete Lagrangian L IMEX qn+ q T n qn+ q n qn q n+ = M U q n +U qn+ qn + q n+ W using (explicit) trapezoidal approximation for te slow potential and (implicit) midpoint approximation for te fast potential. Te discrete Euler Lagrange equations give te two-step variational integrator on Q Q q n+ q n + q n = M U q n + W qn + q n + W qn + q n+ and te corresponding discrete Legendre transform is given by qn+ q n p n = M + U q n + W qn + q n+ qn+ q n p n+ = M U q n+ W qn + q n+. To see ow tis translates into an algoritm for a one-step integrator on T Q it is elpful to introduce te intermediate stages p + n = p n U q n p n+ = p n+ + U q n+.
6 A. STERN AND E. GRINSPUN Substituting tese into te previous expression and rearranging yields te algoritm Step : p + n = p n U q n Step : q n+ p n+ p = q n + M + n + p n+ = p + n W qn + q n+ Step 3: p n+ = p n+ U q n+ were Step corresponds to a step of te implicit midpoint metod. Tis can be summarized in te style of impulse metods as: () kick: explicit kick from U advances q n p n qn p + n () oscillate: implicit midpoint metod wit W advances q n p + n qn+ p n+ (3) kick: explicit kick from U advances q n+ p n+ qn+ p n+. In particular notice tat tis reduces to te Störmer/Verlet metod wen W and to te implicit midpoint metod wen U. Also if te momentum p n does not actually need to be recorded at te full time step (i.e. collocated wit te position q n ) ten Step 3 can be combined wit Step of te next iteration to create a staggered leapfrog metod. Interpretation as a Hamiltonian Splitting Metod. Tis algoritm on T Q can also be interpreted as a fast-slow splitting metod (McLaclan and Quispel ; Hairer et al. 6 II.5 and VIII.4.) for te separable Hamiltonian H = T + U + W were T is te kinetic energy as follows. Let Φ T +W : T Q T Q denote te numerical flow of te implicit midpoint metod wit time step size applied to te fast portion of te Hamiltonian T + W and let ϕ U : T Q T Q be te exact Hamiltonian flow for te slow potential U (i.e. constant acceleration witout displacement). Ten te variational IMEX metod as te flow map Ψ : T Q T Q wic can be written as te following composition of exact and numerical flows: Ψ = ϕ U +W / ΦT ϕ U /. Tis formulation igligts te fact tat variational IMEX is symmetric (since it is a symmetric composition of symmetric metods) as well as symplectic (since it can be written as a composition of symplectic maps)... Application to Higly Oscillatory Problems. For igly oscillatory problems on Q = d we start by taking a quadratic fast potential W (q) = q T Ω q Ω d d symmetric and positive semidefinite. A prototypical Ω is given by te block-diagonal matrix Ω = ωi were some of te degrees of freedom are subjected to an oscillatory force wit constant fast frequency ω. We also denote te slow force g (q) = U(q) and assume witout loss of generality tat te constant mass
IMPLICIT-EXPLICIT VARIATIONAL INTEGRATION OF HIGHLY OSCILLATORY PROBLEMS 7 matrix is given by M = I. Terefore te nonlinear system we wis to approximate numerically is q + Ω q = g (q). Tis is te conventional setup for igly oscillatory problems used by Hairer et al. (6 XIII) and oters. Applying te IMEX metod to tis example we get te discrete Lagrangian L IMEX qn+ q T n qn+ q n qn q n+ = U q n +U qn+ qn + q T n+ Ω qn + q n+ and so te two-step IMEX sceme is given by te discrete Euler Lagrange equations q n+ q n + q n + 4 Ω q n+ + q n + q n = g q n. Combining terms we can rewrite tis as I + qn+ 4 Ω q n + q n + Ω q n = g q n wic is equivalent to Störmer/Verlet wit a modified mass matrix I + (Ω/). Tis equivalence can similarly be sown to old for te one-step formulation of te IMEX sceme on T Q tat is te two metods also produce te same p n as well as te same q n. In fact tis correspondence between IMEX and a modified Störmer/Verlet metod is true not just in te discrete Euler Lagrange equations but in te discrete Lagrangian itself. Tis follows immediately from te following proposition. Proposition.. Suppose we ave a Lagrangian L q q = q T M q q T Ω q and its corresponding midpoint discrete Lagrangian L mid. Next define te modified Lagrangian L q q = q T M q q T Ω q aving te same quadratic potential but a different mass matrix M and take its trapezoidal discrete Lagrangian L trap. Ten L mid L trap wen M = M + (Ω/). Proof. Te midpoint discrete Lagrangian is given by L mid qn+ q T n qn+ q n qn q n+ = M Now notice tat we can rearrange te terms qn + q T n+ Ω qn + q n+ qn+ q T n = Ω qn+ q n qn+ q T n Ω qn+ q n = qn + q T n+ Ω qn + q n+. q T n Ω q n q T n+ Ω q n+ q T n Ω q n q T n+ Ω q n+. Terefore te discrete Lagrangian can be written in te trapezoidal form L mid qn+ q T n Ω qn+ q n qn q n+ = M + q T n Ω q n + q T n+ Ω q n+ wic is precisely L trap qn q n+ wen M = M + (Ω/).
8 A. STERN AND E. GRINSPUN Corollary.. Consider a igly oscillatory system wit an arbitrary slow potential U quadratic fast potential W (q) = q T Ω q and constant mass matrix M = I so tat te Lagrangian L and IMEX discrete Lagrangian L IMEX te same potentials but different mass matrix M. Ten L IMEX are defined as above. Next take te modified Lagrangian L wit L trap wen M = I + (Ω/)..3. Analysis of Linear Resonance Stability. To study te linear resonance stability of tis IMEX integrator we consider a model problem were U and W bot correspond to linear oscillators. Let U(q) = q T q and W (q) = q T Ω q were Ω = ωi for some ω and again let te mass matrix M = I. Altoug tis is someting of a toy problem obviously one could simply combine U and W into a single quadratic potential + ω q T q it is illustrative for studying te numerical resonance of multiple-time-stepping metods since te system as no external forcing terms and ence no real pysical resonance. To prove tat te IMEX metod does not exibit linear resonance instability we sow tat te stability condition only requires tat te time step be stable for te explicit slow force and is independent of te fast frequency ω. Te idea of te proof is to use te results from Section. sowing tat te IMEX metod is equivalent to Störmer/Verlet wit a modified mass matrix and ten to apply te well-known stability criteria for Störmer/Verlet. In particular for a armonic oscillator wit unit mass and frequency ν te Störmer/Verlet metod is linearly stable if and only if ν as can be sown by a straigtforward calculation of te eigenvalues of te propagation matrix (Hairer et al. 6 p. 3). For a system wit constant mass m and spring constant ν tis condition generalizes to ν 4m. Teorem.3. Te IMEX metod is linearly stable for te system described above if and only if (i.e. if and only if is a stable time step size for te slow oscillator alone). Proof. As proved in te previous section te IMEX metod for tis system is equivalent to Störmer/Verlet wit te modified mass matrix I + (Ω/). Now tis modified oscillatory system as constant mass m = + (ω/) and spring constant ν = + ω. Terefore te necessary and sufficient condition for linear stability is + ω 4 + 4 ω and since te ω terms cancel on bot sides tis is equivalent to 4 or. Tis sows tat in contrast to multiple-time-stepping metods te IMEX metod does not exibit linear resonance instability. In particular one can interpret te modified mass matrix as giving te system an effective frequency of + ω + (ω/) wic attenuates te destabilizing ig frequencies in te original system. It sould be noted tat nonlinear instability is known to be possible for te implicit midpoint metod altoug even tat can be avoided wit a time step size restriction tat is considerably weaker tan tat required for explicit metods (see Ascer and Reic 999a).
IMPLICIT-EXPLICIT VARIATIONAL INTEGRATION OF HIGHLY OSCILLATORY PROBLEMS 9 r!respa Variational IMEX Maximum absolute energy error!!!3!4.5.5.5 3 3.5 4 4.5! /" Figure : Maximum energy error of r-respa and variational IMEX integrated over te time interval [ ] for a range of parameters ω. Te r-respa metod exibits resonance instability near integer values of ω/π wile te variational IMEX metod remains stable. 3. NUMERICAL EXPERIMENTS 3.. Coupled Linear Oscillators. To illustrate te numerical resonance beavior of te variational IMEX sceme as compared wit a multiple-time-stepping metod we consider te model problem from Section.3 for dimension d = (i.e. Q = ). Figure sows a log plot of te maximum absolute error in total energy (i.e. te Hamiltonian) for bot r-respa and te variational IMEX metod for a range of frequencies ω. MATLAB simulations were performed over te time interval [] wit fixed time step size =. and wit te normalized frequency ω/π ranging over ( 4.5]. Additionally to fully resolve te fast oscillations r-respa took fast substeps of size / =. for eac full time step of size. Te r-respa metod exibits spikes in te total energy error near integer values of ω/π corresponding to te parameters were resonance instability develops and te numerical solution becomes unbounded. (Te finite size of tese spikes is due to te fact tat te numerical simulation was run only for a finite interval of time. Interestingly one also sees negative spikes were te fast and slow oscillations are exactly out-of-pase and cancel one anoter.) It sould be noted tat te small substep size of r-respa is sufficient for stable integration of te fast force alone; it is only te introduction of te slow force tat makes tings unstable. By contrast te maximum energy error for te variational IMEX metod is nearly constant for all values of ω sowing no sign of resonance. Tis is fully consistent wit te teoretical result obtained in Teorem.3. 3.. Te Fermi Pasta Ulam Problem. As an example of a nontrivial igly oscillatory problem wit nonlinear slow potential we cose te modified Fermi Pasta Ulam (FPU) problem considered by Hairer et al. (6 I.5 and XIII) wose treatment we will now briefly review. Te FPU
A. STERN AND E. GRINSPUN problem consists of l unit point masses wic are cained togeter in series by alternating weak nonlinear springs and stiff linear springs. (Tis particular setup is due to Galgani et al. 99 and is a variant of te problem originally introduced by Fermi et al. 955.) Clearly tis system becomes rater trivial if we make te stiff springs infinitely stiff replacing tem by rigid constraints (as done by some numerical metods suc as SHAKE/RATTLE). However for finite stiffness te FPU system exibits interesting dynamics due to te coupling between fast and slow springs. Let us denote te displacements of te point masses by q... q l (were te endpoints q = q l+ = are taken to be fixed) and teir conjugate momenta by p i = q i for i =... l. In tese variables te FPU system as te Hamiltonian H q p = l i = p i + p ω i + 4 l l 4 qi q i + qi + q i i = wic contains a quadratic potential for te l stiff linear springs eac wit frequency ω and a quartic potential for te l + soft nonlinear (cubic) springs. However it is elpful to perform te coordinate transformation (following Hairer et al. 6 p. ) i = x i = q i + q i x i = q i q i y i = p i + p i y i = p i p i so tat (modulo rescaling) x i corresponds to te location of te i t stiff spring s center x i corresponds to its lengt and y i y i are te respective conjugate momenta. Writing te Hamiltonian in tese new variables we ave H(x y ) = l y i + y ω l i + x i i = i = + l 4 4 4 x x + xi + x i + x i x i + xl + x l 4 wic considerably simplifies te form of te fast quadratic potential. i = Following te example treated numerically by Hairer et al. (6); McLaclan and O Neale (7) we consider an instance of te FPU problem integrated over te time interval [ ] wit parameters l = 3 ω = wose initial conditions are x () = y () = x () = ω y () = wit zero for all oter initial values. Tis displays an interesting and complex property of te FPU problem called slow energy excange wic results from te slow nonlinear coupling between te stiff springs. If we consider only te energies in te stiff springs written as I j xj y j = y j + ω x j j = 3 ten te initial conditions start wit all of te energy in I and none in I I 3. Over te course of te time interval tis energy is transferred in a caracteristic way from I to I 3 gradually transitioning
IMPLICIT-EXPLICIT VARIATIONAL INTEGRATION OF HIGHLY OSCILLATORY PROBLEMS I + I + I3 I I I + II + I 3 3 I I I 3 I I I + I + I 33 I3 I I I 33 I I.5 (d) IMEX wit =.3. (e) IMEX wit =...8.8.8.6.6.6.8.8.8.8.8.6.6.6.6.6 (g) IMEX wit =. (f ) IMEX wit =.5. () IMEX wit = 5. (c) Störmer/Verlet wit =.3. (b) Störmer/Verlet wit =...5.5.5.5.5.5.6.6.6.6.8.8.6.8.8.6.8.8.6.8.6.8.5.5.5.5.5.5.5.5.5 I + I + I3 I3 I I3 I (a) Reference solution: Störmer/Verlet wit time step size =.. I + I + I3 I + I + I3 (i) IMEX wit =.3. Figure : Te IMEX metod robustly captures slow energy excange in te Fermi Pasta Ulam problem wit ω = even for large time steps. Because te fast force is integrated implicitly IMEX remains stable and degrades gradually as te time step size increases unlike te fully explicit Störmer/Verlet metod wic rapidly becomes unstable. troug te middle spring I. Furtermore te total stiff energy I = I + I + I 3 remains nearly constant i.e. is an adiabatic invariant of te system. Figure sows several numerical simulations of tis FPU energy excange computed bot wit Störmer/Verlet and wit te variational IMEX metod for different coices of time step size. Te first plot is a reference solution computed using Störmer/Verlet wit =. fully resolving te fast oscillations. However we see tat te Störmer/Verlet solution s quality and stability degrade rapidly as we increase te step size (for =.3 we ave ω =.5 wic is near
A. STERN AND E. GRINSPUN 5 4.5 4 3.5 3.5.5.5 3 4 (a) IMEX wit =. 3 4 (b) IMEX wit =.3 Figure 3: Numerical simulation of te FPU problem for T = 4 wic sows te beavior of te IMEX metod on te ω scale. For =. we already ave ω = 5 yet te oscillatory beavior and adiabatic invariant are qualitatively correct. By contrast for =.3 te metod as begun to blow up; oscillatory coupling is a drawback of implicit midpoint metods for large time steps. te upper end of te stability region ω ). By contrast te variational IMEX metod performs extremely well for =.3.5 degrading gradually as te time step size increases. Even as te numerical solution begins to undergo serious degradation for =.3 te qualitative structure of te energy excange beavior between I I I 3 is still maintained. Compare Hairer et al. 6 p. 4 Figure 5.3; see also McLaclan and O Neale 7 wo examine a wide variety of geometric integrators particularly trigonometric integrators for te FPU problem wit respect to bot resonance stability and slow energy excange. In particular tese autors found tat te existing trigonometric integrators exibit a trade-off between correct energy excange beavior and resonance stability and tat tese features tend to be mutually exclusive. In Figure 3 we sow te numerical beavior of te variational IMEX metod applied to tis same FPU problem on a longer time scale (T = 4) and for large time steps ( =..3). At =. te IMEX simulation still displays te correct qualitative energy beavior wit respect to bot te slow energy excange and te adiabatic invariant I and te numerical solution remains bounded. However by =.3 numerical stability as broken down as oscillatory coupling in te fast modes leads to unbounded amplitude growt. Tis illustrates one of te drawbacks of implicit midpoint-type metods: despite te lack of linear resonances numerical instability can still result for very large time steps due to nonlinear coupling (Ascer and Reic 999ab). Tis example was cosen to demonstrate tat te variational IMEX metod does not attain its stability merely by smooting out te fast frequencies in a way tat migt destroy te structure of any fast-slow nonlinear coupling. Rater despite te fact tat it does not resolve te fast frequencies te metod is still capable of capturing te complex multiscale interactions seen in te FPU problem.
IMPLICIT-EXPLICIT VARIATIONAL INTEGRATION OF HIGHLY OSCILLATORY PROBLEMS 3 4. ANALYSIS OF SLOW ENERGY EXCHANGE IN THE IMEX METHOD In te previous section te numerical experiments for te Fermi Pasta Ulam problem seemed to suggest tat te variational IMEX metod preserves te slow energy excange between te fast oscillatory modes. Tis is somewat surprising since te metod does not actually resolve tese fast oscillations. However in tis section we will prove tat in fact tis metod does accurately reproduce te slow energy excange beavior as long as te numerical solutions remain bounded. Tis is demonstrated by sowing tat te variational IMEX metod can be understood as a modified impulse metod; tat is te midpoint step exactly resolves te oscillations of some modified differential equation. We can ten apply some of te existing teory about numerical energy excange for impulse metods. (It sould be noted tat impulse metods wic originated wit te work of Deuflard 979 can be understood as a special case of trigonometric integrators wen applied to igly oscillatory problems.) First let us rewrite te fast oscillatory system q + Ω q = as te first-order system Ω q Ω Ωq = ṗ Ω p so it follows tat te exact solution satisfies Ωq(t + ) cos(ω) sin(ω) Ωq(t ) =. p(t + ) sin(ω) cos(ω) p(t ) We will now sow tat te implicit midpoint metod effectively replaces tis rotation matrix for Ω by te rotation matrix corresponding to a modified Ω. In te transformed coordinates just introduced te implicit midpoint metod as te expression I Ω/ Ωqn+ I Ω/ Ωqn =. Ω/ I Ω/ I p n+ Terefore if we take te skew matrix Ω A = Ω it follows tat Ωqn+ p n+ = (I A/) Ωqn (I + A/). Notice tat te expression (I A/) (I + A/) = cay(a) is te Cayley transform wic maps skew matrices to special ortogonal matrices (and can be seen as an approximation to te matrix exponential map wic gives te exact solution). Hence te stability matrix is special ortogonal so we can write Ωqn+ p n+ cos Ω = sin Ω p n sin Ω cos Ω Ωqn for some modified frequency Ω. Terefore te stability matrix for te implicit midpoint metod corresponds to te exact flow matrix for a modified oscillatory system. p n p n
4 A. STERN AND E. GRINSPUN As an example suppose we ave Ω = ωi for some constant frequency ω. Applying te Cayley transform it can be seen tat te modified frequency ω satisfies Squaring bot sides tis becomes ω/ = tan( ω/). (ω/) = tan ( ω/) = cos( ω) + cos( ω) wic finally gives te solution for te modified frequency ω = (ω/) arccos + (ω/). Remark. Tis perspective provides anoter explanation as to wy te variational IMEX metod does not exibit resonance: we always ave ω < π. In fact te Cayley transform does not map to a rotation by π except in te limit as ω. Terefore for any finite and ω we will never encounter te resonance points corresponding to integer multiples of π. As an aside tis also leads to anoter possible interpretation for te onset of nonlinear instability if te time step size becomes too large (as we saw in Figure 3). Since ω < π/ te modified frequency ω must srink as grows. Informally ten if ω is very small tis can be seen as leading to amplitude growt in te fast modes since it requires less energy to induce tis amplification. Since te implicit midpoint metod as now been seen as te exact solution of a modified system we can write te variational IMEX metod as te following modified impulse sceme: Step : p + n = p n U q n Ωqn+ cos Ω sin Ω Step : = sin Ω cos Ω Ωqn p n+ Step 3: p n+ = p n+ U q n+. Suppose again tat Ω = ωi for some constant frequency ω and likewise Ω = ωi. (Tis includes te case of te FPU problem.) Te slow energy excange beavior of tis system was analyzed in detail by Hairer et al. (6 XIII see especially p. 495) using te so-called modulated Fourier expansion; we now give a brief ig-level summary of tis work. In te notation of Hairer et al. te exact solution is asymptotically expanded as x (t ) q(t ) were x (t ) = y (t ) + e i ωt z (t ) + e i ωt z (t ). p + n Note tat altoug Step migt appear to be ill-defined due to te fact tat Ω is possibly singular te singularity can be removed by substituting te relation Ω/ = tan Ω/. Te explicit equation for q n+ and p n+ is ten calculated to be qn+ cos Ω / + cos Ω = / cos Ω cos Ω qn p n+ wic is seen to recover te correct purely kinematic equation wen Ω = Ω =. p + n
IMPLICIT-EXPLICIT VARIATIONAL INTEGRATION OF HIGHLY OSCILLATORY PROBLEMS 5 Here y (t ) is a smoot real-valued function and z (t ) is a smoot complex-valued function and tese can be partitioned according to te blocks of Ω as y = y y and z = (z z ). Tey sow tat assuming te exact solution as energy bounded independent of ω tis implies z (t ) = O ω so z describes te slow-scale evolution of te system. Plugging in tis ansatz for a igly oscillatory system and eliminating te variables y and z te slow evolution turns out to be described by i ωż = g x y z + O ω 3 were ere te slow force g (q) = U(q) as also been block-decomposed as g = g g. Hairer et al. compare te above wit te numerical solution for a trigonometric integrator wic is similarly expanded as x (t ) = y (t ) + e i ωt z (t ) + e i ωt z (t ) wit y = y y and z = z z. For te unmodified Deuflard/impulse metod in particular te slow-scale numerical evolution is given by i ωż = g x y z + O ω 3 wic implies tat te equation for te impulse solution z is consistent wit tat for z. We now finally ave wat we need to prove our main result on te slow energy excange beavior of te variational IMEX metod. Teorem 4.. Let te variational IMEX metod be applied to te igly oscillatory problem above and suppose te numerical solution remains bounded. Ten te ordinary differential equation for z describing te slow energy excange in te numerical solution is consistent wit tat for z in te exact solution; tis olds up to order O ω 3. Proof. As we ave previously sown te IMEX sceme corresponds to a modified impulse metod wit frequency ω. Terefore to get te equation for z we must modify te equation above for z by replacing ω wit ω on te left and side. However notice tat Step of te modified metod advances te original state vector Ωq n p n rater tan te modified Ωq n p n. Canging from Ωqn p n to Ωq n p n also introduces a scaling factor of ω/ω on te rigt and side. Terefore te variational IMEX solution satisfies te slow-scale equation i ω z = ω ω g x ỹ z + O ω 4 ω. Finally cancelling te ω factors and multiplying by ω we once again get i ω z = g x ỹ z + O ω 3 wic is te same as tat for te coefficient z in te original unmodified impulse metod. Tis completes te proof.
6 A. STERN AND E. GRINSPUN ACKNOWLEDGMENTS Te autors would like to tank Will Fong and Adrian Lew for elpful conversations about te stability of AVI metods Houman Owadi for suggesting tat we examine te FPU problem Dion O Neale for advice regarding te FPU simulation plots Teng Zang for pointing out a bug in an earlier version of our FPU simulation code and Jerry Marsden and Reinout Quispel for teir valuable suggestions and feedback about tis work. We especially wis to acknowledge Marlis Hocbruck Arie Iserles and Cristian Lubic for suggesting tat we try to understand te variational IMEX sceme as a modified impulse metod; tis perspective led us directly to te results in Section 4. Finally tis paper benefited greatly from te tougtful critiques and suggestions of te anonymous referees wom we also wis to tank. REFERENCES Ascer U. M. and S. Reic (999a) Te midpoint sceme and variants for Hamiltonian systems: advantages and pitfalls. SIAM J. Sci. Comput. (3) 45 65 (electronic). Ascer U. M. and S. Reic (999b) On some difficulties in integrating igly oscillatory Hamiltonian systems. In Computational molecular dynamics: callenges metods ideas (Berlin 997) volume 4 of Lecture Notes in Computational Science and Engineering pages 8 96. Springer Berlin. Ascer U. M. S. J. Ruut and R. J. Spiteri (997) Implicit-explicit Runge-Kutta metods for time-dependent partial differential equations. Appl. Numer. Mat. 5 (-3) 5 67. Special issue on time integration. Biesiadecki J. J. and R. D. Skeel (993) Dangers of multiple time step metods. J. Comput. Pys. 9 () 38 38. Boxerman E. and U. Ascer (4) Decomposing clot. In SCA 4: Proceedings of te 4 ACM SIGGRAPH/Eurograpics Symposium on Computer Animation pages 53 6. Eurograpics Association Aire-la-Ville Switzerland. doi:.45/853.8543. Crouzeix M. (98) Une métode multipas implicite-explicite pour l approximation des équations d évolution paraboliques. Numer. Mat. 35 (3) 57 76. Deuflard P. (979) A study of extrapolation metods based on multistep scemes witout parasitic solutions. Z. Angew. Mat. Pys. 3 () 77 89. Eberardt B. O. Etzmuß and M. Haut () Implicit-explicit scemes for fast animation wit particle systems. In Proceedings of te t Eurograpics Worksop on Computer Animation and Simulation (EGCAS) pages 37 5. Springer Interlaken Switzerland. Farr W. M. and E. Bertscinger (7) Variational integrators for te gravitational N -body problem. Astropys. J. 663 () 4 433. arxiv:astro-p/646. Fermi E. J. Pasta and S. Ulam (955) Studies of nonlinear problems. Report LA-94. Los Alamos National Laboratory Los Alamos NM. Fong W. E. Darve and A. Lew (7) Stability of asyncronous variational integrators. In PADS 7: Proceedings of te st International Worksop on Principles of Advanced and Distributed Simulation pages 38 44. IEEE Computer Society Press Wasington DC. doi:.9/pads.7.9.
IMPLICIT-EXPLICIT VARIATIONAL INTEGRATION OF HIGHLY OSCILLATORY PROBLEMS 7 Galgani L. A. Giorgilli A. Martinoli and S. Vanzini (99) On te problem of energy equipartition for large systems of te Fermi-Pasta-Ulam type: analytical and numerical estimates. Pys. D 59 (4) 334 348. Hairer E. C. Lubic and G. Wanner (3) Geometric numerical integration illustrated by te Störmer-Verlet metod. Acta Numer. 399 4. Hairer E. C. Lubic and G. Wanner (6) Geometric numerical integration volume 3 of Springer Series in Computational Matematics. Springer-Verlag Berlin second edition. Structure-preserving algoritms for ordinary differential equations. Izaguirre J. A. Q. Ma T. Mattey J. Willcock T. Slabac B. Moore and G. Viamontes () Overcoming instabilities in Verlet-I/r-RESPA wit te mollified impulse metod. In T. Sclick and H. H. Gan editors Computational Metods for Macromolecules: Callenges and Applications Proceedings of te 3rd International Worksop on Algoritms for Macromolecular Modeling volume 4 of Lecture Notes in Computational Science and Engineering (LNCSE) pages 46 74. Springer Berlin. Leimkuler B. J. S. Reic and R. D. Skeel (996) Integration metods for molecular dynamics. In Matematical approaces to biomolecular structure and dynamics (Minneapolis MN 994) volume 8 of IMA Vol. Mat. Appl. pages 6 85. Springer New York. Lew A. J. E. Marsden M. Ortiz and M. West (3) Asyncronous variational integrators. Arc. Ration. Mec. Anal. 67 () 85 46. Marsden J. E. and M. West () Discrete mecanics and variational integrators. Acta Numer. 357 54. McLaclan R. I. and D. R. J. O Neale (7) Comparison of integrators for te Fermi-Pasta-Ulam problem. Preprint NI75-HOP. Isaac Newton Institute for Matematical Sciences Cambridge UK. Available from: ttp://www.newton.ac.uk/preprints/ni75.pdf. McLaclan R. I. and G. R. W. Quispel () Splitting metods. Acta Numer. 34 434. Moser J. and A. P. Veselov (99) Discrete versions of some classical integrable systems and factorization of matrix polynomials. Comm. Mat. Pys. 39 () 7 43. Suris Y. B. (99) Hamiltonian metods of Runge-Kutta type and teir variational interpretation. Mat. Model. (4) 78 87. Zang G. and T. Sclick (993) LIN: a new algoritm to simulate te dynamics of biomolecules by combining implicit-integration and normal mode tecniques. J. Comput. Cem. 4 () 33. doi:/jcc.544. Zang M. and R. D. Skeel (997) Ceap implicit symplectic integrators. Appl. Numer. Mat. 5 (-3) 97 3. Special issue on time integration. ARI STERN DEPARTMENT OF APPLIED AND COMPUTATIONAL MATHEMATICS CALIFORNIA INSTITUTE OF TECHNOLOGY PASADENA CALIFORNIA 95 Current address: Department of Matematics University of California San Diego La Jolla California 993- E-mail address: astern@mat.ucsd.edu EITAN GRINSPUN DEPARTMENT OF COMPUTER SCIENCE COLUMBIA UNIVERSITY NEW YORK NEW YORK 7 E-mail address: eitan@cs.columbia.edu