Application of Wavelets to N body Particle In Cell Simulations

Transcription

1 Application of Wavelets to N body Particle In Cell Simulations Balša Terzić (NIU) Northern Illinois University, Department of Physics April 7, 2006

2 Motivation Gaining insight into the dynamics of multi particle systems (galaxies, charged particle beams, plasma...) heavily relies on N body simulations It is important for N body codes to: account for multiscale dynamics minimize numerical noise due to Nsimulation<< Nphysical be as efficient as possible, without compromising accuracy for some applications: have a compact representation of system's history We present a wavelet based Poisson equation solver which, as a part of an N body code, addresses all of these requirements

3 Outline of the Talk Algorithms for N body simulations Brief introduction to wavelets Wavelet based Poisson equation solver Applications to real machines and comparison to existing codes Summary and discussion of further work

4 N body Simulations Main algorithms for N body simulations: direct summation (DS): CPU cost scales as N2 tree: DS nearby and statistical treatment farther away Particle In Cell (PIC): particles binned in cells (grid) system at t=t0 binning particle distribution N particles in box Newton's equations advance particles by t system at t=t0+ t on Nx Ny Nz grid interpolation, F for each particle F = solve the Poisson equation = on Nx Ny Nz grid

5 PIC Algorithm Any numerical simulation will have numerical noise Sources of numerical noise in PIC simulations: graininess of the distribution function: Nsimulation<< Nphysical discreteness of the computational domain: and specified on a finite grid IDEA: Solve the Poisson equation in such a way so as to minimize numerical noise USE WAVELETS

6 Wavelets What are wavelets? orthogonal basis of functions composed of scaled and translated versions of the mother wavelet (x) and the scaling function (x) f(x) =s00 00 (x) + d00 00 (x) + dik ik (x) ik(x) = 2k/2 (2kx i) = j gik 2i+jk+1 (x) ik(x) = 2k/2 (2kx i) = j hik 2i+jk+1 (x) family of perfect low and high pass filters hi and gi (enable DWT) Why wavelets? simultaneous time (space) and frequency localization (FFT only frequency) data compression: computational speed up (FBI uses it for storing fingerprints) signal denoising: natural setting in which noise can be partially removed denoised simulation simulation with more macroparticles

7 One Dimensional Wavelets (a) Haar wavelet, (b) Morlet wavelet, (c) Daubechies wavelet. Two Dimensional Daubechies least symmetric N = 10 two dimensional wavelet.

8 Wavelet Denoising and Compression Whenever the discrete signal is analytically known, one can compute Signal to Noise Ratio (SNR) which measures its quality SNR ~ Nppc ANALYTICAL Nppc: avg. # of particles per cell Nppc= 3 SNR = 2.02 Nppc = N/Ncells Nppc= 205 SNR = 16.89

9 Wavelet Denoising and Compression Whenever the discrete signal is analytically known, one can compute Signal to Noise Ratio (SNR) which measures its quality SNR ~ Nppc Nppc: avg. # of particles per cell Nppc = N/Ncells 2D superimposed Gaussians on grid ANALYTICAL Nppc= 3 SNR = 2.02 Nppc= 205 SNR = 16.89

10 Wavelet Denoising and Compression Whenever the discrete signal is analytically known, one can compute Signal to Noise Ratio (SNR) which measures its quality SNR ~ Nppc Nppc: avg. # of particles per cell Nppc = N/Ncells 2D superimposed Gaussians on grid ANALYTICAL Nppc= 3 SNR = 2.02 Nppc= 205 SNR = 16.89

11 Wavelet Denoising and Compression Whenever the discrete signal is analytically known, one can compute Signal to Noise Ratio (SNR) which measures its quality SNR ~ Nppc Nppc: avg. # of particles per cell Nppc = N/Ncells 2D superimposed Gaussians on grid ANALYTICAL Nppc= 3 SNR = 2.02 Nppc= 205 SNR = 16.89

12 Wavelet Denoising and Compression Whenever the discrete signal is analytically known, one can compute Signal to Noise Ratio (SNR) which measures its quality SNR ~ Nppc Nppc: avg. # of particles per cell Nppc = N/Ncells 2D superimposed Gaussians on grid ANALYTICAL Nppc= 3 SNR = 2.02 Nppc= 205 SNR = denoising by wavelet thresholding: if wi,j < T, set to 0 (choose T carefully!)

13 Wavelet Denoising and Compression Whenever the discrete signal is analytically known, one can compute Signal to Noise Ratio (SNR) which measures its quality SNR ~ Nppc Nppc: avg. # of particles per cell Nppc = N/Ncells 2D superimposed Gaussians on grid COMPACT: only 0.12% of coeffs WAVELET THRESHOLDING ANALYTICAL Nppc= 3 SNR = 2.02 Nppc= 205 SNR = DENOISED Nppc= 3 SNR = denoising by wavelet thresholding: if wi,j < T, set to 0 (choose T carefully!) Increase in SNR by a equivalent to running simulation with a2 more particles! Particle distribution is compactly stored in wavelet space (in the example a=8.3 equivalent to 68 times more particles; 79/65536 wav. coeffs retained)

14 Wavelet based Poisson Solver Poisson equation in physical space u=f BCs: using Green's functions Discretize Poisson equation on the Nx Ny Nz grid LU=F transform discretized Poisson equation to wavelet space WT Lw Uw = Fw ubnd = g PRECONDITIONED Conjugate Gradient (PCG) in wavelet space A X B 2 ε2 B 2 iwt solution U on the Nx Ny Nz grid wavelet threshold source Fw, operator Lw AX=B (PLwP) P 1Uw = PFw A compressed operator PLwP PRECONDITION Laplacian Lw B denoised distribution PFw with diagonal preconditioner X denoised solution P 1Uw k (Lw) ~ O(Nx2) k (PLwP) ~ O(Nx) P

15 Preconditioned Conjugate Gradient (PCG) i convergence rate depends on k u ui 2 k 1 u 2 preconditioning (diagonal in wavelet space): k ~ O(Nx2) k ~ O(Nx ) k 1 good initial approximation: solution at previous time step

16 Preconditioned Conjugate Gradient (PCG) i convergence rate depends on k u ui 2 k 1 u 2 preconditioning (diagonal in wavelet space): k ~ O(Nx2) k ~ O(Nx ) k 1 good initial approximation: solution at previous time step typical realistic beam simulation no preconditioning Ui=0 initial guess average over step run 75.2

17 Preconditioned Conjugate Gradient (PCG) i convergence rate depends on k u ui 2 k 1 u 2 preconditioning (diagonal in wavelet space): k ~ O(Nx2) k ~ O(Nx ) k 1 good initial approximation: solution at previous time step typical realistic beam simulation average over step run no preconditioning Ui=0 initial guess 75.2 preconditioned Ui=0 initial guess 60.7

18 Preconditioned Conjugate Gradient (PCG) i convergence rate depends on k u ui 2 k 1 u 2 preconditioning (diagonal in wavelet space): k ~ O(Nx2) k ~ O(Nx ) k 1 good initial approximation: solution at previous time step typical realistic beam simulation average over step run no preconditioning Ui=0 initial guess 75.2 preconditioned Ui=0 initial guess 60.7 no preconditioning Ui=Ui 1 initial guess 4.8

19 Preconditioned Conjugate Gradient (PCG) i convergence rate depends on k u ui 2 k 1 u 2 preconditioning (diagonal in wavelet space): k ~ O(Nx2) k ~ O(Nx ) k 1 good initial approximation: solution at previous time step typical realistic beam simulation average over step run no preconditioning Ui=0 initial guess 75.2 preconditioned Ui=0 initial guess 60.7 no preconditioning Ui=Ui 1 initial guess 4.8 preconditioned Ui=Ui 1 initial guess 2.4 considerable computational speedup

20 Applications Our goal: develop wavelet based Poisson solver which can easily be integrated into existing PIC codes First: test the PCG as a stand alone Poisson solver on (idealized) examples from beam dynamics (3D 'fuzzy cigar' beam charge distribution) galactic dynamics (mass density of an elliptical galaxy as idealized by the 3D Plummer sphere)

21 3D 'fuzzy cigar' on a 32x32x32 grid BCs: grounded rectangular pipe (V=0 on the sides), open in z direction (Green's function solution)

22 3D Plummer sphere on a 32x32x32 grid BCs: open in all directions (analytically specified)

23 Applications Second: insert the PCG Poisson solver into an existing PIC code (IMPACT T) IMPACT T and run realistic charged particle beam simulations compare (conventional FFT based) IMPACT T Vs. IMPACT T with PCG: rms properties level of detail computational speed

24 IMPACT T Vs. IMPACT T with PCG: rms properties Fermilab/NICADD photoinjector ( grid) 1 nc charge rms beam radius rms normalized transverse emittance rms bunch length rms normalized longitudinal emittance

25 IMPACT T Vs. IMPACT T with PCG: level of detail IMPACT T transverse charge distribution for the Fermilab/NICADD photoinjector simulation very non axisymmetric beam grid, N= very good agreement in detail IMPACT T w/ PCG initial distribution z = 1.0 m z = 2.0 m z = 4.0 m

26 IMPACT T Vs. IMPACT T with PCG: level of detail IMPACT T transverse charge distribution for the Fermilab/NICADD photoinjector simulation 5 beamlets (masked photocathode) grid, N= very good agreement in detail IMPACT T w/ PCG initial distribution z = 2.0 m z = 4.0 m z = 6.0 m

27 IMPACT T Vs. IMPACT T with PCG: computational speed IMPACT T w/ PCG ~ 10% faster than the conventional serial IMPACT T Areas of further computational optimization: implementing faster wavelet transform routines finding new ways to exploit sparseness of operators and data sets further optimizing boundary conditions computations finding a more effective preconditioner for PCG code parallelization

28 Data Compression: Clear Advantage of PCG IMPACT T w/ PCG provides excellent compression of data sets and operators in wavelet space Fermilab/NICADD photoinjector: Real Simulations particle distribution Laplacian operator grid, N=125000, Nppc=4.58 ~ 3.5% coefficients retained on average grid, N= , Nppc=4.58 ~ 1.75% coefficients retained on average compact storage of beam's distribution history needed for CSR simulations compact storage of beam's potential needed for modeling halo formation

29 Conclusions Presented an iterative wavelet based Poisson solver (PCG) wavelet compression and denoising achieves computational speedup preconditioning and sparcity of operators in wavelet space reduce CPU load integrated PCG into a PIC code (IMPACT T) for beam dynamics simulations Original contribution: first wavelet based solver for 3D Poisson equation with Dirichlet BCs first application of wavelets to 3D simulation of beams better understanding of noise in PIC simulations and its removal modeled real machines: Fermilab/NICADD photoinjector Future plans: use PCG in N body simulations of self gravitating systems (galaxies, clusters...) apply wavelet formalism to other PDEs: Fokker Planck, Maxwell's equations...

30 Auxiliary Slides

31 Computing Boundary Conditions Green's function corresponding to a grounded rectangular pipe V=0 y computational grid EIGENFUNCTIONS pipe walls sin l x V=0 V=0 sin m y EIGENVALUES l =l / a V=0 lm z = 2 lm z 2 4 ab a x b 0 0 x, y, z sin l x sin m y dx dy lm 2 lm lm z = z z N N lm x, y, z = l=1 m=1 z sin l x sin m y x y m =m /b pipe walls 2l m = l2 2m

32 Preconditioner in Wavelet Space

33 Wavelets (x) What are wavelets? 4th order Daubechies orthogonal basis of functions composed of scaled and translated versions of the mother wavelet (x) and the scaling function (x) f(x) =s00 00 (x) + d00 00 (x) + dik ik (x) ik(x) = 2k/2 (2kx i) ik(x) = 2k/2 (2kx i) family of perfect low and high pass filters hi and gi (enable DWT) Why wavelets? simultaneous time (space) and frequency localization (FFT only frequency) data compression: computational speed up signal denoising: natural setting in which noise can be partially removed denoised simulation simulation with more macroparticles i2(x)

34 One Dimensional Wavelets (a) Haar wavelet, (b) Morlet wavelet, (c) Daubechies wavelet. Two Dimensional Daubechies least symmetric N = 10 two dimensional wavelet.

35 Wavelet Decomposition The continuous wavelet transform of a function f (t) is s, = f t s, t dt s, t = 1 s t s t mother wavelet with scale and translation dimensions s and respectively

36 How Do Wavelets Work? Wavelet analysis (wavelet transform): S signal A approximation D detail Approximation apply low pass filter to Signal and down sample Detail apply high pass filter to Signal and down sample Wavelet synthesis (inverse wavelet transform): up sampling & filtering Complexity: 4MN, M the size of the wavelet, N number of cells Recall: FFT complexity 4N log2n

37 2D EXAMPLE: MICROBUNCHED DENSITY DISTRIBUTION (with U=0 starting guess) BCs: open in all directions (analytically specified)

38 IMPACT T Vs. IMPACT T with PCG: rms properties Fermilab/NICADD photoinjector ( grid) 1 nc charge bunch compressor at z=5.65m from cathode rms beam radius rms normalized transverse emittance rms bunch length rms normalized longitudinal emittance

39 IMPACT T Vs. IMPACT T with PCG: level of detail Impact IMPACT T IMPACT Tresidue w/ PCG Impact with CPCG transverse charge distribution for the AES/JLab low charge photoinjector simulation very non axisymmetric beam grid, N= very good agreement in detail initial distribution z = 0.5 m z = 1.9 m z = 2.5 m

40 Application of Wavelets to N body Particle In Cell Simulations Balša Terzić (NIU) in collaboration with Ilya Pogorelov (LBL) Daniel Mihalcea, Courtlandt Bohn (NIU) Northern Illinois University, Department of Physics April 7, 2006