Improvements to wave codes

Transcription

1 Improvements to wave codes John C. Wright P. T. Bonoli Haru Kohno and Jungpyo Lee 1 1 Plasma Science and Fusion Center Massachusetts Institute of Technology Sep PPPL 1 RF SciDAC PPPL 2010

2 Contents 2 RF SciDAC PPPL 2010 CONTENTS 1 CONTENTS 2 SUMMARY 3 PARALLEL SHEATH CODE 4 IMPROVEMENTS IN TORLH debugging Input consistency and automation Improved v-mesh 5 NEXT STEPS

3 Summary 3 RF SciDAC PPPL 2010 SUMMARY 1 Sep2009 Relativistic Imχ e with lookup table - Valeo 2 Oct2009 Handle both signs of n in Imχ e - Valeo 3 Nov2009-Mar2010 V&V Working Group. Establishment of LAPD collaboration. 4 Jan2010 Correct ACCOME eqdsk generation to conform to standard for use in TORLH - Wright 5 Aug-Sep2010 Generate D qle in TORLH on u/u norm mesh for better v-space sampling. -Valeo and Wright 6 Jul-Aug Migrated TORLH from CVS(!) on desktop to SVN on PSFC webserver - London and Wright 7 New collaborations initiated with UCLA (Dec2009), KSTAR(Aug2010)

4 Summary 4 RF SciDAC PPPL 2010 RECENT PAPERS 1 J-P Lee and J.C. Wright, "A versatile parallel solver for massive block-tridiagonal matrix system" - rejected by TOMS, submitted to JCP. 2 A. S. Richardson, P. T. Bonoli, and J. C. Wright Phys. Plasmas 17, (2010) The lower hybrid wave cutoff: A case study in eikonal methods 3 Nersc 2009 Annual Report. P. Bonoli et al. Harnessing Plasma Waves Simulations of wave-plasma interactions pave the way toward practical fusion energy annrep0809/climate/harnessing_plasma_waves.html 4 J. Wright et al. JCP (2010) Challenges in self-consistent full wave simulations of lower hybrid waves from ICNSP09 Lisbon.

5 Parallel sheath code 5 RF SciDAC PPPL 2010 INCREASE SHEATH CODE RESOLUTION - WRIGHT AND KOHNO 1 Ported code to loki, converted to use of open source sparse direct solvers: SuperLU, MUMPS 2 Tried two parallel solvers: parmumps and SuperLU 3 MPI-1 bug for parmumps at large sizes: move to Nersc for more nodes and MPI-2 4 Solve configuration problems at Nersc (famous MPICH_UNEX_BUFFER_SIZE problem), missing parmetis support, memory per node. 5 Now running very large problems and resolving physics - see Kohno s talk. 6 Another lesson: with parmumps cannot increase ncpus without bound, causes communications explosion.

6 Improvements in TORLH debugging 6 RF SciDAC PPPL 2010 PROFILE CORRECTION OF D qle Bob Harvey pointed out what appears to be a factor of r difference between CQL and QLDCE power profiles. Difference tracked down to consistent treatment of normalized ψ pol in TORLH jacobian: B = f ( ψ) φ ψ + g( ψ) φ Led to error in bounce average from dl/b dθ/b θ J was missing factor of q( ψ)

7 Improvements in TORLH Input consistency and automation 7 RF SciDAC PPPL 2010 PYTHON DRIVING SCRIPTS See Jungpyo Lee s talk 3D reconstruction python driven with batch jobs dispatched for each toroidal mode. Separate script for reconstruction and export at VTK for visualization by VisIT. Python script for handling automation of CQL3D-TORLH iteration. 1 Runs CQL3D and TORLH and batch jobs 2 Copies files, makes directories and links for next iteration 3 Ensures input consistency across multiple input files. e.g. enorm specified in torica.inp, cql3d_mapin.inp and cqlinput Also handling input consistency.

8 Improvements in TORLH Improved v-mesh I TERATION WITH F OKKER -P LANCK DONE MANUALLY pol Peld <ExB> Power_e Power_e Peld <ExB> Poynting Power_e <ExB> Peld Poynting <ExB> Poynting Peld Poynting 300 Power_e pol pol pol Iteration # Converges after some oscillations in damping strength. Power of 350 kw generates 150 ka. (nk = 2.5, Te = 2.5keV ) Resolution, TORLH 400Nr 255Nm, CQL3D 60Nr 88Nµ 160Nu 8 RF SciDAC PPPL 2010

9 Improvements in TORLH Improved v-mesh 9 RF SciDAC PPPL 2010 CONVERGED AT STEP Poloidal spectrum on labeled flux surfaces log10 scale m ant P eld <ExB> Power_e Poynting pol

10 Improvements in TORLH Improved v-mesh VELOCITY POORLY SAMPLES RELATIVISTIC MOMENTUM 4 u/c = γv/c v/v th 10 RF SciDAC PPPL 2010

11 Improvements in TORLH Improved v-mesh 11 RF SciDAC PPPL 2010 OSCILLATIONS SEEN IN FINAL ITERATION STEPS Automated simulations oscillate about final end state Agreement in power profiles poor at larger radii, but improved with more velocity space resolution in generated Dql Problem is that natural basis for torlh calculation (v/v te ) is poor sampling for CQL, esp at lower temperatures (larger radii). Solution (under study), generate Dql on same momentum space mesh that CQL uses. Valeo has modified mapper for this case and TORLH generates on u/u norm mesh. Looks promising, but still some bugs to work out. (normalizations, linear test case, better integrator in internal power test of qldce in torlh)

12 Improvements in TORLH Improved v-mesh 12 RF SciDAC PPPL 2010 XML TO BE USED FOR INPUT TO PYTHON DRIVER XML Schema (XSD) - for input validation XML Stylesheet Language Transforms (XSLT) - for conversion to legacy input formats XForms for providing graphical web interface 1 <parameter><name>aconc< / name><value>1.0< / value> <help>ion c o n c e n t r a t i o n array size nspec< / help> 3 < / parameter> <parameter><name>sp_xs1< / name><value>0.0< / value> 5 <help>< / help> < / parameter> 7 <parameter><name>sp_xs1< / name><value>0.0< / value> <help>< / help> 9 < / parameter> < / namelist> 11 < / namelists>

13 Improvements in TORLH Improved v-mesh 13 RF SciDAC PPPL 2010 EXAMPLE OF A INPUT TRANSFORMATION. XSLT: XML->NML 1 <?xml version= " 1.0 "?> <xsl: stylesheet version= " 1.0 " 3 xmlns:xsl=" h t t p : / / org /1999/XSL / Transform "> <xsl: output method= " html " / > 5 <! > XML to NML generates f o r t r a n s t y l e namelist from XML 7 with s t r u c t u r e : namelists / namelist / [ name, parameter / [ name, value ] ] 9 > < x s l : t e m p l a t e match= " / "><html><body> 11 <pre>< x s l : t e x t >&#xa ; < / x s l : t e x t > < x s l : f o r each s e l e c t = " namelists / namelist " > 13 < x s l : t e x t > & < / x s l : t e x t > < x s l :value of s e l e c t = "@name" / > 15 < x s l : t e x t >&#xa ; < / x s l : t e x t > < x s l : f o r each s e l e c t = " parameter " > 17 < x s l : t e x t > < / x s l : t e x t > < x s l :value of s e l e c t = "name" / >= 19 <xsl:value of select= " value " / > < x s l : t e x t >&#xa ; < / x s l : t e x t > 21 < / x s l : f o r each> < x s l : t e x t > /&#xa ; < / x s l : t e x t > 23 < / x s l : f o r each> < / pre> 25 < / body>< / html>< / x s l : t e m p l a t e > < / xsl: stylesheet > 1 &toric_mode toricmode= t o r i c 3 / & t o r i c i n p 5 i s o l =1 nvrb=3 7 nelm=230 n t t =512 9 nmod=255 nptvac= 1 11 mxmvac=15 freqcy =80.0E6 13 nphi =10 Antlen =

14 Next steps 14 RF SciDAC PPPL 2010 NEXT STEPS 1 Complete development of TORLH-CQL3D using momentum space mesh. 2 Complete installation of new parallel solver already in use in TORIC in TORLH 3 Extend use of VisIT in GENRAY - TORLH comparisons 4 Preparation for Non-Maxwellian ions Build on current NonMax architecture in TORLH (which is implemented as a separate set of modules and tools) Use SVN for continued development of NonMax with TORIC coming from IPP SVN Use CSWIM IPS for python driven iteration - IPS recently installed on PSFC Loki cluster.