SC23 Proceedings

The International Conference for High Performance Computing, Networking, Storage, and Analysis

Technical Papers Archive

ANT-MOC: Scalable Neutral Particle Transport Using 3D Method of Characteristics on Multi-GPU Systems


Authors: Shunde Li and Zongguo Wang (Computer Network Information Center, Chinese Academy of Sciences); Lingkun Bu (National Center for Materials Service Safety, University of Science and Technology Beijing); Jue Wang and Zhikuang Xin (Computer Network Information Center, Chinese Academy of Sciences); Shigang Li (School of Computer Science, Beijing University of Posts and Telecommunications); Yangang Wang and Yangde Feng (Computer Network Information Center, Chinese Academy of Sciences); Peng Shi (National Center for Materials Service Safety, University of Science and Technology Beijing); Yun Hu (China Institute of Atomic Energy); and Xuebin Chi (Computer Network Information Center, Chinese Academy of Sciences)

Abstract: The Method Of Characteristic (MOC) to solve the Neutron Transport Equation (NTE) is the core of full-core simulation for reactors. High resolution is enabled by discretizing the NTE through massive tracks to traverse the 3D reactor geometry. However, the 3D full-core simulation is prohibitively expensive because of the high memory consumption and the severe load imbalance. To deal with these challenges, we develop ANT-MOC. Specifically, we build a performance model for memory footprint, computation and communication, based on which a track management strategy is proposed to overcome the resolution bottlenecks caused by limited GPU memory. Furthermore, we implement a novel multi-level load mapping strategy to ensure load balancing among nodes, GPUs, and CUs. ANT-MOC enables a 3D full-core reactor simulation with 100 billion tracks on 16,000 GPUs, with 70.69% and 89.38% parallel efficiency for strong scalability and weak scalability, respectively.




Back to Technical Papers Archive Listing