SC23 Proceedings

The International Conference for High Performance Computing, Networking, Storage, and Analysis

Research Posters Archive

ParLeiden: Boosting Parallelism of Distributed Leiden Algorithm on Large-Scale Graphs

Authors: Yongmin Hu (Douyin Vision Co., Ltd); Jing Wang (Shanghai Jiao Tong University); Cheng Zhao (Douyin Vision Co., Ltd); Yibo Liu (Shanghai Jiao Tong University); Cheng Chen and Xiaoliang Cong (Douyin Vision Co., Ltd); and Chao Li (Shanghai Jiao Tong University)

Abstract: Leiden algorithm has demonstrated superior efficacy compared to traditional Louvain algorithms in the field of community detection. However, parallelizing the Leiden algorithm while imposing community size limitations brings significant challenges in big data processing scenarios. We present ParLeiden, a pioneering parallel Leiden strategy designed for distributed environments. By thread locks and efficient buffers, we effectively resolve community joining conflicts and reduce communication overheads. We can run Leiden algorithm on large-scale graphs and achieve performance speedup on up to 9.8 times than baselines.

Best Poster Finalist (BP): no

Poster: PDF
Poster summary: PDF

Back to Poster Archive Listing