ACM Student Research Competition Poster Archive

Enabling Transparent, High-Throughput Data Movement for Scientific Workflows on HPC Systems

Student: Ian Lumsden (University of Tennessee)
Supervisor: Michela Taufer (University of Tennessee)

Abstract: This poster presents the DYnamic and Asynchronous Data Streamliner (DYAD) middleware that provides an efficient and transparent method for data movement in scientific workflows based on the producer-consumer paradigm. We develop DYAD on top of Flux, a fully hierarchical HPC workload manager, and Unified Communication X (UCX), a unified framework for networking on HPC systems. We measure DYAD's performance with a suite of mini-apps and show how it outperforms traditional methods for data transfer while providing a higher level of transparency.

ACM-SRC Semi-Finalist: no

Poster: PDF
Poster Summary: PDF


Back to Poster Archive Listing