SC23 Proceedings

The International Conference for High Performance Computing, Networking, Storage, and Analysis

Workshops Archive

Enhancing Metadata Transfer Efficiency: Unlocking the Potential of DAOS in the ADIOS Context


Workshop: PDSW23: 8th International Parallel Data Systems Workshop

Authors: Ranjan Sarpangala Venkatesh and Greg Eisenhauer (Georgia Institute of Technology), Scott Klasky (Oak Ridge National Laboratory (ORNL)), and Ada Gavrilovska (Georgia Institute of Technology)


Abstract: In HPC, data movement between applications is typically facilitated by I/O middleware, such as the Adaptable I/O System (ADIOS). This middleware leverages the capabilities of the underlying storage services, to facilitate data movement and distribution. A recent storage system, Intel DAOS, promises to deliver new capabilities for achieving performance and scalability on emerging memory/storage systems. DAOS has already deployed in University of Cambridge, TACC, and the upcoming Aurora supercomputer. This paper investigates the performance tradeoffs associated with mapping ADIOS over one of the many different DAOS interfaces and data models, and makes recommendations for their efficient use.





Back to PDSW23: 8th International Parallel Data Systems Workshop Archive Listing



Back to Full Workshop Archive Listing