Workshops Archive

Centralized Provisioning of Large Language Models for a Research Community

Workshop: HUST-23: 10th International Workshop on HPC User Support Tools

Authors: Dhruvil Shah, Gil Speyer, and Jason Yalim (Arizona State University)

Abstract: Local support for large language models (LLMs) in a research community can address unique technological and procedural challenges that arise in an academic setting. Platforms providing multi-GPU nodes, typically found in a centralized computational resource, such as a university datacenter, can manage the large memory footprint of the open-source LLMs. Customizations employing peripheral frameworks help extend the capabilities of these models. Further, the local implementation addresses the protection of researcher IP and control of restricted data sources. This report describes recent efforts toward provisioning this popular new tool and provides guidance for recreating our approach at Arizona State University.

Website: https://hust-workshop.github.io

Back to HUST-23: 10th International Workshop on HPC User Support Tools Archive Listing

Back to Full Workshop Archive Listing