Papers + Reproducibility Put the “Super” in Supercomputing Year After Year

The SC Papers program is the leading venue for presenting high-quality original research, groundbreaking ideas, and compelling insights in high performance computing (HPC). Submission of technical papers opened March 1 and close April 6, 2023 – no extensions! We look forward to continuing SC’s tradition of excellence in the technical papers program.

Community-Sourced

Part of what makes this the premier venue for HPC research is found in the community: in 2022, over 11,000 attendees and 361 institutions representing the largest and most advanced computing centers in the world attended SC. Another ingredient that puts the “super” in the selected papers is the rigor by which research is evaluated.

Each submitted paper is directed into one of ten technical areas: Algorithms; Applications; Architecture and Networks; Clouds and Distributed Computing; Data Analytics, Visualization and Storage; Machine Learning with HPC; Performance Measurement, Modeling and Tools; Post-Moore Computing; Programming Frameworks and System Software; and State of the Practice.

SC23 will use a streamlined, single-round review-and-rebuttal process. All submitted papers will be reviewed by four or five experts in the technical area. All reviews will be double-anonymous so that reviewers do not know the papers’ authors or affiliations. Authors will have an opportunity to provide rebuttals, answering questions from the reviewers before the technical program committee meets to select papers to be accepted. Acceptance decisions will be released in mid-June. See the Papers page for full details on paper submissions.

The SC Conference is a leader in tangible progress towards scientific rigor, through its pioneering practice of enhanced reproducibility of accepted papers. The scientific method is the foundation of scientific research, utilized by aspiring science fair contestants and Nobel laureates alike. The successful application of the scientific method has a key feature: the result, under given conditions, is reproducible. The SC Papers program promotes this end with the Reproducibility Initiative.

Scientific Rigor

Reproducibility Initiative

First, the Artifact Description and Artifact Evaluation (AD/AE) appendices enhance transparency and improve reproducibility. However, achieving reproducibility might require non-trivial effort and time investment. Therefore, to diminish its impact, it is advisable to incorporate reproducibility practices early in the experimental design phase when validating a paper. Additionally, the benefits of reproducibility extend beyond ensuring trustworthy science, as authors can also reproduce their own experiments in the future, thus enhancing their own research outcomes. All paper submitters should review the information on the Reproducibility Initiative page, including the guidelines for AD/AE Appendices & Badges. Ensuring the reproducibility of scientific results is crucial for establishing trust in scientific findings.

Reproducibility challenge

Second, the Reproducibility Challenge takes a previously accepted paper and has students in the Student Cluster Competition attempt to reproduce it. Now this is where the rubber hits the road! The students will produce publish-quality, citable reports that will be made available through an archive.

Submissions Are Open