paper-with-me

Papers

JUWELS Booster -- A Supercomputer for Large-Scale AI Research

2021-06-30 · Stefan Kesselheim, Andreas Herten, Kai Krajsek, Jan Ebert, Jenia Jitsev, Mehdi Cherti, Michael Langguth, Bing Gong, Scarlet Stadtler, Amirpasha Mozaffari, Gabriele Cavallaro, Rocco Sedona, Alexander Schug, Alexandre Strube, Roshni Kamath, Martin G. Schultz, Morris Riedel, Thomas Lippert

In this article, we present JUWELS Booster, a recently commissioned high-performance computing system at the J\"ulich Supercomputing Center. With its system architecture, most importantly its large number of powerful Graphics Processing Units (GPUs) and its fast interconnect via InfiniBand, it is an ideal machine for large-scale Artificial Intelligence (AI) research and applications. We detail its system architecture, parallel, distributed model training, and benchmarks indicating its outstanding performance. We exemplify its potential for research application by presenting large-scale AI research highlights from various scientific fields that require such a facility.

📄 PDF Abstract BibTeX arXiv:2108.11976

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operators

2022-08-08 · Thorsten Kurth, Shashank Subramanian, Peter Harrington, Jaideep Pathak 외

Extreme weather amplified by climate change is causing increasingly devastating impacts across the globe. The current use of physics-based numerical weather prediction (NWP) limits accuracy due to high computational cost…

Weather Forecasting

Reliable Label Correction is a Good Booster When Learning with Extremely Noisy Labels

2022-04-30 · Kai Wang, Xiangyu Peng, Shuo Yang, Jianfei Yang 외

Learning with noisy labels has aroused much research interest since data annotations, especially for large-scale datasets, may be inevitably imperfect. Recent approaches resort to a semi-supervised learning problem by di…

Learning with noisy labels

NetBooster: Empowering Tiny Deep Learning By Standing on the Shoulders of Deep Giants

2023-06-23 · Zhongzhi Yu, Yonggan Fu, Jiayi Yuan, Haoran You 외

Tiny deep learning has attracted increasing attention driven by the substantial demand for deploying deep learning on numerous intelligent Internet-of-Things devices. However, it is still challenging to unleash tiny deep…

Deep Learning

Exploring GPU-to-GPU Communication: Insights into Supercomputer Interconnects

2024-08-26 · Daniele De Sensi, Lorenzo Pichetti, Flavio Vella, Tiziano De Matteis 외

Multi-GPU nodes are increasingly common in the rapidly evolving landscape of exascale supercomputers. On these systems, GPUs on the same node are connected through dedicated networks, with bandwidths up to a few terabits…

GPU

GPU-Accelerated Drug Discovery with Docking on the Summit Supercomputer: Porting, Optimization, and Application to COVID-19 Research

2020-07-06 · Scott LeGrand, Aaron Scheinberg, Andreas F. Tillack, Mathialakan Thavappiragasam 외

Protein-ligand docking is an in silico tool used to screen potential drug compounds for their ability to bind to a given protein receptor within a drug-discovery campaign. Experimental drug screening is expensive and tim…

Drug DiscoveryGPU