paper-with-me

Papers

Exascale Multi-Task Graph Foundation Models for Imbalanced, Multi-Fidelity Atomistic Data

2026-04-15 · Massimiliano Lupo Pasini, Jong Youl Choi, Kshitij Mehta, Richard Messerly, Rylie Weaver, Linda Ungerboeck, Isaac Lyngaas, Benajmin Stump, Ashwin M. Aji, Karl W. Schulz, Jorda Polo arxiv

We present an exascale workflow for materials discovery using atomistic graph foundation models built on HydraGNN. We jointly train on 16 open first-principles datasets (544+ million structures covering 85+ elements) using a multi-task architecture with per-dataset heads and a scalable ADIOS2/DDStore data pipeline. On Frontier, we execute six large-scale DeepHyper hyperparameter optimization campaigns in FP64 and promote the top-performing message-passing models to sustained 2,048-node training, yielding a PaiNN-based lead model. The resulting model enables billion-scale screening, evaluating 1.1 billion atomistic structures in 50 seconds, compressing a workload that would require years of first-principles computation, and supports data-scarce fine-tuning across diverse downstream tasks. We quantify precision-performance tradeoffs (BF16/FP32/FP64), demonstrate transfer across twelve chemically diverse downstream tasks, and establish seamless strong- and weak-scaling across Frontier, Aurora, and Perlmutter. This work allows fast and reliable exploration of vast chemical design spaces that are otherwise inaccessible to first-principles methods.

📄 PDF Abstract BibTeX arXiv:2604.15380

Code (0)

등록된 구현이 없습니다.

Tasks

Hyperparameter Optimization

Similar Papers 제목 키워드 기반

Scalable Training of Trustworthy and Energy-Efficient Predictive Graph Foundation Models for Atomistic Materials Modeling: A Case Study with HydraGNN

2024-06-12 · Massimiliano Lupo Pasini, Jong Youl Choi, Kshitij Mehta, Pei Zhang 외

We present our work on developing and training scalable, trustworthy, and energy-efficient predictive graph foundation models (GFMs) using HydraGNN, a multi-headed graph convolutional neural network architecture. HydraGN…

Atomic ForcesEnsemble LearningGraph Neural NetworkHyperparameter Optimization+2

Exascale Grid Optimization (ExaGO) toolkit: An open-source high-performance package for solving large-scale grid optimization problems

2022-03-20 · Shrirang Abhyankar, Slaven Peles, Tamara Becejac, Jesse Holzer 외

This paper introduces the Exascale Grid Optimization (ExaGO) toolkit, a library for solving large-scale alternating current optimal power flow (ACOPF) problems including stochastic effects, security constraints and multi…

Scalable and Consistent Graph Neural Networks for Distributed Mesh-based Data-driven Modeling

2024-10-02 · Shivam Barwey, Riccardo Balin, Bethany Lusch, Saumil Patel 외

This work develops a distributed graph neural network (GNN) methodology for mesh-based modeling applications using a consistent neural message passing layer. As the name implies, the focus is on enabling scalable operati…

GPUGraph Neural Network

Transforming the Use of Earth Observation Data: Exascale Training of a Generative Compression Model with Historical Priors for up to 10,000x Data Reduction

2026-05-09 · Jinxiao Zhang, Runmin Dong, Xiyong Wu, Xihan Huang 외 arxiv

Earth observation is becoming one of the largest data-producing activities in science, yet current pipelines still treat compression as a storage and transmission tool rather than a new way to use data. We present a gene…

Hyperparameter optimization of data-driven AI models on HPC systems

2022-03-02 · Eric Wulff, Maria Girone, Joosep Pata

In the European Center of Excellence in Exascale computing "Research on AI- and Simulation-Based Engineering at Exascale" (CoE RAISE), researchers develop novel, scalable AI technologies towards Exascale. This work exerc…

Bayesian OptimizationGraph Neural NetworkHyperparameter Optimization