paper-with-me

홈 › Papers

Training a Foundation Model for Materials on a Budget

2025-08-22 · Teddy Koker, Mit Kotak, Tess Smidt arxiv

Foundation models for materials modeling are advancing quickly, but their training remains expensive, often placing state-of-the-art methods out of reach for many research groups. We introduce Nequix, a compact E(3)-equivariant potential that pairs a simplified NequIP design with modern training practices, including equivariant root-mean-square layer normalization and the Muon optimizer, to retain accuracy while substantially reducing compute requirements. Nequix has 700K parameters and was trained in 100 A100 GPU-hours. On the Matbench-Discovery and MDR Phonon benchmarks, Nequix ranks third overall while requiring a 20 times lower training cost than most other methods, and it delivers two orders of magnitude faster inference speed than the current top-ranked model. We release model weights and fully reproducible codebase at https://github.com/atomicarchitects/nequix.

📄 PDF Abstract BibTeX arXiv:2508.16067

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Foundation Models for Discovery and Exploration in Chemical Space

2025-10-20 · Alexius Wadell, Anoushka Bhutani, Victor Azumah, Austin R. Ellis-Mohr 외 arxiv

Accurate prediction of atomistic, thermodynamic, and kinetic properties from molecular structures underpins materials innovation. Existing computational and experimental approaches lack the scalability required to naviga…

Foundation Model for Composite Microstructures: Reconstruction, Stiffness, and Nonlinear Behavior Prediction

2024-11-10 · Ting-Ju Wei, Chuin-Shan Chen

The rapid advancement of machine learning has unlocked numerous opportunities for materials science, particularly in accelerating the design and analysis of materials. However, a significant challenge lies in the scarcit…

Transfer Learning

Efficient Training of Self-Supervised Speech Foundation Models on a Compute Budget

2024-09-09 · Andy T. Liu, Yi-Cheng Lin, Haibin Wu, Stefan Winkler 외

Despite their impressive success, training foundation models remains computationally costly. This paper investigates how to efficiently train speech foundation models with self-supervised learning (SSL) under a limited c…

Data AugmentationSelf-Supervised Learning

Surrogate-Gated Generation and Foundation-Model Embeddings for Bayesian Materials Design

2026-06-26 · Sk Md Ahnaf Akif Alvi, Jan Janssen, Danny Perez, Douglas Allaire 외 arxiv

Closed-loop materials discovery iterates between proposing candidate structures and evaluating their properties, and property evaluation dominates the cost. In the generative variant, a learned prior proposes candidate c…

Multimodal Foundation Models for Material Property Prediction and Discovery

2023-11-30 · Viggo Moro, Charlotte Loh, Rumen Dangovski, Ali Ghorashi 외

Artificial intelligence is transforming computational materials science, improving the prediction of material properties, and accelerating the discovery of novel materials. Recently, publicly available material data repo…

Property Prediction