paper-with-me

홈 › Papers

Broken neural scaling laws in materials science

2026-02-05 · Max Großmann, Malte Grunert, Erich Runge arxiv

In materials science, data are scarce and expensive to generate, whether computationally or experimentally. Therefore, it is crucial to identify how model performance scales with dataset size and model capacity to distinguish between data- and model-limited regimes. Neural scaling laws provide a framework for quantifying this behavior and guide the design of materials datasets and machine learning architectures. Here, we investigate neural scaling laws for a paradigmatic materials science task: predicting the dielectric function of metals, a high-dimensional response that governs how solids interact with light. Using over 200,000 dielectric functions from high-throughput ab initio calculations, we study two multi-objective graph neural networks trained to predict the frequency-dependent complex interband dielectric function and the Drude frequency. We observe broken neural scaling laws with respect to dataset size, whereas scaling with the number of model parameters follows a simple power law that rapidly saturates.

📄 PDF Abstract BibTeX arXiv:2602.05702

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Scaling Laws of Graph Neural Networks for Atomistic Materials Modeling

2025-04-10 · Chaojian Li, Zhifan Ye, Massimiliano Lupo Pasini, Jong Youl Choi 외

Atomistic materials modeling is a critical task with wide-ranging applications, from drug discovery to materials science, where accurate predictions of the target material property can lead to significant advancements in…

Drug Discoveryscientific discovery

Broken Neural Scaling Laws

2022-10-26 · Ethan Caballero, Kshitij Gupta, Irina Rish, David Krueger

We present a smoothly broken power law functional form (referred to by us as a Broken Neural Scaling Law (BNSL)) that accurately models and extrapolates the scaling behaviors of deep neural networks (i.e. how the evaluat…

Adversarial RobustnessContinual LearningContrastive LearningForm+7

Omics-scale polymer computational database transferable to real-world artificial intelligence applications

2025-11-07 · Ryo Yoshida, Yoshihiro Hayashi, Hidemine Furuya, Ryohei Hosoya 외 arxiv

Developing large-scale foundational datasets is a critical milestone in advancing artificial intelligence (AI)-driven scientific innovation. However, unlike AI-mature fields such as natural language processing, materials…

Machine Learning in Heterogeneous Porous Materials

2022-02-04 · Martha D'Eli, Hang Deng, Cedric Fraces, Krishna Garikipati 외

The "Workshop on Machine learning in heterogeneous porous materials" brought together international scientific communities of applied mathematics, porous media, and material sciences with experts in the areas of heteroge…

BIG-bench Machine Learning

The Open MatSci ML Toolkit: A Flexible Framework for Machine Learning in Materials Science

2022-10-31 · Santiago Miret, Kin Long Kelvin Lee, Carmelo Gonzales, Marcel Nassar 외

We present the Open MatSci ML Toolkit: a flexible, self-contained, and scalable Python-based framework to apply deep learning models and methods on scientific data with a specific focus on materials science and the OpenC…

CPUGPUGraph Neural Network