paper-with-me

Papers

Band-gap regression with architecture-optimized message-passing neural networks

2023-09-12 · Tim Bechtel, Daniel T. Speckhard, Jonathan Godwin, Claudia Draxl

Graph-based neural networks and, specifically, message-passing neural networks (MPNNs) have shown great potential in predicting physical properties of solids. In this work, we train an MPNN to first classify materials through density functional theory data from the AFLOW database as being metallic or semiconducting/insulating. We then perform a neural-architecture search to explore the model architecture and hyperparameter space of MPNNs to predict the band gaps of the materials identified as non-metals. The parameters in the search include the number of message-passing steps, latent size, and activation-function, among others. The top-performing models from the search are pooled into an ensemble that significantly outperforms existing models from the literature. Uncertainty quantification is evaluated with Monte-Carlo Dropout and ensembling, with the ensemble method proving superior. The domain of applicability of the ensemble model is analyzed with respect to the crystal systems, the inclusion of a Hubbard parameter in the density functional calculations, and the atomic species building up the materials.

📄 PDF Abstract BibTeX arXiv:2309.06348

Code (1)

tisabe/jraph_mpeu 공식 구현 jax

Tasks

Band Gapband gap regressionNeural Architecture SearchregressionUncertainty Quantification

Methods 이 논문이 사용한 방법론

MPNN There are at least eight notable examples of models from the literature that can be described using the Message Passing Neural Networks (MPNN) framework. For simplicity we…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Tensor Frames -- How To Make Any Message Passing Network Equivariant

2024-05-24 · Peter Lippmann, Gerrit Gerhartz, Roman Remme, Fred A. Hamprecht

In many applications of geometric deep learning, the choice of global coordinate frame is arbitrary, and predictions should be independent of the reference frame. In other words, the network should be equivariant with re…

Decentralized Baseband Processing with Gaussian Message Passing Detection for Uplink Massive MU-MIMO Systems

2021-05-22 · Zhenyu Zhang, Yuanyuan Dong, Keping Long, Xiyuan Wang 외

Decentralized baseband processing (DBP) architecture, which partitions the base station antennas into multiple antenna clusters, has been recently proposed to alleviate the excessively high interconnect bandwidth, chip i…

Efficient Message Passing Architecture for GCN Training on HBM-based FPGAs with Orthogonal Topology On-Chip Networks

2024-11-06 · Qizhe Wu, Letian Zhao, Yuchen Gui, Huawen Liang Xiaotian Wang

Graph Convolutional Networks (GCNs) are state-of-the-art deep learning models for representation learning on graphs. However, the efficient training of GCNs is hampered by constraints in memory capacity and bandwidth, co…

Representation Learning

What drives performance in molecular MPNNs? An operator-level factorial benchmark

2026-05-28 · Panyu Jiao, Shuizhou Chen, Yiheng Shen, Yuyang Wang 외 arxiv

Message-passing neural networks (MPNNs) are widely used for molecular property prediction, but their deployment as monolithic architectures makes it difficult to identify how specific message-passing operators affect per…

Molecular Property PredictionGraph Neural Network

Minimizing Communication while Maximizing Performance in Multi-Agent Reinforcement Learning

2021-06-15 · Varun Kumar Vijay, Hassam Sheikh, Somdeb Majumdar, Mariano Phielipp

Inter-agent communication can significantly increase performance in multi-agent tasks that require co-ordination to achieve a shared goal. Prior work has shown that it is possible to learn inter-agent communication proto…

Multi-agent Reinforcement LearningMulti-Task Learningreinforcement-learningReinforcement Learning+1