Compositionally restricted attention-based network for materials property predictions
In this paper, we demonstrate an application of the Transformer self-attention mechanism in the context of materials science. Our network, the Compositionally Restricted Attention-Based network (CrabNet), explores the area of structure-agnostic materials property predictions when only a chemical formula is provided. Our results show that CrabNet’s performance matches or exceeds current best-practice methods on nearly all of 28 total benchmark datasets. We also demonstrate how CrabNet’s architecture lends itself towards model interpretability by showing different visualization approaches that are made possible by its design. We feel confident that CrabNet and its attention-based framework will be of keen interest to future materials informatics researchers.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Assessing data-driven predictions of band gap and electrical conductivity for transparent conducting materials
Machine Learning (ML) has offered innovative perspectives for accelerating the discovery of new functional materials, leveraging the increasing availability of material databases. Despite the promising advances, data-dri…
Band GapProperty PredictionCAST: Cross Attention based multimodal fusion of Structure and Text for materials property prediction
Recent advancements in AI have revolutionized property prediction in materials science and accelerating material discovery. Graph neural networks (GNNs) stand out due to their ability to represent crystal structures as g…
Band GapPredictionProperty PredictionXtal2DoS: Attention-based Crystal to Sequence Learning for Density of States Prediction
Modern machine learning techniques have been extensively applied to materials science, especially for property prediction tasks. A majority of these methods address scalar property predictions, while more challenging spe…
Property PredictionGlobal Attention based Graph Convolutional Neural Networks for Improved Materials Property Prediction
Machine learning (ML) methods have gained increasing popularity in exploring and developing new materials. More specifically, graph neural network (GNN) has been applied in predicting material properties. In this work, w…
Graph AttentionGraph Neural NetworkProperty PredictionFrom Word2Vec to Transformers: Text-Derived Composition Embeddings for Filtering Combinatorial Electrocatalysts
Compositionally complex solid solution electrocatalysts span vast composition spaces, and even one materials system can contain more candidate compositions than can be measured exhaustively. Here we evaluate a label-free…