paper-with-me

Papers

SA-GAT-SR: Self-Adaptable Graph Attention Networks with Symbolic Regression for high-fidelity material property prediction

2025-05-01 · Junchi Liu, Ying Tang, Sergei Tretiak, Wenhui Duan, Liujiang Zhou

Recent advances in machine learning have demonstrated an enormous utility of deep learning approaches, particularly Graph Neural Networks (GNNs) for materials science. These methods have emerged as powerful tools for high-throughput prediction of material properties, offering a compelling enhancement and alternative to traditional first-principles calculations. While the community has predominantly focused on developing increasingly complex and universal models to enhance predictive accuracy, such approaches often lack physical interpretability and insights into materials behavior. Here, we introduce a novel computational paradigm, Self-Adaptable Graph Attention Networks integrated with Symbolic Regression (SA-GAT-SR), that synergistically combines the predictive capability of GNNs with the interpretative power of symbolic regression. Our framework employs a self-adaptable encoding algorithm that automatically identifies and adjust attention weights so as to screen critical features from an expansive 180-dimensional feature space while maintaining O(n) computational scaling. The integrated SR module subsequently distills these features into compact analytical expressions that explicitly reveal quantum-mechanically meaningful relationships, achieving 23 times acceleration compared to conventional SR implementations that heavily rely on first principle calculations-derived features as input. This work suggests a new framework in computational materials science, bridging the gap between predictive accuracy and physical interpretability, offering valuable physical insights into material behavior.

📄 PDF Abstract BibTeX arXiv:2505.00625

Code (1)

MustBeOne/SA-GAT-SR 공식 구현 pytorch

Tasks

Graph AttentionProperty PredictionSymbolic Regression

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

From GNNs to Symbolic Surrogates via Kolmogorov-Arnold Networks for Delay Prediction

2025-12-24 · Sami Marouani, Kamal Singh, Baptiste Jeudy, Amaury Habrard arxiv

Accurate prediction of flow delay is essential for optimizing and managing modern communication networks. We investigate three levels of modeling for this task. First, we implement a heterogeneous GNN with attention-base…

ViSymRe: Vision-guided Multimodal Symbolic Regression

2024-12-15 · Da Li, Junping Yin, Jin Xu, Xinxin Li 외

Symbolic regression automatically searches for mathematical equations to reveal underlying mechanisms within datasets, offering enhanced interpretability compared to black box models. Traditionally, symbolic regression h…

Meta-LearningregressionSymbolic Regression

Embodied-Symbolic Contrastive Graph Self-Supervised Learning for Molecular Graphs

2022-05-13 · Daniel T. Chang

Dual embodied-symbolic concept representations are the foundation for deep learning and symbolic AI integration. We discuss the use of dual embodied-symbolic concept representations for molecular graph representation lea…

Graph Representation LearningRepresentation LearningSelf-Supervised Learning

AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularity

2020-06-18 · NeurIPS 2020 12 · Silviu-Marian Udrescu, Andrew Tan, Jiahai Feng, Orisvaldo Neto 외

We present an improved method for symbolic regression that seeks to fit data to formulas that are Pareto-optimal, in the sense of having the best accuracy for a given complexity. It improves on the previous state-of-the-…

regressionSymbolic RegressionTwo-sample testing

Parameter Choice and Neuro-Symbolic Approaches for Deep Domain-Invariant Learning

2024-10-08 · Marius-Constantin Dinu

As artificial intelligence (AI) systems advance, we move towards broad AI: systems capable of performing well on diverse tasks, understanding context, and adapting rapidly to new scenarios. A central challenge for broad …

Domain AdaptationModel Selection