paper-with-me

Papers

A Crystal-Specific Pre-Training Framework for Crystal Material Property Prediction

2023-06-08 · Haomin Yu, Yanru Song, Jilin Hu, Chenjuan Guo, Bin Yang

Crystal property prediction is a crucial aspect of developing novel materials. However, there are two technical challenges to be addressed for speeding up the investigation of crystals. First, labeling crystal properties is intrinsically difficult due to the high cost and time involved in physical simulations or lab experiments. Second, crystals adhere to a specific quantum chemical principle known as periodic invariance, which is often not captured by existing machine learning methods. To overcome these challenges, we propose the crystal-specific pre-training framework for learning crystal representations with self-supervision. The framework designs a mutex mask strategy for enhancing representation learning so as to alleviate the limited labels available for crystal property prediction. Moreover, we take into account the specific periodic invariance in crystal structures by developing a periodic invariance multi-graph module and periodic attribute learning within our framework. This framework has been tested on eight different tasks. The experimental results on these tasks show that the framework achieves promising prediction performance and is able to outperform recent strong baselines.

📄 PDF Abstract BibTeX arXiv:2306.05344

Code (0)

등록된 구현이 없습니다.

Tasks

AttributePhysical SimulationsPredictionProperty PredictionRepresentation Learning

Similar Papers 제목 키워드 기반

Space Group Informed Transformer for Crystalline Materials Generation

2024-03-23 · Zhendong Cao, Xiaoshan Luo, Jian Lv, Lei Wang

We introduce CrystalFormer, a transformer-based autoregressive model specifically designed for space group-controlled generation of crystalline materials. The incorporation of space group symmetry significantly simplifie…

CrystalICL: Enabling In-Context Learning for Crystal Generation

2025-08-27 · Ruobing Wang, Qiaoyu Tan, Yili Wang, Ying Wang 외 arxiv

Designing crystal materials with desired physicochemical properties remains a fundamental challenge in materials science. While large language models (LLMs) have demonstrated strong in-context learning (ICL) capabilities…

Universal crystal material property prediction via multi-view geometric fusion in graph transformers

2025-07-21 · Liang Zhang, Kong Chen, Yuen Wu arxiv

Accurately and comprehensively representing crystal structures is critical for advancing machine learning in large-scale crystal materials simulations, however, effectively capturing and leveraging the intricate geometri…

Transfer Learning

Large Language Models Are Innate Crystal Structure Generators

2025-02-28 · Jingru Gan, Peichen Zhong, Yuanqi Du, Yanqiao Zhu 외

Crystal structure generation is fundamental to materials discovery, enabling the prediction of novel materials with desired properties. While existing approaches leverage Large Language Models (LLMs) through extensive fi…

Density of States Prediction of Crystalline Materials via Prompt-guided Multi-Modal Transformer

2023-10-24 · NeurIPS 2023 11 · Namkyeong Lee, Heewoong Noh, Sungwon Kim, Dongmin Hyun 외

The density of states (DOS) is a spectral property of crystalline materials, which provides fundamental insights into various characteristics of the materials. While previous works mainly focus on obtaining high-quality …