paper-with-me

홈 › Papers

Generative Language Model for Catalyst Discovery

2024-07-19 · Dong Hyeon Mok, Seoin Back

Discovery of novel and promising materials is a critical challenge in the field of chemistry and material science, traditionally approached through methodologies ranging from trial-and-error to machine learning-driven inverse design. Recent studies suggest that transformer-based language models can be utilized as material generative models to expand chemical space and explore materials with desired properties. In this work, we introduce the Catalyst Generative Pretrained Transformer (CatGPT), trained to generate string representations of inorganic catalyst structures from a vast chemical space. CatGPT not only demonstrates high performance in generating valid and accurate catalyst structures but also serves as a foundation model for generating desired types of catalysts by fine-tuning with sparse and specified datasets. As an example, we fine-tuned the pretrained CatGPT using a binary alloy catalyst dataset designed for screening two-electron oxygen reduction reaction (2e-ORR) catalyst and generate catalyst structures specialized for 2e-ORR. Our work demonstrates the potential of language models as generative tools for catalyst discovery.

📄 PDF Abstract BibTeX arXiv:2407.14040

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage Modellingmodelvalid

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Residual Connection 설명 없음
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Toward Controllable Catalyst Inverse Design via Large-Scale Autoregressive Pretraining

2026-06-16 · Dong Hyeon Mok, Jonggeol Na, Seoin Back arxiv

Inverse design of heterogeneous catalysts remains challenging because catalyst surfaces exhibit substantial structural complexity with coupled surface-adsorbate interactions across a vast chemical space that is difficult…

ChemReasoner: Heuristic Search over a Large Language Model's Knowledge Space using Quantum-Chemical Feedback

2024-02-15 · Henry W. Sprueill, Carl Edwards, Khushbu Agarwal, Mariefel V. Olarte 외

The discovery of new catalysts is essential for the design of new and more efficient chemical processes in order to transition to a sustainable future. We introduce an AI-guided computational screening framework unifying…

Computational chemistryGraph Neural NetworkHeuristic SearchLanguage Modeling+2

LLM-Driven Discovery of High-Entropy Catalysts via Retrieval-Augmented Generation

2026-03-16 · AI Scientists, Xinyi Lin, Danqing Yin, Ying Guo arxiv

CO2 reduction requires efficient catalysts, yet materials discovery remains bottlenecked by 10-20 year development cycles requiring deep domain expertise. This paper demonstrates how large language models can assist the …

Computational Efficiency

Adaptive Catalyst Discovery Using Multicriteria Bayesian Optimization with Representation Learning

2024-04-18 · Jie Chen, Pengfei Ou, Yuxin Chang, Hengrui Zhang 외

High-performance catalysts are crucial for sustainable energy conversion and human health. However, the discovery of catalysts faces challenges due to the absence of efficient approaches to navigating vast and high-dimen…

Bayesian OptimizationRepresentation LearningUncertainty Quantification

Leveraging Data Mining, Active Learning, and Domain Adaptation in a Multi-Stage, Machine Learning-Driven Approach for the Efficient Discovery of Advanced Acidic Oxygen Evolution Electrocatalysts

2024-07-05 · Rui Ding, Jianguo Liu, Kang Hua, Xuebin Wang 외

Developing advanced catalysts for acidic oxygen evolution reaction (OER) is crucial for sustainable hydrogen production. This study introduces a novel, multi-stage machine learning (ML) approach to streamline the discove…

Active LearningDomain Adaptation