paper-with-me

Papers

Molecular Quantum Transformer

2025-03-27 · Yuichi Kamata, Quoc Hoan Tran, Yasuhiro Endo, Hirotaka Oshima

The Transformer model, renowned for its powerful attention mechanism, has achieved state-of-the-art performance in various artificial intelligence tasks but faces challenges such as high computational cost and memory usage. Researchers are exploring quantum computing to enhance the Transformer's design, though it still shows limited success with classical data. With a growing focus on leveraging quantum machine learning for quantum data, particularly in quantum chemistry, we propose the Molecular Quantum Transformer (MQT) for modeling interactions in molecular quantum systems. By utilizing quantum circuits to implement the attention mechanism on the molecular configurations, MQT can efficiently calculate ground-state energies for all configurations. Numerical demonstrations show that in calculating ground-state energies for H2, LiH, BeH2, and H4, MQT outperforms the classical Transformer, highlighting the promise of quantum effects in Transformer structures. Furthermore, its pretraining capability on diverse molecular data facilitates the efficient learning of new molecules, extending its applicability to complex molecular systems with minimal additional effort. Our method offers an alternative to existing quantum algorithms for estimating ground-state energies, opening new avenues in quantum chemistry and materials science.

📄 PDF Abstract BibTeX arXiv:2503.21686

Code (0)

등록된 구현이 없습니다.

Tasks

Quantum Machine Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Residual Connection 설명 없음
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Multimodal Quantum Vision Transformer for Enzyme Commission Classification from Biochemical Representations

2025-08-20 · Murat Isik, Mandeep Kaur Saggi, Humaira Gowher, Sabre Kais arxiv

Accurately predicting enzyme functionality remains one of the major challenges in computational biology, particularly for enzymes with limited structural annotations or sequence homology. We present a novel multimodal Qu…

Quantum Machine Learning

Path-Augmented Graph Transformer Network

2019-05-29 · Benson Chen, Regina Barzilay, Tommi Jaakkola

Much of the recent work on learning molecular representations has been based on Graph Convolution Networks (GCN). These models rely on local aggregation operations and can therefore miss higher-order graph properties. To…

Molecular Property PredictionProperty Prediction

NNQS-Transformer: an Efficient and Scalable Neural Network Quantum States Approach for Ab initio Quantum Chemistry

2023-06-29 · Yangjun Wu, Chu Guo, Yi Fan, Pengyu Zhou 외

Neural network quantum state (NNQS) has emerged as a promising candidate for quantum many-body problems, but its practical applications are often hindered by the high cost of sampling and local energy calculation. We dev…

Variational Monte Carlo

Quantum-Classical Hybrid Molecular Autoencoder for Advancing Classical Decoding

2025-08-26 · Afrar Jahin, Yi Pan, Yingfeng Wang, Tianming Liu 외 arxiv

Although recent advances in quantum machine learning (QML) offer significant potential for enhancing generative models, particularly in molecular design, a large array of classical approaches still face challenges in ach…

Quantum Machine LearningDrug Discovery

Equivariant Transformers for Neural Network based Molecular Potentials

2021-09-29 · ICLR 2022 4 · Philipp Thölke, Gianni de Fabritiis

The prediction of quantum mechanical properties is historically plagued by a trade-off between accuracy and speed. Machine learning potentials have previously shown great success in this domain, reaching increasingly bet…

Computational Efficiency