Quantum-Enhanced Attention Mechanism in NLP: A Hybrid Classical-Quantum Approach

2025-01-26 · S. M. Yousuf Iqbal Tomal, Abdullah Al Shafin, Debojit Bhattacharjee, MD. Khairul Amin, Rafiad Sadat Shahir

Transformer-based models have achieved remarkable results in natural language processing (NLP) tasks such as text classification and machine translation. However, their computational complexity and resource demands pose challenges for scalability and accessibility. This research proposes a hybrid quantum-classical transformer model that integrates a quantum-enhanced attention mechanism to address these limitations. By leveraging quantum kernel similarity and variational quantum circuits (VQC), the model captures intricate token dependencies while improving computational efficiency. Experimental results on the IMDb dataset demonstrate that the quantum-enhanced model outperforms the classical baseline across all key metrics, achieving a 1.5% improvement in accuracy (65.5% vs. 64%), precision, recall, and F1 score. Statistical significance tests validate these improvements, highlighting the robustness of the quantum approach. These findings illustrate the transformative potential of quantum-enhanced attention mechanisms in optimizing NLP architectures for real-world applications.

📄 PDF Abstract BibTeX arXiv:2501.15630

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency Machine Translation text-classification Text Classification

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Attention 설명 없음

Hybrid Quantum Neural Networks for Enhanced Breast Cancer Thermographic Classification: A Novel Quantum-Classical Integration Approach

2026-04-18 · Riza Alaudin Syah, Irwan Alnarus Kautsar, Gunawan Witjaksono, Haza Nuzly bin Abdull Hamed arxiv

Breast cancer diagnosis through thermographic image analysis remains a critical challenge in medical AI, with classical deep learning approaches facing limitations in complex thermal pattern classification tasks. This pa…

Medical Image Classification Quantum Machine Learning Cancer Classification

Integrating Quantum-Classical Attention in Patch Transformers for Enhanced Time Series Forecasting

2025-03-31 · Sanjay Chakraborty, Fredrik Heintz

QCAAPatchTF is a quantum attention network integrated with an advanced patch-based transformer, designed for multivariate time series forecasting, classification, and anomaly detection. Leveraging quantum superpositions,…

Anomaly Detection Multivariate Time Series Forecasting Time Series Time Series Forecasting

Quantum Graph Attention Network: A Novel Quantum Multi-Head Attention Mechanism for Graph Learning

2025-08-25 · An Ning, Tai Yue Li, Nan Yow Chen arxiv

We propose the Quantum Graph Attention Network (QGAT), a hybrid graph neural network that integrates variational quantum circuits into the attention mechanism. At its core, QGAT employs strongly entangling quantum circui…

Graph Neural Network Graph Learning

From Classical to Hybrid: A Practical Framework for Quantum-Enhanced Learning

2025-11-11 · Silvie Illésová, Tomáš Bezděk, Vojtěch Novák, Ivan Zelinka 외 arxiv

This work addresses the challenge of enabling practitioners without quantum expertise to transition from classical to hybrid quantum-classical machine learning workflows. We propose a three-stage framework: starting with…

Quantum Reinforcement Learning with Transformers for the Capacitated Vehicle Routing Problem

2026-02-05 · Eva Andrés arxiv

This paper addresses the Capacitated Vehicle Routing Problem (CVRP) by comparing classical and quantum Reinforcement Learning (RL) approaches. An Advantage Actor-Critic (A2C) agent is implemented in classical, full quant…

Reinforcement Learning