Quantum Mixed-State Self-Attention Network
Attention mechanisms have revolutionized natural language processing. Combining them with quantum computing aims to further advance this technology. This paper introduces a novel Quantum Mixed-State Self-Attention Network (QMSAN) for natural language processing tasks. Our model leverages quantum computing principles to enhance the effectiveness of self-attention mechanisms. QMSAN uses a quantum attention mechanism based on mixed state, allowing for direct similarity estimation between queries and keys in the quantum domain. This approach leads to more effective attention coefficient calculations. We also propose an innovative quantum positional encoding scheme, implemented through fixed quantum gates within the circuit, improving the model's ability to capture sequence information without additional qubit resources. In numerical experiments of text classification tasks on public datasets, QMSAN outperforms Quantum Self-Attention Neural Network (QSANN). Furthermore, we demonstrate QMSAN's robustness in different quantum noise environments, highlighting its potential for near-term quantum devices.
Code (0)
등록된 구현이 없습니다.
Tasks
Quantum Machine Learningtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Quantum Complex-Valued Self-Attention Model
Self-attention has revolutionized classical machine learning, yet existing quantum self-attention models underutilize quantum states' potential due to oversimplified or incomplete mechanisms. To address this limitation, …
modelMulti-class ClassificationQuantum Machine LearningAttention-based Quantum Tomography
With rapid progress across platforms for quantum systems, the problem of many-body quantum state reconstruction for noisy quantum states becomes an important challenge. Recent works found promise in recasting the problem…
SentenceMixed-State Quantum Denoising Diffusion Probabilistic Model
Generative quantum machine learning has gained significant attention for its ability to produce quantum states with desired distributions. Among various quantum generative models, quantum denoising diffusion probabilisti…
DenoisingmodelQuantum Machine LearningUniversal Quantum Tomography With Deep Neural Networks
Quantum state tomography is a crucial technique for characterizing the state of a quantum system, which is essential for many applications in quantum technologies. In recent years, there has been growing interest in leve…
Generative Adversarial NetworkQuantum State TomographyIntegrating Quantum-Classical Attention in Patch Transformers for Enhanced Time Series Forecasting
QCAAPatchTF is a quantum attention network integrated with an advanced patch-based transformer, designed for multivariate time series forecasting, classification, and anomaly detection. Leveraging quantum superpositions,…
Anomaly DetectionMultivariate Time Series ForecastingTime SeriesTime Series Forecasting