paper-with-me

홈 › Papers

CLAQS: Compact Learnable All-Quantum Token Mixer with Shared-ansatz for Text Classification

2025-10-08 · Junhao Chen, Yifan Zhou, Hanqi Jiang, Yi Pan, Yiwei Li, Huaqin Zhao, Wei Zhang, Yingfeng Wang, Tianming Liu arxiv

Quantum compute is scaling fast, from cloud QPUs to high throughput GPU simulators, making it timely to prototype quantum NLP beyond toy tasks. However, devices remain qubit limited and depth limited, training can be unstable, and classical attention is compute and memory heavy. This motivates compact, phase aware quantum token mixers that stabilize amplitudes and scale to long sequences. We present CLAQS, a compact, fully quantum token mixer for text classification that jointly learns complex-valued mixing and nonlinear transformations within a unified quantum circuit. To enable stable end-to-end optimization, we apply l1 normalization to regulate amplitude scaling and introduce a two-stage parameterized quantum architecture that decouples shared token embeddings from a window-level quantum feed-forward module. Operating under a sliding-window regime with document-level aggregation, CLAQS requires only eight data qubits and shallow circuits, yet achieves 91.64% accuracy on SST-2 and 87.08% on IMDB, outperforming both classical Transformer baselines and strong hybrid quantum-classical counterparts.

📄 PDF Abstract BibTeX arXiv:2510.06532

Code (0)

등록된 구현이 없습니다.

Tasks

Text Classification

Results from the Paper

RankTaskDatasetModelMetrics
#3 Classification SST-2 CLAQS Test Accuracy: 87.08
#3 Text Classification SST-2 CLAQS Accuracy: 91.64

Similar Papers 제목 키워드 기반

Hybrid Fourier Neural Operator for Surrogate Modeling of Laser Processing with a Quantum-Circuit Mixer

2026-04-06 · Mateusz Papierz, Asel Sagingalieva, Alix Benoit, Toni Ivas 외 arxiv

Data-driven surrogates can replace expensive multiphysics solvers for parametric PDEs, yet building compact, accurate neural operators for three-dimensional problems remains challenging: in Fourier Neural Operators, dens…

MVFormer: Diversifying Feature Normalization and Token Mixing for Efficient Vision Transformers

2024-11-28 · Jongseong Bae, Susang Kim, Minsu Cho, Ha Young Kim

Active research is currently underway to enhance the efficiency of vision transformers (ViTs). Most studies have focused solely on effective token mixers, overlooking the potential relationship with normalization. To boo…

image-classificationImage Classificationobject-detectionObject Detection+2

Mixer-TTS: non-autoregressive, fast and compact text-to-speech model conditioned on language model embeddings

2021-10-07 · Oktai Tatanov, Stanislav Beliaev, Boris Ginsburg

This paper describes Mixer-TTS, a non-autoregressive model for mel-spectrogram generation. The model is based on the MLP-Mixer architecture adapted for speech synthesis. The basic Mixer-TTS contains pitch and duration pr…

Language ModelingLanguage ModellingmodelSpeech Synthesis+2

CAMixerSR: Only Details Need More "Attention"

2024-02-29 · CVPR 2024 1 · Yan Wang, Yi Liu, Shijie Zhao, Junlin Li 외

To satisfy the rapidly increasing demands on the large image (2K-8K) super-resolution (SR), prevailing methods follow two independent tracks: 1) accelerate existing networks by content-aware routing, and 2) design better…

2k8kImage Super-ResolutionSuper-Resolution

PoM: A Linear-Time Replacement for Attention with the Polynomial Mixer

2026-04-07 · David Picard, Nicolas Dufour, Lucas Degeorge, Arijit Ghosh 외 arxiv

This paper introduces the Polynomial Mixer (PoM), a novel token mixing mechanism with linear complexity that serves as a drop-in replacement for self-attention. PoM aggregates input tokens into a compact representation t…

Handwritten Text RecognitionImage GenerationText Generation