Hybrid Quantum Transformer for Language Generation
Although quantum computing has been increasingly applied to replace classical computation, most existing quantum or hybrid models remain confined to simple tasks, with no successful application to large-scale natural language generation to date. In this work, we present the first hybrid quantum-classical large language model (LLM) for natural language generation, HyQuT, capable of performing coherent and context-aware dialogue. The proposed architecture integrates variational quantum circuits (VQCs) into the Transformer framework at both 8M and 150M parameter scales. Experimental results show that a minimal number of qubits (10 qubits with 80 quantum gates) can replace about 10% of the classical parameters in the 150M-parameter model, while achieving comparable convergence stability and generation quality. This study provides an early demonstration of the feasibility of integrating quantum computing to large-scale generative language models.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Quantum-Enhanced Natural Language Generation: A Multi-Model Framework with Hybrid Quantum-Classical Architectures
This paper presents a comprehensive evaluation of quantum text generation models against traditional Transformer/MLP architectures, addressing the growing interest in quantum computing applications for natural language p…
Text GenerationQuantum-Enhanced Attention Mechanism in NLP: A Hybrid Classical-Quantum Approach
Transformer-based models have achieved remarkable results in natural language processing (NLP) tasks such as text classification and machine translation. However, their computational complexity and resource demands pose …
Computational EfficiencyMachine Translationtext-classificationText ClassificationQuantum Attention for Vision Transformers in High Energy Physics
We present a novel hybrid quantum-classical vision transformer architecture incorporating quantum orthogonal neural networks (QONNs) to enhance performance and computational efficiency in high-energy physics applications…
Computational EfficiencyGenerative quantum combinatorial optimization by means of a novel conditional generative quantum eigensolver
Quantum computing is entering a transformative phase with the emergence of logical quantum processors, which hold the potential to tackle complex problems beyond classical capabilities. While significant progress has bee…
Combinatorial OptimizationDecoderQuantum Circuit GenerationHybrid Quantum Vision Transformers for Event Classification in High Energy Physics
Models based on vision transformer architectures are considered state-of-the-art when it comes to image classification tasks. However, they require extensive computational resources both for training and deployment. The …
image-classificationImage Classification