When BERT Meets Quantum Temporal Convolution Learning for Text Classification in Heterogeneous Computing
The rapid development of quantum computing has demonstrated many unique characteristics of quantum advantages, such as richer feature representation and more secured protection on model parameters. This work proposes a vertical federated learning architecture based on variational quantum circuits to demonstrate the competitive performance of a quantum-enhanced pre-trained BERT model for text classification. In particular, our proposed hybrid classical-quantum model consists of a novel random quantum temporal convolution (QTC) learning framework replacing some layers in the BERT-based decoder. Our experiments on intent classification show that our proposed BERT-QTC model attains competitive experimental results in the Snips and ATIS spoken language datasets. Particularly, the BERT-QTC boosts the performance of the existing quantum circuit-based language model in two text classification datasets by 1.57% and 1.52% relative improvements. Furthermore, BERT-QTC can be feasibly deployed on both existing commercial-accessible quantum computation hardware and CPU-based interface for ensuring data isolation.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationCPUDecoderFederated Learningintent-classificationIntent ClassificationLanguage ModelingLanguage Modellingtext-classificationText ClassificationVertical Federated LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
When Federated Learning Meets Quantum Computing: Survey and Research Opportunities
Quantum Federated Learning (QFL) is an emerging field that harnesses advances in Quantum Computing (QC) to improve the scalability and efficiency of decentralized Federated Learning (FL) models. This paper provides a sys…
Federated LearningPhysics-informed time series analysis with Kolmogorov-Arnold Networks under Ehrenfest constraints
The prediction of quantum dynamical responses lies at the heart of modern physics. Yet, modeling these time-dependent behaviors remains a formidable challenge because quantum systems evolve in high-dimensional Hilbert sp…
Time Series AnalysisMultilingual Machine Translation with Quantum Encoder Decoder Attention-based Convolutional Variational Circuits
Cloud-based multilingual translation services like Google Translate and Microsoft Translator achieve state-of-the-art translation capabilities. These services inherently use large multilingual language models such as GRU…
DecoderMachine TranslationTranslationHybrid Quantum Temporal Convolutional Networks
Quantum machine learning models for sequential data face scalability challenges with complex multivariate signals. We introduce the Hybrid Quantum Temporal Convolutional Network (HQTCN), which combines classical temporal…
Quantum Machine LearningQuantum Temporal Convolutional Neural Networks for Cross-Sectional Equity Return Prediction: A Comparative Benchmark Study
Quantum machine learning offers a promising pathway for enhancing stock market prediction, particularly under complex, noisy, and highly dynamic financial environments. However, many classical forecasting models struggle…
Quantum Machine LearningStock Market Prediction