Adapting Pre-trained Language Models for Quantum Natural Language Processing
The emerging classical-quantum transfer learning paradigm has brought a decent performance to quantum computational models in many tasks, such as computer vision, by enabling a combination of quantum models and classical pre-trained neural networks. However, using quantum computing with pre-trained models has yet to be explored in natural language processing (NLP). Due to the high linearity constraints of the underlying quantum computing infrastructures, existing Quantum NLP models are limited in performance on real tasks. We fill this gap by pre-training a sentence state with complex-valued BERT-like architecture, and adapting it to the classical-quantum transfer learning scheme for sentence classification. On quantum simulation experiments, the pre-trained representation can bring 50\% to 60\% increases to the capacity of end-to-end quantum models.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceSentence ClassificationTransfer LearningSimilar Papers 제목 키워드 기반
A Survey of Classical And Quantum Sequence Models
Our primary objective is to conduct a brief survey of various classical and quantum neural net sequence models, which includes self-attention and recurrent neural networks, with a focus on recent quantum approaches propo…
Classificationimage-classificationImage ClassificationSurveyQCSE: A Pretrained Quantum Context-Sensitive Word Embedding for Natural Language Processing
Quantum Natural Language Processing (QNLP) offers a novel approach to encoding and understanding the complexity of natural languages through the power of quantum computation. This paper presents a pretrained quantum cont…
Universal language model with the intervention of quantum theory
This paper examines language modeling based on the theory of quantum mechanics. It focuses on the introduction of quantum mechanics into the symbol-meaning pairs of language in order to build a representation model of na…
Language ModelingLanguage ModellingParametrized Quantum Circuits of Synonymous Sentences in Quantum Natural Language Processing
In this paper, we develop a compositional vector-based semantics of positive transitive sentences in quantum natural language processing for a non-English language, i.e. Persian, to compare the parametrized quantum circu…
SentenceHyper Compressed Fine-Tuning of Large Foundation Models with Quantum Inspired Adapters
Fine-tuning pre-trained large foundation models for specific tasks has become increasingly challenging due to the computational and storage demands associated with full parameter updates. Parameter-Efficient Fine-Tuning …
parameter-efficient fine-tuningQuantum Machine Learning