paper-with-me

홈 › Papers

Quantum Transfer Learning for Acceptability Judgements

2024-01-15 · Giuseppe Buonaiuto, Raffaele Guarasci, Aniello Minutolo, Giuseppe De Pietro, Massimo Esposito

Hybrid quantum-classical classifiers promise to positively impact critical aspects of natural language processing tasks, particularly classification-related ones. Among the possibilities currently investigated, quantum transfer learning, i.e., using a quantum circuit for fine-tuning pre-trained classical models for a specific task, is attracting significant attention as a potential platform for proving quantum advantage. This work shows potential advantages, both in terms of performance and expressiveness, of quantum transfer learning algorithms trained on embedding vectors extracted from a large language model to perform classification on a classical Linguistics task: acceptability judgments. Acceptability judgment is the ability to determine whether a sentence is considered natural and well-formed by a native speaker. The approach has been tested on sentences extracted from ItaCoLa, a corpus that collects Italian sentences labeled with their acceptability judgment. The evaluation phase shows results for the quantum transfer learning pipeline comparable to state-of-the-art classical transfer learning algorithms, proving current quantum computers' capabilities to tackle NLP tasks for ready-to-use applications. Furthermore, a qualitative linguistic analysis, aided by explainable AI methods, reveals the capabilities of quantum transfer learning algorithms to correctly classify complex and more structured sentences, compared to their classical counterpart. This finding sets the ground for a quantifiable quantum advantage in NLP in the near future.

📄 PDF Abstract BibTeX arXiv:2401.07777

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModellingLarge Language ModelSentenceTransfer Learning

Similar Papers 제목 키워드 기반

The Influence of Context on Sentence Acceptability Judgements

2018-07-01 · ACL 2018 7 · Jean-Philippe Bernardy, Shalom Lappin, Jey Han Lau

We investigate the influence that document context exerts on human acceptability judgements for English sentences, via two sets of experiments. The first compares ratings for sentences presented on their own with ratings…

Language ModelingLanguage ModellingMachine TranslationSentence+1

Revisiting Acceptability Judgements

2023-05-23 · Hai Hu, Ziyin Zhang, Weifang Huang, Jackie Yan-Ki Lai 외

In this work, we revisit linguistic acceptability in the context of large language models. We introduce CoLAC - Corpus of Linguistic Acceptability in Chinese, the first large-scale acceptability dataset for a non-Indo-Eu…

Cross-Lingual TransferLinguistic Acceptability

MELA: Multilingual Evaluation of Linguistic Acceptability

2023-11-15 · Ziyin Zhang, Yikang Liu, Weifang Huang, Junyu Mao 외

In this work, we present the largest benchmark to date on linguistic acceptability: Multilingual Evaluation of Linguistic Acceptability -- MELA, with 46K samples covering 10 languages from a diverse set of language famil…

Code GenerationCross-Lingual TransferLinguistic AcceptabilityMulti-Task Learning+1

From Human Judgements to Predictive Models: Unravelling Acceptability in Code-Mixed Sentences

2024-05-09 · Prashant Kodali, Anmol Goel, Likhith Asapu, Vamshi Krishna Bonagiri 외

Current computational approaches for analysing or generating code-mixed sentences do not explicitly model ``naturalness'' or ``acceptability'' of code-mixed sentences, but rely on training corpora to reflect distribution…

Decoder

Human acceptability judgements for extractive sentence compression

2019-02-01 · Abram Handler, Brian Dillon, Brendan O'Connor

Recent approaches to English-language sentence compression rely on parallel corpora consisting of sentence-compression pairs. However, a sentence may be shortened in many different ways, which each might be suited to the…

SentenceSentence Compression