paper-with-me

Papers

Multi-source Meta Transfer for Low Resource Multiple-Choice Question Answering

2020-07-01 · ACL 2020 6 · Ming Yan, Hao Zhang, Di Jin, Joey Tianyi Zhou

Multiple-choice question answering (MCQA) is one of the most challenging tasks in machine reading comprehension since it requires more advanced reading comprehension skills such as logical reasoning, summarization, and arithmetic operations. Unfortunately, most existing MCQA datasets are small in size, which increases the difficulty of model learning and generalization. To address this challenge, we propose a multi-source meta transfer (MMT) for low-resource MCQA. In this framework, we first extend meta learning by incorporating multiple training sources to learn a generalized feature representation across domains. To bridge the distribution gap between training sources and the target, we further introduce the meta transfer that can be integrated into the multi-source meta training. More importantly, the proposed MMT is independent of backbone language models. Extensive experiments demonstrate the superiority of MMT over state-of-the-arts, and continuous improvements can be achieved on different backbone networks on both supervised and unsupervised domain adaptation settings.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationLogical ReasoningMachine Reading ComprehensionMeta-LearningMultiple-choiceMultiple Choice Question Answering (MCQA)Question AnsweringReading ComprehensionUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

MetaXLR -- Mixed Language Meta Representation Transformation for Low-resource Cross-lingual Learning based on Multi-Armed Bandit

2023-05-31 · Liat Bezalel, Eyal Orgad

Transfer learning for extremely low resource languages is a challenging task as there is no large scale monolingual corpora for pre training or sufficient annotated data for fine tuning. We follow the work of MetaXL whic…

Meta-LearningNERTransfer Learning

Low Resource Style Transfer via Domain Adaptive Meta Learning

2022-05-25 · NAACL 2022 7 · Xiangyang Li, Xiang Long, Yu Xia, Sujian Li

Text style transfer (TST) without parallel data has achieved some practical success. However, most of the existing unsupervised text style transfer methods suffer from (i) requiring massive amounts of non-parallel data t…

General KnowledgeLanguage ModelingLanguage ModellingMeta-Learning+3

Meta-RTL: Reinforcement-Based Meta-Transfer Learning for Low-Resource Commonsense Reasoning

2024-09-27 · Yu Fu, Jie He, Yifan Yang, Qun Liu 외

Meta learning has been widely used to exploit rich-resource source tasks to improve the performance of low-resource target tasks. Unfortunately, most existing meta learning approaches treat different source tasks equally…

Meta-LearningTransfer Learning

Enhanced Meta-Learning for Cross-lingual Named Entity Recognition with Minimal Resources

2019-11-14 · Qianhui Wu, Zijia Lin, Guoxin Wang, Hui Chen 외

For languages with no annotated resources, transferring knowledge from rich-resource languages is an effective solution for named entity recognition (NER). While all existing methods directly transfer from source-learned…

Cross-Lingual NERCross-Lingual TransferMeta-Learningnamed-entity-recognition+4

MetaXL: Meta Representation Transformation for Low-resource Cross-lingual Learning

2021-04-16 · NAACL 2021 4 · Mengzhou Xia, Guoqing Zheng, Subhabrata Mukherjee, Milad Shokouhi 외

The combination of multilingual pre-trained representations and cross-lingual transfer learning is one of the most effective methods for building functional NLP systems for low-resource languages. However, for extremely …

Cross-Lingual TransferMeta-Learningnamed-entity-recognitionNamed Entity Recognition+3