paper-with-me

Papers

Multi-Task and Multi-Corpora Training Strategies to Enhance Argumentative Sentence Linking Performance

2021-09-27 · EMNLP (ArgMining) 2021 11 · Jan Wira Gotama Putra, Simone Teufel, Takenobu Tokunaga

Argumentative structure prediction aims to establish links between textual units and label the relationship between them, forming a structured representation for a given input text. The former task, linking, has been identified by earlier works as particularly challenging, as it requires finding the most appropriate structure out of a very large search space of possible link combinations. In this paper, we improve a state-of-the-art linking model by using multi-task and multi-corpora training strategies. Our auxiliary tasks help the model to learn the role of each sentence in the argumentative structure. Combining multi-corpora training with a selective sampling strategy increases the training data size while ensuring that the model still learns the desired target distribution well. Experiments on essays written by English-as-a-foreign-language learners show that both strategies significantly improve the model's performance; for instance, we observe a 15.8% increase in the F1-macro for individual link predictions.

📄 PDF Abstract BibTeX arXiv:2109.13067

Code (1)

wiragotama/argmin2021 공식 구현 pytorch

Tasks

Sentence

Similar Papers 제목 키워드 기반

Adaptive Multi-Corpora Language Model Training for Speech Recognition

2022-11-09 · Yingyi Ma, Zhe Liu, Xuedong Zhang

Neural network language model (NNLM) plays an essential role in automatic speech recognition (ASR) systems, especially in adaptation tasks when text-only data is available. In practice, an NNLM is typically trained on a …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Domain AdaptationLanguage Modeling+3

A Recipe of Parallel Corpora Exploitation for Multilingual Large Language Models

2024-06-29 · Peiqin Lin, André F. T. Martins, Hinrich Schütze

Recent studies have highlighted the potential of exploiting parallel corpora to enhance multilingual large language models, improving performance in both bilingual tasks, e.g., machine translation, and general-purpose ta…

Language IdentificationMachine TranslationSentencetext-classification+2

BERT-based Acronym Disambiguation with Multiple Training Strategies

2021-02-25 · Chunguang Pan, Bingyan Song, Shengguang Wang, Zhipeng Luo

Acronym disambiguation (AD) task aims to find the correct expansions of an ambiguous ancronym in a given sentence. Although it is convenient to use acronyms, sometimes they could be difficult to understand. Identifying t…

Binary ClassificationSentenceTask 2

Efficient Incorporation of Multiple Latency Targets in the Once-For-All Network

2020-12-12 · Vidhur Kumar, Andrew Szidon

Neural Architecture Search has proven an effective method of automating architecture engineering. Recent work in the field has been to look for architectures subject to multiple objectives such as accuracy and latency to…

AllNetwork PruningNeural Architecture Search

TA-MAMC at SemEval-2021 Task 4: Task-adaptive Pretraining and Multi-head Attention for Abstract Meaning Reading Comprehension

2021-08-01 · SEMEVAL 2021 · Jing Zhang, Yimeng Zhuang, Yinpei Su

This paper describes our system used in the SemEval-2021 Task4 Reading Comprehension of Abstract Meaning, achieving 1st for subtask 1 and 2nd for subtask 2 on the leaderboard. We propose an ensemble of ELECTRA-based mode…

Contrastive LearningMultiple-choiceReading ComprehensionTask 2