Exploring Multitask Learning for Low-Resource AbstractiveSummarization
This paper explores the effect of using multitask learning for abstractive summarization in the context of small training corpora. In particular, we incorporate four different tasks (extractive summarization, language modeling, concept detection, and paraphrase detection) both individually and in combination, with the goal of enhancing the target task of abstractive summarization via multitask learning. We show that for many task combinations, a model trained in a multitask setting outperforms a model trained only for abstractive summarization, with no additional summarization data introduced. Additionally, we do a comprehensive search and find that certain tasks (e.g. paraphrase detection) consistently benefit abstractive summarization, not only when combined with other tasks but also when using different architectures and training corpora.
Code (0)
등록된 구현이 없습니다.
Tasks
Abstractive Text SummarizationExtractive SummarizationLanguage ModelingLanguage ModellingSimilar Papers 제목 키워드 기반
Exploring Multitask Learning for Low-Resource Abstractive Summarization
This paper explores the effect of using multitask learning for abstractive summarization in the context of small training corpora. In particular, we incorporate four different tasks (extractive summarization, language mo…
Abstractive Text SummarizationExtractive SummarizationLanguage ModelingLanguage ModellingBusiness Process Simulation: Probabilistic Modeling of Intermittent Resource Availability and Multitasking Behavior
In business process simulation, resource availability is typically modeled by assigning a calendar to each resource, e.g., Monday-Friday, 9:00-18:00. Resources are assumed to be always available during each time slot in …
Hierarchical Multitask Learning for CTC-based Speech Recognition
Previous work has shown that neural encoder-decoder speech recognition can be improved with hierarchical multitask learning, where auxiliary tasks are added at intermediate layers of a deep encoder. We explore the effect…
Decoderspeech-recognitionSpeech RecognitionPolySpeech: Exploring Unified Multitask Speech Models for Competitiveness with Single-task Models
Recently, there have been attempts to integrate various speech processing tasks into a unified model. However, few previous works directly demonstrated that joint optimization of diverse tasks in multitask speech models …
Language ModelingLanguage Modellingspeech-recognitionSpeech Recognition+1Gradient Masters at BLP-2025 Task 1: Advancing Low-Resource NLP for Bengali using Ensemble-Based Adversarial Training for Hate Speech Detection
This paper introduces the approach of "Gradient Masters" for BLP-2025 Task 1: "Bangla Multitask Hate Speech Identification Shared Task". We present an ensemble-based fine-tuning strategy for addressing subtasks 1A (hate-…
Hate Speech Detection