Multi-Task Learning with Language Modeling for Question Generation
This paper explores the task of answer-aware questions generation. Based on the attention-based pointer generator model, we propose to incorporate an auxiliary task of language modeling to help question generation in a hierarchical multi-task learning structure. Our joint-learning model enables the encoder to learn a better representation of the input sequence, which will guide the decoder to generate more coherent and fluent questions. On both SQuAD and MARCO datasets, our multi-task learning model boosts the performance, achieving state-of-the-art results. Moreover, human evaluation further proves the high quality of our generated questions.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderLanguage ModelingLanguage ModellingMulti-Task LearningQuestion GenerationQuestion-GenerationSimilar Papers 제목 키워드 기반
QURIOUS: Question Generation Pretraining for Text Generation
Recent trends in natural language processing using pretraining have shifted focus towards pretraining and fine-tuning approaches for text generation. Often the focus has been on task-agnostic approaches that generalize t…
Abstractive Text SummarizationLanguage ModelingLanguage ModellingQuestion Generation+2Unified Language Model Pre-training for Natural Language Understanding and Generation
This paper presents a new Unified pre-trained Language Model (UniLM) that can be fine-tuned for both natural language understanding and generation tasks. The model is pre-trained using three types of language modeling ta…
Abstractive Text SummarizationDocument SummarizationGenerative Question AnsweringLanguage Modeling+8Modeling Complex Event Scenarios via Simple Entity-focused Questions
Event scenarios are often complex and involve multiple event sequences connected through different entity participants. Exploring such complex scenarios requires an ability to branch through different sequences, somethin…
Language ModelingLanguage ModellingDual Diffusion for Unified Image Generation and Understanding
Diffusion models have gained tremendous success in text-to-image generation, yet still lag behind with visual understanding tasks, an area dominated by autoregressive vision-language models. We propose a large-scale and …
Image GenerationLanguage ModelingLanguage ModellingQuestion Answering+3Unifying Vision-and-Language Tasks via Text Generation
Existing methods for vision-and-language learning typically require designing task-specific architectures and objectives for each task. For example, a multi-label answer classifier for visual question answering, a region…
Conditional Text GenerationDecoderImage CaptioningLanguage Modeling+9