paper-with-me

홈 › Papers

Stronger Transformers for Neural Multi-Hop Question Generation

2020-10-22 · Devendra Singh Sachan, Lingfei Wu, Mrinmaya Sachan, William Hamilton

Prior work on automated question generation has almost exclusively focused on generating simple questions whose answers can be extracted from a single document. However, there is an increasing interest in developing systems that are capable of more complex multi-hop question generation, where answering the questions requires reasoning over multiple documents. In this work, we introduce a series of strong transformer models for multi-hop question generation, including a graph-augmented transformer that leverages relations between entities in the text. While prior work has emphasized the importance of graph-based models, we show that we can substantially outperform the state-of-the-art by 5 BLEU points using a standard transformer architecture. We further demonstrate that graph-based augmentations can provide complimentary improvements on top of this foundation. Interestingly, we find that several important factors--such as the inclusion of an auxiliary contrastive objective and data filtering could have larger impacts on performance. We hope that our stronger baselines and analysis provide a constructive foundation for future work in this area.

📄 PDF Abstract BibTeX arXiv:2010.11374

Code (0)

등록된 구현이 없습니다.

Tasks

Question GenerationQuestion-Generation

Similar Papers 제목 키워드 기반

WBI at MEDIQA 2021: Summarizing Consumer Health Questions with Generative Transformers

2021-06-01 · NAACL (BioNLP) 2021 6 · Mario Sänger, Leon Weber, Ulf Leser

This paper describes our contribution for the MEDIQA-2021 Task 1 question summarization competition. We model the task as conditional generation problem. Our concrete pipeline performs a finetuning of the large pretraine…

Entity Embeddings

A task in a suit and a tie: paraphrase generation with semantic augmentation

2018-10-31 · Su Wang, Rahul Gupta, Nancy Chang, Jason Baldridge

Paraphrasing is rooted in semantics. We show the effectiveness of transformers (Vaswani et al. 2017) for paraphrase generation and further improvements by incorporating PropBank labels via a multi-encoder. Evaluating on …

Paraphrase Generation

The Counterattack of CNNs in Self-Supervised Learning: Larger Kernel Size might be All You Need

2023-12-09 · Tianjin Huang, Tianlong Chen, Zhangyang Wang, Shiwei Liu

Vision Transformers have been rapidly uprising in computer vision thanks to their outstanding scaling trends, and gradually replacing convolutional neural networks (CNNs). Recent works on self-supervised learning (SSL) i…

AllSelf-Supervised Learning

Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiT

2024-06-05 · Le Zhuo, Ruoyi Du, Han Xiao, Yangguang Li 외

Lumina-T2X is a nascent family of Flow-based Large Diffusion Transformers that establishes a unified framework for transforming noise into various modalities, such as images and videos, conditioned on text instructions. …

Image GenerationPoint Cloud GenerationText to Image GenerationText-to-Image Generation

Question Generation by Transformers

2019-09-09 · Kettip Kriangchaivech, Artit Wangperawong

A machine learning model was developed to automatically generate questions from Wikipedia passages using transformers, an attention-based model eschewing the paradigm of existing recurrent neural networks (RNNs). The mod…

ArticlesQuestion AnsweringQuestion GenerationQuestion-Generation+1