Expanding, Retrieving and Infilling: Diversifying Cross-Domain Question Generation with Flexible Templates
Sequence-to-sequence based models have recently shown promising results in generating high-quality questions. However, these models are also known to have main drawbacks such as lack of diversity and bad sentence structures. In this paper, we focus on question generation over SQL database and propose a novel framework by expanding, retrieving, and infilling that first incorporates flexible templates with a neural-based model to generate diverse expressions of questions with sentence structure guidance. Furthermore, a new activation/deactivation mechanism is proposed for template-based sequence-to-sequence generation, which learns to discriminate template patterns and content patterns, thus further improves generation quality. We conduct experiments on two large-scale cross-domain datasets. The experiments show that the superiority of our question generation method in producing more diverse questions while maintaining high quality and consistency under both automatic evaluation and human evaluation.
Code (1)
Tasks
DiversityQuestion GenerationQuestion-GenerationSentenceSimilar Papers 제목 키워드 기반
$\textbf{Only-IF}$:Revealing the Decisive Effect of Instruction Diversity on Generalization
Understanding and accurately following instructions is critical for large language models (LLMs) to be effective across diverse tasks. In this work, we rigorously examine the key factors that enable models to generalize …
DiversityInstruction FollowingDiversifying Agent's Behaviors in Interactive Decision Models
Modelling other agents' behaviors plays an important role in decision models for interactions among multiple agents. To optimise its own decisions, a subject agent needs to model what other agents act simultaneously in a…
DiversityEnabling Language Models to Fill in the Blanks
We present a simple approach for text infilling, the task of predicting missing spans of text at any position in a document. While infilling could enable rich functionality especially for writing assistance tools, more a…
Language ModelingLanguage ModellingText InfillingTowards Probabilistically-Sound Beam Search with Masked Language Models
Beam search with masked language models (MLMs) is challenging in part because joint probability distributions over sequences are not readily available, unlike for autoregressive models. However, estimating such distribut…
Ancient Text RestorationText InfillingA Simple yet Effective Framework for Few-Shot Aspect-Based Sentiment Analysis
The pre-training and fine-tuning paradigm has become the mainstream framework in the field of Aspect-Based Sentiment Analysis (ABSA). Although it has achieved sound performance in the domains containing enough fine-grain…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Aspect Term Extraction and Sentiment ClassificationSentiment Analysis+2