paper-with-me

홈 › Papers

Learning to Diversify for Product Question Generation

2022-07-06 · Haggai Roitman, Uriel Singer, Yotam Eshel, Alexander Nus, Eliyahu Kiperwasser

We address the product question generation task. For a given product description, our goal is to generate questions that reflect potential user information needs that are either missing or not well covered in the description. Moreover, we wish to cover diverse user information needs that may span a multitude of product types. To this end, we first show how the T5 pre-trained Transformer encoder-decoder model can be fine-tuned for the task. Yet, while the T5 generated questions have a reasonable quality compared to the state-of-the-art method for the task (KPCNet), many of such questions are still too general, resulting in a sub-optimal global question diversity. As an alternative, we propose a novel learning-to-diversify (LTD) fine-tuning approach that allows to enrich the language learned by the underlying Transformer model. Our empirical evaluation shows that, using our approach significantly improves the global diversity of the underlying Transformer model, while preserves, as much as possible, its generation relevance.

📄 PDF Abstract BibTeX arXiv:2207.02534

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderDiversityQuestion GenerationQuestion-Generation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Gated Linear Unit A Gated Linear Unit, or GLU computes: $$ \mathrm{GLU}(a, b) = a \otimes \sigma(b) $$ It is used in natural language processing architectures, for example the Gated CNN,…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Multi-Head Attention 설명 없음
Residual Connection 설명 없음
SentencePiece 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

Diversifying Question Generation over Knowledge Base via External Natural Questions

2023-09-23 · Shasha Guo, Jing Zhang, Xirui Ke, Cuiping Li 외

Previous methods on knowledge base question generation (KBQG) primarily focus on enhancing the quality of a single generated question. Recognizing the remarkable paraphrasing ability of humans, we contend that diverse te…

DiversityNatural QuestionsQuestion AnsweringQuestion Generation+1

KCS: Diversify Multi-hop Question Generation with Knowledge Composition Sampling

2025-08-28 · Yangfan Wang, Jie Liu, Chen Tang, Lian Yan 외 arxiv

Multi-hop question answering faces substantial challenges due to data sparsity, which increases the likelihood of language models learning spurious patterns. To address this issue, prior research has focused on diversify…

Multi-hop Question AnsweringQuestion GenerationData Augmentation

Diversifying Reply Suggestions using a Matching-Conditional Variational Autoencoder

2019-03-25 · NAACL 2019 6 · Budhaditya Deb, Peter Bailey, Milad Shokouhi

We consider the problem of diversifying automated reply suggestions for a commercial instant-messaging (IM) system (Skype). Our conversation model is a standard matching based information retrieval architecture, which co…

DiversityInformation RetrievalRetrievalVariational Inference

Expanding, Retrieving and Infilling: Diversifying Cross-Domain Question Generation with Flexible Templates

2021-04-01 · EACL 2021 2 · Xiaojing Yu, Anxiao Jiang

Sequence-to-sequence based models have recently shown promising results in generating high-quality questions. However, these models are also known to have main drawbacks such as lack of diversity and bad sentence structu…

DiversityQuestion GenerationQuestion-GenerationSentence

Diversify-verify-adapt: Efficient and Robust Retrieval-Augmented Ambiguous Question Answering

2024-09-04 · Yeonjun In, Sungchul Kim, Ryan A. Rossi, Md Mehrab Tanjim 외

The retrieval augmented generation (RAG) framework addresses an ambiguity in user queries in QA systems by retrieving passages that cover all plausible interpretations and generating comprehensive responses based on the …

Question AnsweringRAGRetrievalRetrieval-augmented Generation