paper-with-me

홈 › Papers

MK-SQuIT: Synthesizing Questions using Iterative Template-filling

2020-11-04 · Benjamin A. Spiegel, Vincent Cheong, James E. Kaplan, Anthony Sanchez

The aim of this work is to create a framework for synthetically generating question/query pairs with as little human input as possible. These datasets can be used to train machine translation systems to convert natural language questions into queries, a useful tool that could allow for more natural access to database information. Existing methods of dataset generation require human input that scales linearly with the size of the dataset, resulting in small datasets. Aside from a short initial configuration task, no human input is required during the query generation process of our system. We leverage WikiData, a knowledge base of RDF triples, as a source for generating the main content of questions and queries. Using multiple layers of question templating we are able to sidestep some of the most challenging parts of query generation that have been handled by humans in previous methods; humans never have to modify, aggregate, inspect, annotate, or generate any questions or queries at any step in the process. Our system is easily configurable to multiple domains and can be modified to generate queries in natural languages other than English. We also present an example dataset of 110,000 question/query pairs across four WikiData domains. We then present a baseline model that we train using the dataset which shows promise in a commercial QA setting.

📄 PDF Abstract BibTeX arXiv:2011.02566

Code (1)

MeetKai/MK-SQuIT 공식 구현

Tasks

Dataset GenerationMachine Translation

Similar Papers 제목 키워드 기반

Expanding, Retrieving and Infilling: Diversifying Cross-Domain Question Generation with Flexible Templates

2021-04-01 · EACL 2021 2 · Xiaojing Yu, Anxiao Jiang

Sequence-to-sequence based models have recently shown promising results in generating high-quality questions. However, these models are also known to have main drawbacks such as lack of diversity and bad sentence structu…

DiversityQuestion GenerationQuestion-GenerationSentence

On Event Individuation for Document-Level Information Extraction

2022-12-19 · William Gantt, Reno Kriz, Yunmo Chen, Siddharth Vashishtha 외

As information extraction (IE) systems have grown more adept at processing whole documents, the classic task of template filling has seen renewed interest as benchmark for document-level IE. In this position paper, we ca…

Position

MultiMUC: Multilingual Template Filling on MUC-4

2024-01-29 · William Gantt, Shabnam Behzad, Hannah Youngeun An, Yunmo Chen 외

We introduce MultiMUC, the first multilingual parallel corpus for template filling, comprising translations of the classic MUC-4 template filling benchmark into five languages: Arabic, Chinese, Farsi, Korean, and Russian…

Machine TranslationTranslation

Macaron: Controlled, Human-Written Benchmark for Multilingual and Multicultural Reasoning via Template-Filling

2026-02-11 · Alaa Elsetohy, Sama Hadhoud, Haryo Akbarianto Wibowo, Chenxi Whitehouse 외 arxiv

Multilingual benchmarks rarely test reasoning over culturally grounded premises: translated datasets keep English-centric scenarios, while culture-first datasets often lack control over the reasoning required. We propose…

A Dataset for Cross-Domain Reasoning via Template Filling

2022-01-16 · ACL ARR January 2022 1 · Anonymous

While several benchmarks exist for reasoning tasks, reasoning across domains is an under-explored area in NLP. Towards this, we present a dataset and a prompt-template-filling approach to enable sequence to sequence mode…

Decoder