paper-with-me

홈 › Papers

MIX : a Multi-task Learning Approach to Solve Open-Domain Question Answering

2020-12-17 · Sofian Chaybouti, Achraf Saghe, Aymen Shabou

In this paper, we introduce MIX : a multi-task deep learning approach to solve Open-Domain Question Answering. First, we design our system as a multi-stage pipeline made of 3 building blocks : a BM25-based Retriever, to reduce the search space; RoBERTa based Scorer and Extractor, to rank retrieved paragraphs and extract relevant spans of text respectively. Eventually, we further improve computational efficiency of our system to deal with the scalability challenge : thanks to multi-task learning, we parallelize the close tasks solved by the Scorer and the Extractor. Our system is on par with state-of-the-art performances on the squad-open benchmark while being simpler conceptually.

📄 PDF Abstract BibTeX arXiv:2012.09766

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyMulti-Task LearningOpen-Domain Question AnsweringQuestion Answering

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
WordPiece 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Adam 설명 없음
Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

AmbigQA: Answering Ambiguous Open-domain Questions

2020-04-22 · EMNLP 2020 11 · Sewon Min, Julian Michael, Hannaneh Hajishirzi, Luke Zettlemoyer

Ambiguity is inherent to open-domain question answering; especially when exploring new topics, it can be difficult to ask questions that have a single, unambiguous answer. In this paper, we introduce AmbigQA, a new open-…

Open-Domain Question AnsweringQuestion AnsweringWeakly-supervised Learning

Ask To The Point: Open-Domain Entity-Centric Question Generation

2023-10-21 · Yuxiang Liu, Jie Huang, Kevin Chen-Chuan Chang

We introduce a new task called *entity-centric question generation* (ECQG), motivated by real-world applications such as topic-specific learning, assisted reading, and fact-checking. The task aims to generate questions f…

Fact CheckingQuestion GenerationQuestion-Generation

Answering Ambiguous Questions through Generative Evidence Fusion and Round-Trip Prediction

2020-11-26 · ACL 2021 5 · Yifan Gao, Henghui Zhu, Patrick Ng, Cicero Nogueira dos santos 외

In open-domain question answering, questions are highly likely to be ambiguous because users may not know the scope of relevant topics when formulating them. Therefore, a system needs to find possible interpretations of …

Open-Domain Question AnsweringQuestion AnsweringTriviaQA

OpenBioRQ: Unsolved Biomedical Research Questions for Agents

2026-06-20 · Minbyul Jeong arxiv

A working citation looks like proof -- but the fact that a link resolves does not mean the cited paper supports the claim. I find that current agentic models rarely fabricate citations (over $99\%$ resolve), yet roughly …

Simple yet Effective Bridge Reasoning for Open-Domain Multi-Hop Question Answering

2019-09-17 · WS 2019 11 · Wenhan Xiong, Mo Yu, Xiaoxiao Guo, Hong Wang 외

A key challenge of multi-hop question answering (QA) in the open-domain setting is to accurately retrieve the supporting passages from a large corpus. Existing work on open-domain QA typically relies on off-the-shelf inf…

Information RetrievalMulti-hop Question AnsweringQuestion AnsweringReading Comprehension+1