paper-with-me

Papers

Learning to Focus when Ranking Answers

2018-08-08 · Dana Sagi, Tzoof Avny, Kira Radinsky, Eugene Agichtein

One of the main challenges in ranking is embedding the query and document pairs into a joint feature space, which can then be fed to a learning-to-rank algorithm. To achieve this representation, the conventional state of the art approaches perform extensive feature engineering that encode the similarity of the query-answer pair. Recently, deep-learning solutions have shown that it is possible to achieve comparable performance, in some settings, by learning the similarity representation directly from data. Unfortunately, previous models perform poorly on longer texts, or on texts with significant portion of irrelevant information, or which are grammatically incorrect. To overcome these limitations, we propose a novel ranking algorithm for question answering, QARAT, which uses an attention mechanism to learn on which words and phrases to focus when building the mutual representation. We demonstrate superior ranking performance on several real-world question-answer ranking datasets, and provide visualization of the attention mechanism to otter more insights into how our models of attention could benefit ranking for difficult question answering challenges.

📄 PDF Abstract BibTeX arXiv:1808.02724

Code (0)

등록된 구현이 없습니다.

Tasks

Feature EngineeringLearning-To-RankQuestion Answering

Similar Papers 제목 키워드 기반

Diverse and Non-redundant Answer Set Extraction on Community QA based on DPPs

2020-11-18 · COLING 2020 8 · Shogo Fujita, Tomohide Shibata, Manabu Okumura

In community-based question answering (CQA) platforms, it takes time for a user to get useful information from among many answers. Although one solution is an answer ranking method, the user still needs to read through t…

Point ProcessesQuestion Answering

Ranking Distillation for Open-Ended Video Question Answering with Insufficient Labels

2024-03-21 · CVPR 2024 1 · Tianming Liang, Chaolei Tan, Beihao Xia, Wei-Shi Zheng 외

This paper focuses on open-ended video question answering, which aims to find the correct answers from a large answer set in response to a video-related question. This is essentially a multi-label classification task, si…

Multi-Label ClassificationMUlTI-LABEL-ClASSIFICATIONQuestion AnsweringVideo Question Answering

Training Curricula for Open Domain Answer Re-Ranking

2020-04-29 · Sean MacAvaney, Franco Maria Nardini, Raffaele Perego, Nicola Tonellotto 외

In precision-oriented tasks like answer ranking, it is more important to rank many relevant answers highly than to retrieve all relevant answers. It follows that a good ranking strategy would be to learn how to identify …

Re-Ranking

Aggregation of pairwise comparisons with reduction of biases

2019-06-09 · Nadezhda Bugakova, Valentina Fedorova, Gleb Gusev, Alexey Drutsa

We study the problem of ranking from crowdsourced pairwise comparisons. Answers to pairwise tasks are known to be affected by the position of items on the screen, however, previous models for aggregation of pairwise comp…

Position

Ranking Generated Answers: On the Agreement of Retrieval Models with Humans on Consumer Health Questions

2024-08-19 · Sebastian Heineking, Jonas Probst, Daniel Steinbach, Martin Potthast 외

Evaluating the output of generative large language models (LLMs) is challenging and difficult to scale. Many evaluations of LLMs focus on tasks such as single-choice question-answering or text classification. These tasks…

Open-Ended Question AnsweringQuestion AnsweringRetrievalSingle Choice Question+2