paper-with-me

홈 › Papers

TextGraphs 2020 Shared Task on Multi-Hop Inference for Explanation Regeneration

2020-12-01 · COLING (TextGraphs) 2020 12 · Peter Jansen, Dmitry Ustalov

The 2020 Shared Task on Multi-Hop Inference for Explanation Regeneration tasks participants with regenerating large detailed multi-fact explanations for standardized science exam questions. Given a question, correct answer, and knowledge base, models must rank each fact in the knowledge base such that facts most likely to appear in the explanation are ranked highest. Explanations consist of an average of 6 (and as many as 16) facts that span both core scientific knowledge and world knowledge, and form an explicit lexically-connected “explanation graph” describing how the facts interrelate. In this second iteration of the explanation regeneration shared task, participants are supplied with more than double the training and evaluation data of the first shared task, as well as a knowledge base nearly double in size, both of which expand into more challenging scientific topics that increase the difficulty of the task. In total 10 teams participated, and 5 teams submitted system description papers. The best-performing teams significantly increased state-of-the-art performance both in terms of ranking (mean average precision) and inference speed on this challenge task.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

World Knowledge

Similar Papers 제목 키워드 기반

Red Dragon AI at TextGraphs 2021 Shared Task: Multi-Hop Inference Explanation Regeneration by Matching Expert Ratings

2021-07-27 · Vivek Kalyan, Sam Witteveen, Martin Andrews

Creating explanations for answers to science questions is a challenging task that requires multi-hop inference over a large set of fact sentences. This year, to refocus the Textgraphs Shared Task on the problem of gather…

Retrieval

Textgraphs-15 Shared Task System Description : Multi-Hop Inference Explanation Regeneration by Matching Expert Ratings

2021-06-01 · NAACL (TextGraphs) 2021 6 · Sureshkumar Vivek Kalyan, Sam Witteveen, Martin Andrews

Creating explanations for answers to science questions is a challenging task that requires multi-hop inference over a large set of fact sentences. This year, to refocus the Textgraphs Shared Task on the problem of gather…

Retrieval

ASU at TextGraphs 2019 Shared Task: Explanation ReGeneration using Language Models and Iterative Re-Ranking

2019-09-19 · WS 2019 11 · Pratyay Banerjee

In this work we describe the system from Natural Language Processing group at Arizona State University for the TextGraphs 2019 Shared Task. The task focuses on Explanation Regeneration, an intermediate step towards gener…

Learning-To-RankRe-Ranking

Red Dragon AI at TextGraphs 2020 Shared Task : LIT : LSTM-Interleaved Transformer for Multi-Hop Explanation Ranking

2020-12-01 · COLING (TextGraphs) 2020 12 · Yew Ken Chia, Sam Witteveen, Martin Andrews

Explainable question answering for science questions is a challenging task that requires multi-hop inference over a large set of fact sentences. To counter the limitations of methods that view each query-document pair in…

Question AnsweringRe-Ranking

DeepBlueAI at TextGraphs 2021 Shared Task: Treating Multi-Hop Inference Explanation Regeneration as A Ranking Problem

2021-06-01 · NAACL (TextGraphs) 2021 6 · Chunguang Pan, Bingyan Song, Zhipeng Luo

This paper describes the winning system for TextGraphs 2021 shared task: Multi-hop inference explanation regeneration. Given a question and its corresponding correct answer, this task aims to select the facts that can ex…

Re-RankingTriplet