LiveQA: A Question Answering Dataset over Sports Live
In this paper, we introduce LiveQA, a new question answering dataset constructed from play-by-play live broadcast. It contains 117k multiple-choice questions written by human commentators for over 1,670 NBA games, which are collected from the Chinese Hupu (https://nba.hupu.com/games) website. Derived from the characteristics of sports games, LiveQA can potentially test the reasoning ability across timeline-based live broadcasts, which is challenging compared to the existing datasets. In LiveQA, the questions require understanding the timeline, tracking events or doing mathematical computations. Our preliminary experiments show that the dataset introduces a challenging problem for question answering models, and a strong baseline model only achieves the accuracy of 53.1\% and cannot beat the dominant option rule. We release the code and data of this paper for future research.
Code (2)
Tasks
Multiple-choiceQuestion AnsweringSimilar Papers 제목 키워드 기반
CMU LiveMedQA at TREC 2017 LiveQA: A Consumer Health Question Answering System
In this paper, we present LiveMedQA, a question answering system that is optimized for consumer health question. On top of the general QA system pipeline, we introduce several new features that aim to exploit domain-spec…
Answer GenerationGeneral ClassificationQuestion AnsweringRetrieval+2Integrating UMLS Knowledge into Large Language Models for Medical Question Answering
Large language models (LLMs) have demonstrated powerful text generation capabilities, bringing unprecedented innovation to the healthcare field. While LLMs hold immense promise for applications in healthcare, applying th…
Medical Question AnsweringQuestion AnsweringText GenerationQASports: A Question Answering Dataset about Sports
Sport is one of the most popular and revenue-generating forms of entertainment. Therefore, analyzing data related to this domain introduces several opportunities for Question Answering (QA) systems, such as supporting ta…
Decision MakingQuestion AnsweringSports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sports
Reasoning over sports videos for question answering is an important task with numerous applications, such as player training and information retrieval. However, this task has not been explored due to the lack of relevant…
Action UnderstandingcounterfactualInformation RetrievalQuestion Answering+2A Question-Entailment Approach to Question Answering
One of the challenges in large-scale information retrieval (IR) is to develop fine-grained and domain-specific methods to answer natural language questions. Despite the availability of numerous sources and datasets for a…
Information RetrievalQuestion AnsweringQuestion SimilarityRetrieval