Semantic Answer Type and Relation Prediction Task (SMART 2021)
Each year the International Semantic Web Conference organizes a set of Semantic Web Challenges to establish competitions that will advance state-of-the-art solutions in some problem domains. The Semantic Answer Type and Relation Prediction Task (SMART) task is one of the ISWC 2021 Semantic Web challenges. This is the second year of the challenge after a successful SMART 2020 at ISWC 2020. This year's version focuses on two sub-tasks that are very important to Knowledge Base Question Answering (KBQA): Answer Type Prediction and Relation Prediction. Question type and answer type prediction can play a key role in knowledge base question answering systems providing insights about the expected answer that are helpful to generate correct queries or rank the answer candidates. More concretely, given a question in natural language, the first task is, to predict the answer type using a target ontology (e.g., DBpedia or Wikidata. Similarly, the second task is to identify relations in the natural language query and link them to the relations in a target ontology. This paper discusses the task descriptions, benchmark datasets, and evaluation metrics. For more information, please visit https://smart-task.github.io/2021/.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge Base Question AnsweringPredictionQuestion AnsweringRelationRelation PredictionType predictionVocal Bursts Type PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SeMantic AnsweR Type prediction task (SMART) at ISWC 2020 Semantic Web Challenge
Each year the International Semantic Web Conference accepts a set of Semantic Web Challenges to establish competitions that will advance the state of the art solutions in any given problem domain. The SeMantic AnsweR Typ…
Knowledge Base Question AnsweringPredictionQuestion AnsweringType prediction+1Type-based Neural Link Prediction Adapter for Complex Query Answering
Answering complex logical queries on incomplete knowledge graphs (KGs) is a fundamental and challenging task in multi-hop reasoning. Recent work defines this task as an end-to-end optimization problem, which significantl…
Complex Query AnsweringKnowledge GraphsLink PredictionVisual Question Answering with Prior Class Semantics
We present a novel mechanism to embed prior knowledge in a model for visual question answering. The open-set nature of the task is at odds with the ubiquitous approach of training of a fixed classifier. We show how to ex…
Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)Word EmbeddingsExtreme Classification for Answer Type Prediction in Question Answering
Semantic answer type prediction (SMART) is known to be a useful step towards effective question answering (QA) systems. The SMART task involves predicting the top-$k$ knowledge graph (KG) types for a given natural langua…
ClassificationClusteringExtreme Multi-Label ClassificationMulti-Label Classification+5Type Prediction Systems
Inferring semantic types for entity mentions within text documents is an important asset for many downstream NLP tasks, such as Semantic Role Labelling, Entity Disambiguation, Knowledge Base Question Answering, etc. Prio…
Entity DisambiguationKnowledge Base Question AnsweringPredictionQuestion Answering+2