Semantic Answer Type Prediction using BERT: IAI at the ISWC SMART Task 2020
This paper summarizes our participation in the SMART Task of the ISWC 2020 Challenge. A particular question we are interested in answering is how well neural methods, and specifically transformer models, such as BERT, perform on the answer type prediction task compared to traditional approaches. Our main finding is that coarse-grained answer types can be identified effectively with standard text classification methods, with over 95% accuracy, and BERT can bring only marginal improvements. For fine-grained type detection, on the other hand, BERT clearly outperforms previous retrieval-based approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Retrievaltext-classificationText ClassificationType predictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SeMantic AnsweR Type prediction task (SMART) at ISWC 2020 Semantic Web Challenge
Each year the International Semantic Web Conference accepts a set of Semantic Web Challenges to establish competitions that will advance the state of the art solutions in any given problem domain. The SeMantic AnsweR Typ…
Knowledge Base Question AnsweringPredictionQuestion AnsweringType prediction+1Semantic Answer Type and Relation Prediction Task (SMART 2021)
Each year the International Semantic Web Conference organizes a set of Semantic Web Challenges to establish competitions that will advance state-of-the-art solutions in some problem domains. The Semantic Answer Type and …
Knowledge Base Question AnsweringPredictionQuestion AnsweringRelation+3Integrating SPARQL and LLMs for Question Answering over Scholarly Data Sources
The Scholarly Hybrid Question Answering over Linked Data (QALD) Challenge at the International Semantic Web Conference (ISWC) 2024 focuses on Question Answering (QA) over diverse scholarly sources: DBLP, SemOpenAlex, and…
Extractive Question-AnsweringQuestion AnsweringExtreme Classification for Answer Type Prediction in Question Answering
Semantic answer type prediction (SMART) is known to be a useful step towards effective question answering (QA) systems. The SMART task involves predicting the top-$k$ knowledge graph (KG) types for a given natural langua…
ClassificationClusteringExtreme Multi-Label ClassificationMulti-Label Classification+5PSYCHIC: A Neuro-Symbolic Framework for Knowledge Graph Question-Answering Grounding
The Scholarly Question Answering over Linked Data (Scholarly QALD) at The International Semantic Web Conference (ISWC) 2023 challenge presents two sub-tasks to tackle question answering (QA) over knowledge graphs (KGs). …
Entity LinkingGraph Question AnsweringKnowledge GraphsQuestion Answering