paper-with-me

홈 › Papers

Semantic Answer Type Prediction using BERT: IAI at the ISWC SMART Task 2020

2021-09-14 · Vinay Setty, Krisztian Balog

This paper summarizes our participation in the SMART Task of the ISWC 2020 Challenge. A particular question we are interested in answering is how well neural methods, and specifically transformer models, such as BERT, perform on the answer type prediction task compared to traditional approaches. Our main finding is that coarse-grained answer types can be identified effectively with standard text classification methods, with over 95% accuracy, and BERT can bring only marginal improvements. For fine-grained type detection, on the other hand, BERT clearly outperforms previous retrieval-based approaches.

📄 PDF Abstract BibTeX arXiv:2109.06714

Code (0)

등록된 구현이 없습니다.

Tasks

Retrievaltext-classificationText ClassificationType prediction

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

SeMantic AnsweR Type prediction task (SMART) at ISWC 2020 Semantic Web Challenge

2020-12-01 · Nandana Mihindukulasooriya, Mohnish Dubey, Alfio Gliozzo, Jens Lehmann 외

Each year the International Semantic Web Conference accepts a set of Semantic Web Challenges to establish competitions that will advance the state of the art solutions in any given problem domain. The SeMantic AnsweR Typ…

Knowledge Base Question AnsweringPredictionQuestion AnsweringType prediction+1

Semantic Answer Type and Relation Prediction Task (SMART 2021)

2021-12-07 · Nandana Mihindukulasooriya, Mohnish Dubey, Alfio Gliozzo, Jens Lehmann 외

Each year the International Semantic Web Conference organizes a set of Semantic Web Challenges to establish competitions that will advance state-of-the-art solutions in some problem domains. The Semantic Answer Type and …

Knowledge Base Question AnsweringPredictionQuestion AnsweringRelation+3

Integrating SPARQL and LLMs for Question Answering over Scholarly Data Sources

2024-09-11 · Fomubad Borista Fondi, Azanzi Jiomekong Fidel, Gaoussou Camara

The Scholarly Hybrid Question Answering over Linked Data (QALD) Challenge at the International Semantic Web Conference (ISWC) 2024 focuses on Question Answering (QA) over diverse scholarly sources: DBLP, SemOpenAlex, and…

Extractive Question-AnsweringQuestion Answering

Extreme Classification for Answer Type Prediction in Question Answering

2023-04-24 · Vinay Setty

Semantic answer type prediction (SMART) is known to be a useful step towards effective question answering (QA) systems. The SMART task involves predicting the top-$k$ knowledge graph (KG) types for a given natural langua…

ClassificationClusteringExtreme Multi-Label ClassificationMulti-Label Classification+5

PSYCHIC: A Neuro-Symbolic Framework for Knowledge Graph Question-Answering Grounding

2023-10-19 · Hanna Abi Akl

The Scholarly Question Answering over Linked Data (Scholarly QALD) at The International Semantic Web Conference (ISWC) 2023 challenge presents two sub-tasks to tackle question answering (QA) over knowledge graphs (KGs). …

Entity LinkingGraph Question AnsweringKnowledge GraphsQuestion Answering