Extreme Classification for Answer Type Prediction in Question Answering

2023-04-24 · Vinay Setty

Semantic answer type prediction (SMART) is known to be a useful step towards effective question answering (QA) systems. The SMART task involves predicting the top-$k$ knowledge graph (KG) types for a given natural language question. This is challenging due to the large number of types in KGs. In this paper, we propose use of extreme multi-label classification using Transformer models (XBERT) by clustering KG types using structural and semantic features based on question text. We specifically improve the clustering stage of the XBERT pipeline using textual and structural features derived from KGs. We show that these features can improve end-to-end performance for the SMART task, and yield state-of-the-art results.

📄 PDF Abstract BibTeX arXiv:2304.12395

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationClusteringExtreme Multi-Label ClassificationMulti-Label Classification MUlTI-LABEL-ClASSIFICATION Prediction Question Answering Type prediction Vocal Bursts Type Prediction

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Adam 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Adopting the Multi-answer Questioning Task with an Auxiliary Metric for Extreme Multi-label Text Classification Utilizing the Label Hierarchy

2023-03-02 · Li Wang, Ying Wah Teh, Mohammed Ali Al-Garadi

Extreme multi-label text classification utilizes the label hierarchy to partition extreme labels into multiple label groups, turning the task into simple multi-group multi-label classification tasks. Current research enc…

Classification Extreme Multi-Label Classification Multi-Label Classification MUlTI-LABEL-ClASSIFICATION+5

Semantic Answer Type Prediction using BERT: IAI at the ISWC SMART Task 2020

2021-09-14 · Vinay Setty, Krisztian Balog

This paper summarizes our participation in the SMART Task of the ISWC 2020 Challenge. A particular question we are interested in answering is how well neural methods, and specifically transformer models, such as BERT, pe…

Retrieval text-classification Text Classification Type prediction

A Novel Architecture For Question Classification Based Indexing Scheme For Efficient Question Answering

2013-07-26 · Renu Mudgal, Rosy Madaan, A. K. Sharma, Ashutosh Dixit

Question answering system can be seen as the next step in information retrieval, allowing users to pose question in natural language and receive compact answers. For the Question answering system to be successful, resear…

Classification General Classification Information Retrieval Question Answering+1

ColumbiaNLP at SemEval-2019 Task 8: The Answer is Language Model Fine-tuning

2019-06-01 · SEMEVAL 2019 6 · Tuhin Chakrabarty, Smar Muresan, a

Community Question Answering forums are very popular nowadays, as they represent effective means for communities to share information around particular topics. But the information shared on these forums are often not aut…

Community Question Answering Fact Checking General Classification Language Modeling+2

Image-based Vehicle Analysis using Deep Neural Network: A Systematic Study

2016-01-06 · Yiren Zhou, Hossein Nejati, Thanh-Toan Do, Ngai-Man Cheung 외

We address the vehicle detection and classification problems using Deep Neural Networks (DNNs) approaches. Here we answer to questions that are specific to our application including how to utilize DNN for vehicle detecti…

Classification General Classification vehicle detection