paper-with-me

홈 › Papers

Short Text Classification via Knowledge powered Attention with Similarity Matrix based CNN

2020-02-09 · Mingchen Li, Gabtone. Clinton, Yijia Miao, Feng Gao

Short text is becoming more and more popular on the web, such as Chat Message, SMS and Product Reviews. Accurately classifying short text is an important and challenging task. A number of studies have difficulties in addressing this problem because of the word ambiguity and data sparsity. To address this issue, we propose a knowledge powered attention with similarity matrix based convolutional neural network (KASM) model, which can compute comprehensive information by utilizing the knowledge and deep neural network. We use knowledge graph (KG) to enrich the semantic representation of short text, specially, the information of parent-entity is introduced in our model. Meanwhile, we consider the word interaction in the literal-level between short text and the representation of label, and utilize similarity matrix based convolutional neural network (CNN) to extract it. For the purpose of measuring the importance of knowledge, we introduce the attention mechanisms to choose the important information. Experimental results on five standard datasets show that our model significantly outperforms state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2002.03350

Code (0)

등록된 구현이 없습니다.

Tasks

General Classificationtext-classificationText Classification

Similar Papers 제목 키워드 기반

Deep Short Text Classification with Knowledge Powered Attention

2019-02-21 · Jindong Chen, Yizhou Hu, Jingping Liu, Yanghua Xiao 외

Short text classification is one of important tasks in Natural Language Processing (NLP). Unlike paragraphs or documents, short texts are more ambiguous since they have not enough contextual information, which poses a gr…

ClassificationGeneral Classificationtext-classificationText Classification

KW-ATTN: Knowledge Infused Attention for Accurate and Interpretable Text Classification

2021-06-01 · NAACL (DeeLIO) 2021 6 · Hyeju Jang, Seojin Bang, Wen Xiao, Giuseppe Carenini 외

Text classification has wide-ranging applications in various domains. While neural network approaches have drastically advanced performance in text classification, they tend to be powered by a large amount of training da…

Classificationtext-classificationText Classification

A Cross Attention Approach to Diagnostic Explainability using Clinical Practice Guidelines for Depression

2023-11-23 · Sumit Dalal, Deepa Tilwani, Kaushik Roy, Manas Gaur 외

The lack of explainability using relevant clinical knowledge hinders the adoption of Artificial Intelligence-powered analysis of unstructured clinical dialogue. A wealth of relevant, untapped Mental Health (MH) data is a…

Clinical KnowledgeDiagnosticLanguage Modelling

Prompt-Learning for Short Text Classification

2022-02-23 · Yi Zhu, Xinke Zhou, Jipeng Qiang, Yun Li 외

In the short text, the extremely short length, feature sparsity, and high ambiguity pose huge challenges to classification tasks. Recently, as an effective method for tuning Pre-trained Language Models for specific downs…

ClassificationPrompt Learningtext-classificationText Classification

Isomer: Transfer enhanced Dual-Channel Heterogeneous Dependency Attention Network for Aspect-based Sentiment Classification

2021-11-21 · Yukun Cao, Yijia Tang, Ziyue Wei, ChengKun Jin 외

Aspect-based sentiment classification aims to predict the sentiment polarity of a specific aspect in a sentence. However, most existing methods attempt to construct dependency relations into a homogeneous dependency grap…

SentenceSentiment AnalysisSentiment Classification