paper-with-me

Papers

Using Knowledge-Embedded Attention to Augment Pre-trained Language Models for Fine-Grained Emotion Recognition

2021-07-31 · Varsha Suresh, Desmond C. Ong

Modern emotion recognition systems are trained to recognize only a small set of emotions, and hence fail to capture the broad spectrum of emotions people experience and express in daily life. In order to engage in more empathetic interactions, future AI has to perform \textit{fine-grained} emotion recognition, distinguishing between many more varied emotions. Here, we focus on improving fine-grained emotion recognition by introducing external knowledge into a pre-trained self-attention model. We propose Knowledge-Embedded Attention (KEA) to use knowledge from emotion lexicons to augment the contextual representations from pre-trained ELECTRA and BERT models. Our results and error analyses outperform previous models on several datasets, and is better able to differentiate closely-confusable emotions, such as afraid and terrified.

📄 PDF Abstract BibTeX arXiv:2108.00194

Code (1)

varsha33/Fine-Grained-Emotion-Recognition 공식 구현 pytorch

Tasks

Emotion Recognition

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

KBLaM: Knowledge Base augmented Language Model

2024-10-14 · Xi Wang, Liana Mikaelyan, Taketomo Isazawa, James Hensman

In this paper, we propose Knowledge Base augmented Language Model (KBLaM), a new method for augmenting Large Language Models (LLMs) with external knowledge. KBLaM works with a knowledge base (KB) constructed from a corpu…

8kGPUIn-Context LearningLanguage Modeling+6

KRAST: Knowledge-Augmented Robotic Action Recognition with Structured Text for Vision-Language Models

2025-09-19 · Son Hai Nguyen, Diwei Wang, Jinhyeok Jang, Hyewon Seo arxiv

Accurate vision-based action recognition is crucial for developing autonomous robots that can operate safely and reliably in complex, real-world environments. In this work, we advance video-based recognition of indoor da…

Action Recognition

Embedded Translations for Low-resource Automated Glossing

2024-03-13 · Changbing Yang, Garrett Nicolai, Miikka Silfverberg

We investigate automatic interlinear glossing in low-resource settings. We augment a hard-attentional neural model with embedded translation information extracted from interlinear glossed text. After encoding these trans…

DecoderTranslation

Combining Knowledge Hunting and Neural Language Models to Solve the Winograd Schema Challenge

2019-07-01 · ACL 2019 7 · Ashok Prakash, Arpit Sharma, Arindam Mitra, Chitta Baral

Winograd Schema Challenge (WSC) is a pronoun resolution task which seems to require reasoning with commonsense knowledge. The needed knowledge is not present in the given text. Automatic extraction of the needed knowledg…

Language ModelingLanguage Modelling

An embedded deep learning system for augmented reality in firefighting applications

2020-09-22 · Manish Bhattarai, Aura Rose Jensen-Curtis, Manel Martínez-Ramón

Firefighting is a dynamic activity, in which numerous operations occur simultaneously. Maintaining situational awareness (i.e., knowledge of current conditions and activities at the scene) is critical to the accurate dec…

Decision Making