A Hybrid BERT and LightGBM based Model for Predicting Emotion GIF Categories on Twitter

2020-08-14 · Ye Bi, Shuo Wang, Zhongrui Fan

The animated Graphical Interchange Format (GIF) images have been widely used on social media as an intuitive way of expression emotion. Given their expressiveness, GIFs offer a more nuanced and precise way to convey emotions. In this paper, we present our solution for the EmotionGIF 2020 challenge, the shared task of SocialNLP 2020. To recommend GIF categories for unlabeled tweets, we regarded this problem as a kind of matching tasks and proposed a learning to rank framework based on Bidirectional Encoder Representations from Transformer (BERT) and LightGBM. Our team won the 4th place with a Mean Average Precision @ 6 (MAP@6) score of 0.5394 on the round 1 leaderboard.

📄 PDF Abstract BibTeX arXiv:2008.06176

Code (0)

등록된 구현이 없습니다.

Tasks

Learning-To-Rank

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

Multi-Head Attention 설명 없음

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Attention 설명 없음

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

BERT at SemEval-2020 Task 8: Using BERT to Analyse Meme Emotions

2020-12-01 · SEMEVAL 2020 · Adithya Avvaru, Sanath Vobilisetty

Sentiment analysis, being one of the most sought after research problems within Natural Language Processing (NLP) researchers. The range of problems being addressed by sentiment analysis is increasing. Till now, most of …

Sentiment Analysis

Multi-view Multi-label Fine-grained Emotion Decoding from Human Brain Activity

2022-10-26 · Kaicheng Fu, Changde Du, Shengpei Wang, Huiguang He

Decoding emotional states from human brain activity plays an important role in brain-computer interfaces. Existing emotion decoding methods still have two main limitations: one is only decoding a single emotion category …

Multi-Label Classification MUlTI-LABEL-ClASSIFICATION

Comparing emotion feature extraction approaches for predicting depression and anxiety

2022-07-01 · NAACL (CLPsych) 2022 7 · Hannah Burkhardt, Michael Pullmann, Thomas Hull, Patricia Aren 외

The increasing adoption of message-based behavioral therapy enables new approaches to assessing mental health using linguistic analysis of patient-generated text. Word counting approaches have demonstrated utility for li…

Diagnostic

LAST at SemEval-2020 Task 10: Finding Tokens to Emphasise in Short Written Texts with Precomputed Embedding Models and LightGBM

2020-12-01 · SEMEVAL 2020 · Yves Bestgen

To select tokens to be emphasised in short texts, a system mainly based on precomputed embedding models, such as BERT and ELMo, and LightGBM is proposed. Its performance is low. Additional analyzes suggest that its effec…

Improving Arabic Multi-Label Emotion Classification using Stacked Embeddings and Hybrid Loss Function

2024-10-04 · Muhammad Azeem Aslam, Wang Jun, Nisar Ahmed, Muhammad Imran Zaman 외

In multi-label emotion classification, particularly for low-resource languages like Arabic, the challenges of class imbalance and label correlation hinder model performance, especially in accurately predicting minority e…

Classification Contrastive Learning Emotion Classification Meta-Learning+2