Emoji Prediction in Tweets using BERT

2023-07-05 · Muhammad Osama Nusrat, Zeeshan Habib, Mehreen Alam, Saad Ahmed Jamal

In recent years, the use of emojis in social media has increased dramatically, making them an important element in understanding online communication. However, predicting the meaning of emojis in a given text is a challenging task due to their ambiguous nature. In this study, we propose a transformer-based approach for emoji prediction using BERT, a widely-used pre-trained language model. We fine-tuned BERT on a large corpus of text (tweets) containing both text and emojis to predict the most appropriate emoji for a given text. Our experimental results demonstrate that our approach outperforms several state-of-the-art models in predicting emojis with an accuracy of over 75 percent. This work has potential applications in natural language processing, sentiment analysis, and social media marketing.

📄 PDF Abstract BibTeX arXiv:2307.02054

Code (1)

mnusrat786/emoji-prediction-with-transformer 공식 구현

Tasks

Language ModelingLanguage Modelling Marketing Prediction Sentiment Analysis

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…

Adam 설명 없음

WordPiece 설명 없음

Machine learning and emoji prediction: How much accuracy can MARBERT achieve?

2026-04-22 · Mohammed Q. Shormani, Ibrahim Abdulmalik Hassan Muneef Y. Alshawsh arxiv

This study investigates Machine Learning (ML) in the prediction of emojis in Arabic tweets employing the (state-of-the-art) MARBERT model. A corpus of 11379 CA tweets representing multiple Arabic colloquial dialects was …

Multilingual Emoticon Prediction of Tweets about COVID-19

2020-12-01 · COLING (PEOPLES) 2020 12 · Stefanos Stoikos, Mike Izbicki

Emojis are a widely used tool for encoding emotional content in informal messages such as tweets,and predicting which emoji corresponds to a piece of text can be used as a proxy for measuring the emotional content in the…

Prediction

Making Your Tweets More Fancy: Emoji Insertion to Texts

2021-09-01 · RANLP 2021 9 · Jingun Kwon, Naoki Kobayashi, Hidetaka Kamigaito, Hiroya Takamura 외

In the social media, users frequently use small images called emojis in their posts. Although using emojis in texts plays a key role in recent communication systems, less attention has been paid on their positions in the…

Position Prediction

DUTH at SemEval-2018 Task 2: Emoji Prediction in Tweets

2018-06-01 · SEMEVAL 2018 6 · Dimitrios Effrosynidis, Georgios Peikos, Symeon Symeonidis, Avi Arampatzis

This paper describes the approach that was developed for SemEval 2018 Task 2 (Multilingual Emoji Prediction) by the DUTH Team. First, we employed a combination of pre-processing techniques to reduce the noise of tweets a…

Information Retrieval Task 2

A Federated Approach to Predicting Emojis in Hindi Tweets

2022-11-11 · Deep Gandhi, Jash Mehta, Nirali Parekh, Karan Waghela 외

The use of emojis affords a visual modality to, often private, textual communication. The task of predicting emojis however provides a challenge for machine learning as emoji use tends to cluster into the frequently used…

Federated Learning