paper-with-me

홈 › Papers

HinglishNLP: Fine-tuned Language Models for Hinglish Sentiment Detection

2020-08-22 · Meghana Bhange, Nirant Kasliwal

Sentiment analysis for code-mixed social media text continues to be an under-explored area. This work adds two common approaches: fine-tuning large transformer models and sample efficient methods like ULMFiT. Prior work demonstrates the efficacy of classical ML methods for polarity detection. Fine-tuned general-purpose language representation models, such as those of the BERT family are benchmarked along with classical machine learning and ensemble methods. We show that NB-SVM beats RoBERTa by 6.2% (relative) F1. The best performing model is a majority-vote ensemble which achieves an F1 of 0.707. The leaderboard submission was made under the codalab username nirantk, with F1 of 0.689.

📄 PDF Abstract BibTeX arXiv:2008.09820

Code (2)

NirantK/Hinglish 공식 구현 pytorch
makcedward/nlpaug tf

Tasks

BIG-bench Machine LearningSentiment Analysis

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Temporal Activation Regularization 설명 없음
Activation Regularization Activation Regularization (AR), or $L\_{2}$ activation regularization, is regularization performed on activations as opposed to weights. It is usually used in conjunction with…
DropConnect DropConnect generalizes Dropout by randomly dropping the weights rather than the activations with probability $1-p$. DropConnect…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

HinglishNLP at SemEval-2020 Task 9: Fine-tuned Language Models for Hinglish Sentiment Detection

2020-12-01 · SEMEVAL 2020 · Meghana Bhange, Nirant Kasliwal

Sentiment analysis for code-mixed social media text continues to be an under-explored area. This work adds two common approaches: fine-tuning large transformer models and sample efficient methods like ULMFiT. Prior work …

Sentiment Analysis

Code-Mix Sentiment Analysis on Hinglish Tweets

2026-01-08 · Aashi Garg, Aneshya Das, Arshi Arya, Anushka Goyal 외 arxiv

The effectiveness of brand monitoring in India is increasingly challenged by the rise of Hinglish--a hybrid of Hindi and English--used widely in user-generated content on platforms like Twitter. Traditional Natural Langu…

Sentiment Analysis

NITS-Hinglish-SentiMix at SemEval-2020 Task 9: Sentiment Analysis For Code-Mixed Social Media Text Using an Ensemble Model

2020-07-23 · SEMEVAL 2020 · Subhra Jyoti Baroi, Nivedita Singh, Ringki Das, Thoudam Doren Singh

Sentiment Analysis is the process of deciphering what a sentence emotes and classifying them as either positive, negative, or neutral. In recent times, India has seen a huge influx in the number of active social media us…

SentenceSentiment Analysis

SemEval-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed Tweets

2020-08-10 · SEMEVAL 2020 · Parth Patwa, Gustavo Aguilar, Sudipta Kar, Suraj Pandey 외

In this paper, we present the results of the SemEval-2020 Task 9 on Sentiment Analysis of Code-Mixed Tweets (SentiMix 2020). We also release and describe our Hinglish (Hindi-English) and Spanglish (Spanish-English) corpo…

Language IdentificationSentenceSentiment Analysis

Small Wins Big: Comparing Large Language Models and Domain Fine-Tuned Models for Sarcasm Detection in Code-Mixed Hinglish Text

2026-02-25 · Bitan Majumder, Anirban Sen arxiv

Sarcasm detection in multilingual and code-mixed environments remains a challenging task for natural language processing models due to structural variations, informal expressions, and low-resource linguistic availability…

Sarcasm Detection