paper-with-me

홈 › Papers

HinglishNLP at SemEval-2020 Task 9: Fine-tuned Language Models for Hinglish Sentiment Detection

2020-12-01 · SEMEVAL 2020 · Meghana Bhange, Nirant Kasliwal

Sentiment analysis for code-mixed social media text continues to be an under-explored area. This work adds two common approaches: fine-tuning large transformer models and sample efficient methods like ULMFiT. Prior work demonstrates the efficacy of classical ML methods for polarity detection. Fine-tuned general-purpose language representation models, such as those of the BERT family are benchmarked along with classical machine learning and ensemble methods. We show that NB-SVM beats RoBERTa by 6.2{\%} (relative) F1. The best performing model is a majority-vote ensemble which achieves an F1 of 0.707. The leaderboard submission was made under the codalab username nirantk, with F1 of 0.689.

📄 PDF Abstract BibTeX

Code (2)

NirantK/Hinglish 공식 구현 pytorch
makcedward/nlpaug tf

Tasks

Sentiment Analysis

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
DropConnect DropConnect generalizes Dropout by randomly dropping the weights rather than the activations with probability $1-p$. DropConnect…
Tanh Activation 설명 없음
Activation Regularization Activation Regularization (AR), or $L\_{2}$ activation regularization, is regularization performed on activations as opposed to weights. It is usually used in conjunction with…
Weight Tying Weight Tying improves the performance of language models by tying (sharing) the weights of the embedding and softmax layers. This…
Variational Dropout Variational Dropout is a regularization technique based on dropout, but uses a variational inference grounded approach. In…

Similar Papers 제목 키워드 기반

HinglishNLP: Fine-tuned Language Models for Hinglish Sentiment Detection

2020-08-22 · Meghana Bhange, Nirant Kasliwal

Sentiment analysis for code-mixed social media text continues to be an under-explored area. This work adds two common approaches: fine-tuning large transformer models and sample efficient methods like ULMFiT. Prior work …

BIG-bench Machine LearningSentiment Analysis

Hitachi at SemEval-2020 Task 10: Emphasis Distribution Fusion on Fine-Tuned Language Models

2020-12-01 · SEMEVAL 2020 · Gaku Morio, Terufumi Morishita, Hiroaki Ozaki, Toshinori Miyoshi

This paper shows our system for SemEval-2020 task 10, Emphasis Selection for Written Text in Visual Media. Our strategy is two-fold. First, we propose fine-tuning many pre-trained language models, predicting an emphasis …

problemConquero at SemEval-2020 Task 12: Transformer and Soft label-based approaches

2020-07-21 · SEMEVAL 2020 · Karishma Laud, Jagriti Singh, Randeep Kumar Sahu, Ashutosh Modi

In this paper, we present various systems submitted by our team problemConquero for SemEval-2020 Shared Task 12 Multilingual Offensive Language Identification in Social Media. We participated in all the three sub-tasks o…

Language Identification

Tesla at SemEval-2022 Task 4: Patronizing and Condescending Language Detection using Transformer-based Models with Data Augmentation

2022-07-01 · SemEval (NAACL) 2022 7 · Sahil Bhatt, Manish Shrivastava

This paper describes our system for Task 4 of SemEval 2022: Patronizing and Condescending Language (PCL) Detection. For sub-task 1, where the objective is to classify a text as PCL or non-PCL, we use a T5 Model fine-tune…

ClassificationData AugmentationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+1

AliEdalat at SemEval-2022 Task 4: Patronizing and Condescending Language Detection using Fine-tuned Language Models, BERT+BiGRU, and Ensemble Models

2022-07-01 · SemEval (NAACL) 2022 7 · Ali Edalat, Yadollah Yaghoobzadeh, Behnam Bahrak

This paper presents the AliEdalat team’s methodology and results in SemEval-2022 Task 4: Patronizing and Condescending Language (PCL) Detection. This task aims to detect the presence of PCL and PCL categories in text in …

Binary Condescension DetectionMulti-label Condescension Detection