SJ_AJ@DravidianLangTech-EACL2021: Task-Adaptive Pre-Training of Multilingual BERT models for Offensive Language Identification

2021-02-01 · EACL (DravidianLangTech) 2021 4 · Sai Muralidhar Jayanthi, Akshat Gupta

In this paper we present our submission for the EACL 2021-Shared Task on Offensive Language Identification in Dravidian languages. Our final system is an ensemble of mBERT and XLM-RoBERTa models which leverage task-adaptive pre-training of multilingual BERT models with a masked language modeling objective. Our system was ranked 1st for Kannada, 2nd for Malayalam and 3rd for Tamil.

📄 PDF Abstract BibTeX arXiv:2102.01051

Code (1)

murali1996/eacl2021-OffensEval-Dravidian 공식 구현 pytorch

Tasks

Language IdentificationLanguage ModelingLanguage ModellingMasked Language Modeling

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

mBERT mBERT

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Attention 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Residual Connection 설명 없음

WordPiece 설명 없음

GX@DravidianLangTech-EACL2021: Multilingual Neural Machine Translation and Back-translation

2021-04-01 · EACL (DravidianLangTech) 2021 4 · Wanying Xie

In this paper, we describe the GX system in the EACL2021 shared task on machine translation in Dravidian languages. Given the low amount of parallel training data, We adopt two methods to improve the overall performance:…

Decoder Machine Translation Translation

cs@DravidianLangTech-EACL2021: Offensive Language Identification Based On Multilingual BERT Model

2021-04-01 · EACL (DravidianLangTech) 2021 4 · Shi Chen, Bing Kong

This paper introduces the related content of the task “Offensive Language Identification in Dravidian LANGUAGES-EACL 2021”. The task requires us to classify Dravidian languages collected from social media into Not-Offens…

Language Identification text-classification Text Classification

HUB@DravidianLangTech-EACL2021: Identify and Classify Offensive Text in Multilingual Code Mixing in Social Media

2021-04-01 · EACL (DravidianLangTech) 2021 4 · Bo Huang, Yang Bai

This paper introduces the system description of the HUB team participating in DravidianLangTech - EACL2021: Offensive Language Identification in Dravidian Languages. The theme of this shared task is the detection of offe…

Classification Language Identification

Codewithzichao@DravidianLangTech-EACL2021: Exploring Multilingual Transformers for Offensive Language Identification on Code Mixing Text

2021-04-01 · EACL (DravidianLangTech) 2021 4 · Zichao Li

This paper describes our solution submitted to shared task on Offensive Language Identification in Dravidian Languages. We participated in all three of offensive language identification. In order to address the task, we …

Language Identification

IIITT@DravidianLangTech-EACL2021: Transfer Learning for Offensive Language Detection in Dravidian Languages

2021-04-01 · EACL (DravidianLangTech) 2021 4 · Konthala Yasaswini, Karthik Puranik, Adeep Hande, Ruba Priyadharshini 외

This paper demonstrates our work for the shared task on Offensive Language Identification in Dravidian Languages-EACL 2021. Offensive language detection in the various social media platforms was identified previously. Bu…

Diversity Language Identification Transfer Learning