paper-with-me

Papers

Offensive language detection in Arabic using ULMFiT

2020-05-01 · LREC 2020 5 · Mohamed Abdellatif, Ahmed Elgammal

In this paper, we approach the shared task OffenseEval 2020 by Mubarak et al. (2020) using ULMFiT Howard and Ruder (2018) pre-trained on Arabic Wikipedia Khooli (2019) which we use as a starting point and use the target data-set to fine-tune it. The data set of the task is highly imbalanced. We train forward and backward models and ensemble the results. We report confusion matrix, accuracy, precision, recall and F1 of the development set and report summarized results of the test set. Transfer learning method using ULMFiT shows potential for Arabic text classification. Mubarak, K. Darwish,W. Magdy, T. Elsayed, and H. Al-Khalifa. Overview of osact4 arabic offensive language detection shared task. 4, 2020. Howard and S. Ruder. Universal language model fine-tuning for text classification. arXiv preprint arXiv:1801.06146, 2018. Khooli. Applied data science. https://github.com/abedkhooli/ds2, 2019.

📄 PDF Abstract BibTeX

Code (1)

abedkhooli/ds2 공식 구현 pytorch

Tasks

General ClassificationLanguage ModelingLanguage Modellingtext-classificationText ClassificationTransfer Learning

Methods 이 논문이 사용한 방법론

Tanh Activation 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Sigmoid Activation 설명 없음
Activation Regularization Activation Regularization (AR), or $L\_{2}$ activation regularization, is regularization performed on activations as opposed to weights. It is usually used in conjunction with…
Temporal Activation Regularization 설명 없음
Weight Tying Weight Tying improves the performance of language models by tying (sharing) the weights of the embedding and softmax layers. This…
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Variational Dropout Variational Dropout is a regularization technique based on dropout, but uses a variational inference grounded approach. In…

Similar Papers 제목 키워드 기반

Towards Offensive Language Identification for Tamil Code-Mixed YouTube Comments and Posts

2021-08-24 · Charangan Vasantharajan, Uthayasanker Thayasivam

Offensive Language detection in social media platforms has been an active field of research over the past years. In non-native English spoken countries, social media users mostly use a code-mixed form of text in their po…

Language IdentificationTransfer LearningTranslationTransliteration

Explainable and High-Performance Hate and Offensive Speech Detection

2022-06-26 · Marzieh Babaeianjelodar, Gurram Poorna Prudhvi, Stephen Lorenz, Keyu Chen 외

The spread of information through social media platforms can create environments possibly hostile to vulnerable communities and silence certain groups in society. To mitigate such instances, several models have been deve…

Hate Speech DetectionVocal Bursts Intensity Prediction

Gauravarora@HASOC-Dravidian-CodeMix-FIRE2020: Pre-training ULMFiT on Synthetically Generated Code-Mixed Data for Hate Speech Detection

2020-10-05 · Gaurav Arora

This paper describes the system submitted to Dravidian-Codemix-HASOC2020: Hate Speech and Offensive Content Identification in Dravidian languages (Tamil-English and Malayalam-English). The task aims to identify offensive…

Hate Speech Detection

Spartans@LT-EDI-EACL2021: Inclusive Speech Detection using Pretrained Language Models

2021-04-01 · EACL (LTEDI) 2021 4 · Megha Sharma, Gaurav Arora

We describe our system that ranked first in Hope Speech Detection (HSD) shared task and fourth in Offensive Language Identification (OLI) shared task, both in Tamil language. The goal of HSD and OLI is to identify if a c…

Hope Speech DetectionLanguage Identification

ASU\_OPTO at OSACT4 - Offensive Language Detection for Arabic text

2020-05-01 · LREC 2020 5 · Amr Keleg, Samhaa R. El-Beltagy, Mahmoud Khalil

In the past years, toxic comments and offensive speech are polluting the internet and manual inspection of these comments is becoming a tiresome task to manage. Having a machine learning based model that is able to filte…