Offensive Language Detection in Under-resourced Algerian Dialectal Arabic Language

2022-03-18 · Oussama Boucherit, Kheireddine Abainia

This paper addresses the problem of detecting the offensive and abusive content in Facebook comments, where we focus on the Algerian dialectal Arabic which is one of under-resourced languages. The latter has a variety of dialects mixed with different languages (i.e. Berber, French and English). In addition, we deal with texts written in both Arabic and Roman scripts (i.e. Arabizi). Due to the scarcity of works on the same language, we have built a new corpus regrouping more than 8.7k texts manually annotated as normal, abusive and offensive. We have conducted a series of experiments using the state-of-the-art classifiers of text categorisation, namely: BiLSTM, CNN, FastText, SVM and NB. The results showed acceptable performances, but the problem requires further investigation on linguistic features to increase the identification accuracy.

📄 PDF Abstract BibTeX arXiv:2203.10024

Code (1)

xprogramer/dziriofn 공식 구현

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음

Tanh Activation 설명 없음

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…

LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

BiLSTM A Bidirectional LSTM, or biLSTM, is a sequence processing model that consists of two LSTMs: one taking the input in a forward direction, and the other in a backwards…

Findings of the Shared Task on Offensive Language Identification in Tamil, Malayalam, and Kannada

2021-04-01 · EACL (DravidianLangTech) 2021 4 · Bharathi Raja Chakravarthi, Ruba Priyadharshini, Navya Jose, Anand Kumar M 외

Detecting offensive language in social media in local languages is critical for moderating user-generated content. Thus, the field of offensive language identification in under-resourced Tamil, Malayalam and Kannada lang…

Benchmarking Language Identification

KanCMD: Kannada CodeMixed Dataset for Sentiment Analysis and Offensive Language Detection

2020-12-01 · COLING (PEOPLES) 2020 12 · Adeep Hande, Ruba Priyadharshini, Bharathi Raja Chakravarthi

We introduce Kannada CodeMixed Dataset (KanCMD), a multi-task learning dataset for sentiment analysis and offensive language identification. The KanCMD dataset highlights two real-world issues from the social media text.…

Language Identification Multi-Task Learning Sentiment Analysis

Identifying Sentiments in Algerian Code-switched User-generated Comments

2020-05-01 · LREC 2020 5 · Wafia Adouane, Samia Touileb, Jean-Philippe Bernardy

We present in this paper our work on Algerian language, an under-resourced North African colloquial Arabic variety, for which we built a comparably large corpus of more than 36,000 code-switched user-generated comments a…

Sentiment Analysis

Improving Neural Network Performance by Injecting Background Knowledge: Detecting Code-switching and Borrowing in Algerian texts

2018-07-01 · WS 2018 7 · Wafia Adouane, Jean-Philippe Bernardy, Simon Dobnik

We explore the effect of injecting background knowledge to different deep neural network (DNN) configurations in order to mitigate the problem of the scarcity of annotated data when applying these models on datasets of l…

Word Embeddings

Subasa -- Adapting Language Models for Low-resourced Offensive Language Detection in Sinhala

2025-04-02 · Shanilka Haturusinghe, Tharindu Cyril Weerasooriya, Marcos Zampieri, Christopher M. Homan 외

Accurate detection of offensive language is essential for a number of applications related to social media safety. There is a sharp contrast in performance in this task between low and high-resource languages. In this pa…

XLM-R