paper-with-me

홈 › Papers

FBERT: A Neural Transformer for Identifying Offensive Content

2021-09-10 · Findings (EMNLP) 2021 11 · Diptanu Sarkar, Marcos Zampieri, Tharindu Ranasinghe, Alexander Ororbia

Transformer-based models such as BERT, XLNET, and XLM-R have achieved state-of-the-art performance across various NLP tasks including the identification of offensive language and hate speech, an important problem in social media. In this paper, we present fBERT, a BERT model retrained on SOLID, the largest English offensive language identification corpus available with over $1.4$ million offensive instances. We evaluate fBERT's performance on identifying offensive content on multiple English datasets and we test several thresholds for selecting instances from SOLID. The fBERT model will be made freely available to the community.

📄 PDF Abstract BibTeX arXiv:2109.05074

Code (0)

등록된 구현이 없습니다.

Tasks

Language IdentificationXLM-R

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
XLM-R XLM-R
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

Offensive Language Identification in Transliterated and Code-Mixed Bangla

2023-11-25 · Md Nishat Raihan, Umma Hani Tanmoy, Anika Binte Islam, Kai North 외

Identifying offensive content in social media is vital for creating safe online communities. Several recent studies have addressed this problem by creating datasets for various languages. In this paper, we explore offens…

Language Identification

A Text-to-Text Model for Multilingual Offensive Language Identification

2023-12-06 · Tharindu Ranasinghe, Marcos Zampieri

The ubiquity of offensive content on social media is a growing cause for concern among companies and government organizations. Recently, transformer-based models such as BERT, XLNET, and XLM-R have achieved state-of-the-…

DecoderLanguage IdentificationXLM-R

NITK-IT_NLP@TamilNLP-ACL2022: Transformer based model for Toxic Span Identification in Tamil

2022-05-01 · DravidianLangTech (ACL) 2022 5 · Hariharan LekshmiAmmal, Manikandan Ravikiran, Anand Kumar Madasamy

Toxic span identification in Tamil is a shared task that focuses on identifying harmful content, contributing to offensiveness. In this work, we have built a model that can efficiently identify the span of text contribut…

CUSATNLP@DravidianLangTech-EACL2021:Language Agnostic Classification of Offensive Content in Tweets

2021-04-01 · EACL (DravidianLangTech) 2021 4 · Sara Renjit, Sumam Mary Idicula

Identifying offensive information from tweets is a vital language processing task. This task concentrated more on English and other foreign languages these days. In this shared task on Offensive Language Identification i…

Language IdentificationPositionSentenceSentence Embedding+1

An Annotated Corpus of Arabic Tweets for Hate Speech Analysis

2025-05-17 · Md. Rafiul Biswas, Wajdi Zaghouani

Identifying hate speech content in the Arabic language is challenging due to the rich quality of dialectal variations. This study introduces a multilabel hate speech dataset in the Arabic language. We have collected 1000…