paper-with-me

홈 › Papers

CRAB: Class Representation Attentive BERT for Hate Speech Identification in Social Media

2020-10-25 · Sayyed M. Zahiri, Ali Ahmadvand

In recent years, social media platforms have hosted an explosion of hate speech and objectionable content. The urgent need for effective automatic hate speech detection models have drawn remarkable investment from companies and researchers. Social media posts are generally short and their semantics could drastically be altered by even a single token. Thus, it is crucial for this task to learn context-aware input representations, and consider relevancy scores between input embeddings and class representations as an additional signal. To accommodate these needs, this paper introduces CRAB (Class Representation Attentive BERT), a neural model for detecting hate speech in social media. The model benefits from two semantic representations: (i) trainable token-wise and sentence-wise class representations, and (ii) contextualized input embeddings from state-of-the-art BERT encoder. To investigate effectiveness of CRAB, we train our model on Twitter data and compare it against strong baselines. Our results show that CRAB achieves 1.89% relative improved Macro-averaged F1 over state-of-the-art baseline. The results of this research open an opportunity for the future research on automated abusive behavior detection in social media

📄 PDF Abstract BibTeX arXiv:2010.13028

Code (0)

등록된 구현이 없습니다.

Tasks

Hate Speech DetectionSentence

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

Detection of Hate Speech using BERT and Hate Speech Word Embedding with Deep Model

2021-11-02 · Hind Saleh, Areej Alhothali, Kawthar Moria

The enormous amount of data being generated on the web and social media has increased the demand for detecting online hate speech. Detecting hate speech will reduce their negative impact and influence on others. A lot of…

Binary ClassificationHate Speech DetectionLanguage ModelingLanguage Modelling+1

Multiclass Hate Speech Detection with RoBERTa-OTA: Integrating Transformer Attention and Graph Convolutional Networks

2026-02-03 · Mahmoud Abusaqer, Jamil Saquer arxiv

Multiclass hate speech detection across demographic categories remains computationally challenging due to implicit targeting strategies and linguistic variability in social media content. Existing approaches rely solely …

Computational EfficiencyHate Speech Detection

Mono vs Multilingual BERT for Hate Speech Detection and Text Classification: A Case Study in Marathi

2022-04-19 · Abhishek Velankar, Hrushikesh Patil, Raviraj Joshi

Transformers are the most eminent architectures used for a vast range of Natural Language Processing tasks. These models are pre-trained over a large text corpus and are meant to serve state-of-the-art results over tasks…

ArticlesClassificationHate Speech DetectionSentence+5

GUCT at Arabic Hate Speech 2022: Towards a Better Isotropy for Hatespeech Detection

2022-06-01 · OSACT (LREC) 2022 6 · Nehal Elkaref, Mervat Abu-Elkheir

Hate Speech is an increasingly common occurrence in verbal and textual exchanges on online platforms, where many users, especially those from vulnerable minorities, are in danger of being attacked or harassed via text me…

ArticlesHate Speech Detection

Jointly Modeling Intra- and Inter-transaction Dependencies with Hierarchical Attentive Transaction Embeddings for Next-item Recommendation

2020-05-30 · Shoujin Wang, Longbing Cao, Liang Hu, Shlomo Berkovsky 외

A transaction-based recommender system (TBRS) aims to predict the next item by modeling dependencies in transactional data. Generally, two kinds of dependencies considered are intra-transaction dependency and inter-trans…

Recommendation Systems