UoT-UWF-PartAI at SemEval-2021 Task 5: Self Attention Based Bi-GRU with Multi-Embedding Representation for Toxicity Highlighter

2021-04-27 · SEMEVAL 2021 · Hamed Babaei Giglou, Taher Rahgooy, Mostafa Rahgouy, Jafar Razmara

Toxic Spans Detection(TSD) task is defined as highlighting spans that make a text toxic. Many works have been done to classify a given comment or document as toxic or non-toxic. However, none of those proposed models work at the token level. In this paper, we propose a self-attention-based bidirectional gated recurrent unit(BiGRU) with a multi-embedding representation of the tokens. Our proposed model enriches the representation by a combination of GPT-2, GloVe, and RoBERTa embeddings, which led to promising results. Experimental results show that our proposed approach is very effective in detecting span tokens.

📄 PDF Abstract BibTeX arXiv:2104.13164

Code (0)

등록된 구현이 없습니다.

Tasks

Toxic Spans Detection

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…

Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…

Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

WordPiece 설명 없음

Residual Connection 설명 없음

UC Davis at SemEval-2019 Task 1: DAG Semantic Parsing with Attention-based Decoder

2019-06-01 · SEMEVAL 2019 6 · Dian Yu, Kenji Sagae

We present an encoder-decoder model for semantic parsing with UCCA SemEval 2019 Task 1. The encoder is a Bi-LSTM and the decoder uses recursive self-attention. The proposed model alleviates challenges and feature enginee…

Decoder Feature Engineering Semantic Parsing

CNRL at SemEval-2020 Task 5: Modelling Causal Reasoning in Language with Multi-Head Self-Attention Weights based Counterfactual Detection

2020-05-31 · SEMEVAL 2020 · Rajaswa Patil, Veeky Baths

In this paper, we describe an approach for modelling causal reasoning in natural language by detecting counterfactuals in text using multi-head self-attention weights. We use pre-trained transformer models to extract con…

counterfactual Counterfactual Detection

NTUA-SLP at SemEval-2018 Task 1: Predicting Affective Content in Tweets with Deep Attentive RNNs and Transfer Learning

2018-04-18 · SEMEVAL 2018 6 · Christos Baziotis, Nikos Athanasiou, Alexandra Chronopoulou, Athanasia Kolovou 외

In this paper we present deep-learning models that submitted to the SemEval-2018 Task~1 competition: "Affect in Tweets". We participated in all subtasks for English tweets. We propose a Bi-LSTM architecture equipped with…

Emotion Classification Transfer Learning Word Embeddings

uOttawa at SemEval-2018 Task 1: Self-Attentive Hybrid GRU-Based Network

2018-06-01 · SEMEVAL 2018 6 · Ahmed Husseini Orabi, Mahmoud Husseini Orabi, Diana Inkpen, David Van Bruwaene

We propose a novel attentive hybrid GRU-based network (SAHGN), which we used at SemEval-2018 Task 1: Affect in Tweets. Our network has two main characteristics, 1) has the ability to internally optimize its feature repre…

regression

UBC-NLP at SemEval-2019 Task 4: Hyperpartisan News Detection With Attention-Based Bi-LSTMs

2019-06-01 · SEMEVAL 2019 6 · Chiyu Zhang, Arun Rajendran, Muhammad Abdul-Mageed

We present our deep learning models submitted to the SemEval-2019 Task 4 competition focused at Hyperpartisan News Detection. We acquire best results with a Bi-LSTM network equipped with a self-attention mechanism. Among…