paper-with-me

Papers

Fight Fire with Fire: Fine-tuning Hate Detectors using Large Samples of Generated Hate Speech

2021-09-01 · Findings (EMNLP) 2021 11 · Tomer Wullach, Amir Adler, Einat Minkov

Automatic hate speech detection is hampered by the scarcity of labeled datasetd, leading to poor generalization. We employ pretrained language models (LMs) to alleviate this data bottleneck. We utilize the GPT LM for generating large amounts of synthetic hate speech sequences from available labeled examples, and leverage the generated data in fine-tuning large pretrained LMs on hate detection. An empirical study using the models of BERT, RoBERTa and ALBERT, shows that this approach improves generalization significantly and consistently within and across data distributions. In fact, we find that generating relevant labeled hate speech sequences is preferable to using out-of-domain, and sometimes also within-domain, human-labeled examples.

📄 PDF Abstract BibTeX arXiv:2109.00591

Code (0)

등록된 구현이 없습니다.

Tasks

Hate Speech Detection

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Weight Decay 설명 없음
Discriminative Fine-Tuning Discriminative Fine-Tuning is a fine-tuning strategy that is used for ULMFiT type models. Instead of using the same learning rate…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Coordinated Control of UAVs for Human-Centered Active Sensing of Wildfires

2020-06-14 · Esmaeil Seraj, Matthew Gombolay

Fighting wildfires is a precarious task, imperiling the lives of engaging firefighters and those who reside in the fire's path. Firefighters need online and dynamic observation of the firefront to anticipate a wildfire's…

Instilling Organisational Values in Firefighters through Simulation-Based Training

2025-12-14 · Nardine Osman, Manel Rodriguez-Soto, Jordi Sabater-Mir arxiv

In firefighting and other emergency operations, decisions made under pressure carry profound ethical weight and can significantly impact incident outcomes and firefighter safety. Traditional training methods, while found…

Aerial Assistance System for Automated Firefighting during Turntable Ladder Operations

2025-11-18 · Jan Quenzel, Valerij Sekin, Daniel Schleich, Alexander Miller 외 arxiv

Fires in industrial facilities pose special challenges to firefighters, e.g., due to the sheer size and scale of the buildings. The resulting visual obstructions impair firefighting accuracy, further compounded by inaccu…

Safe Coordination of Human-Robot Firefighting Teams

2019-03-16 · Esmaeil Seraj, Andrew Silva, Matthew Gombolay

Wildfires are destructive and inflict massive, irreversible harm to victims' lives and natural resources. Researchers have proposed commissioning unmanned aerial vehicles (UAVs) to provide firefighters with real-time tra…

A Deep Learning Framework for Detection of Targets in Thermal Images to Improve Firefighting

2019-10-08 · Manish Bhattarai, Manel Martínez-Ramón

Intelligent detection and processing capabilities can be instrumental to improving the safety, efficiency, and successful completion of rescue missions conducted by firefighters in emergency first response settings. The …

Decision Makingobject-detectionObject DetectionReal-Time Object Detection