Text generation for dataset augmentation in security classification tasks

2023-10-22 · Alexander P. Welsh, Matthew Edwards

Security classifiers, designed to detect malicious content in computer systems and communications, can underperform when provided with insufficient training data. In the security domain, it is often easy to find samples of the negative (benign) class, and challenging to find enough samples of the positive (malicious) class to train an effective classifier. This study evaluates the application of natural language text generators to fill this data gap in multiple security-related text classification tasks. We describe a variety of previously-unexamined language-model fine-tuning approaches for this purpose and consider in particular the impact of disproportionate class-imbalances in the training set. Across our evaluation using three state-of-the-art classifiers designed for offensive language detection, review fraud detection, and SMS spam detection, we find that models trained with GPT-3 data augmentation strategies outperform both models trained without augmentation and models trained using basic data augmentation strategies already in common usage. In particular, we find substantial benefits for GPT-3 data augmentation strategies in situations with severe limitations on known positive-class samples.

📄 PDF Abstract BibTeX arXiv:2310.14429

Code (1)

wenliangdai/multi-task-offensive-language-detection 공식 구현 pytorch

Tasks

Data Augmentation Fraud DetectionLanguage ModelingLanguage Modelling Spam detection text-classification Text Classification Text Generation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

15 Ways to Contact How can i speak to someone at Delta Airlines 설명 없음

Attention 설명 없음

Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…

Adam 설명 없음

Boosting Text Classification Performance on Sexist Tweets by Text Augmentation and Text Generation Using a Combination of Knowledge Graphs

2018-10-01 · WS 2018 10 · Sima Sharifirad, Borna Jafarpour, Stan Matwin

Text classification models have been heavily utilized for a slew of interesting natural language processing problems. Like any other machine learning model, these classifiers are very dependent on the size and quality of…

Abusive Language BIG-bench Machine Learning Classification Dialogue Generation+8

DAGAM: Data Augmentation with Generation And Modification

2022-04-06 · Byeong-Cheol Jo, Tak-Sung Heo, Yeongjoon Park, Yongmin Yoo 외

Text classification is a representative downstream task of natural language processing, and has exhibited excellent performance since the advent of pre-trained language models based on Transformer architecture. However, …

Data Augmentation text-classification Text Classification

Class-specific Data Augmentation for Plant Stress Classification

2024-06-18 · Nasla Saleem, Aditya Balu, Talukder Zaki Jubery, Arti Singh 외

Data augmentation is a powerful tool for improving deep learning-based image classifiers for plant stress identification and classification. However, selecting an effective set of augmentations from a large pool of candi…

Classification Data Augmentation

Data Augmentation via Mixed Class Interpolation using Cycle-Consistent Generative Adversarial Networks Applied to Cross-Domain Imagery

2020-05-05 · Hiroshi Sasaki, Chris G. Willcocks, Toby P. Breckon

Machine learning driven object detection and classification within non-visible imagery has an important role in many fields such as night vision, all-weather surveillance and aviation security. However, such applications…

Classification Data Augmentation domain classification General Classification+2

GRAID: Synthetic Data Generation with Geometric Constraints and Multi-Agentic Reflection for Harmful Content Detection

2025-08-23 · Melissa Kazemi Rad, Alberto Purpura, Himanshu Kumar, Emily Chen 외 arxiv

We address the problem of data scarcity in harmful text classification for guardrailing applications and introduce GRAID (Geometric and Reflective AI-Driven Data Augmentation), a novel pipeline that leverages Large Langu…

Synthetic Data Generation Text Classification Data Augmentation