SSCAE -- Semantic, Syntactic, and Context-aware natural language Adversarial Examples generator
Machine learning models are vulnerable to maliciously crafted Adversarial Examples (AEs). Training a machine learning model with AEs improves its robustness and stability against adversarial attacks. It is essential to develop models that produce high-quality AEs. Developing such models has been much slower in natural language processing (NLP) than in areas such as computer vision. This paper introduces a practical and efficient adversarial attack model called SSCAE for \textbf{S}emantic, \textbf{S}yntactic, and \textbf{C}ontext-aware natural language \textbf{AE}s generator. SSCAE identifies important words and uses a masked language model to generate an early set of substitutions. Next, two well-known language models are employed to evaluate the initial set in terms of semantic and syntactic characteristics. We introduce (1) a dynamic threshold to capture more efficient perturbations and (2) a local greedy search to generate high-quality AEs. As a black-box method, SSCAE generates humanly imperceptible and context-aware AEs that preserve semantic consistency and the source language's syntactical and grammatical requirements. The effectiveness and superiority of the proposed SSCAE model are illustrated with fifteen comparative experiments and extensive sensitivity analysis for parameter optimization. SSCAE outperforms the existing models in all experiments while maintaining a higher semantic consistency with a lower query number and a comparable perturbation rate.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial AttackLanguage ModellingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SSCAE: A Novel Semantic, Syntactic, and Context-Aware Natural Language Adversarial Example Generator
Training a machine learning model with adversarial examples (AEs) improves its robustness against adversarial attacks. Hence, it is crucial to develop effective generative models to produce high-quality AEs. Developing s…
Adversarial AttackGenerating Long and Informative Reviews with Aspect-Aware Coarse-to-Fine Decoding
Generating long and informative review text is a challenging natural language generation task. Previous work focuses on word-level generation, neglecting the importance of topical and syntactic characteristics from natur…
DecoderReview GenerationSentenceText GenerationRWEN-TTS: Relation-aware Word Encoding Network for Natural Text-to-Speech Synthesis
With the advent of deep learning, a huge number of text-to-speech (TTS) models which produce human-like speech have emerged. Recently, by introducing syntactic and semantic information w.r.t the input text, various appro…
RelationSpeech Synthesistext-to-speechText to Speech+1LOLgorithm: Integrating Semantic,Syntactic and Contextual Elements for Humor Classification
This paper explores humor detection through a linguistic lens, prioritizing syntactic, semantic, and contextual features over computational methods in Natural Language Processing. We categorize features into syntactic, s…
Feature EngineeringHumor DetectionSentenceEntity-Aware Self-Attention and Contextualized GCN for Enhanced Relation Extraction in Long Sentences
Relation extraction as an important natural Language processing (NLP) task is to identify relations between named entities in text. Recently, graph convolutional networks over dependency trees have been widely used to ca…
PositionRelationRelation ExtractionRelation Prediction+1