paper-with-me

홈 › Papers

SSCAE -- Semantic, Syntactic, and Context-aware natural language Adversarial Examples generator

2024-03-18 · Javad Rafiei Asl, Mohammad H. Rafiei, Manar Alohaly, Daniel Takabi

Machine learning models are vulnerable to maliciously crafted Adversarial Examples (AEs). Training a machine learning model with AEs improves its robustness and stability against adversarial attacks. It is essential to develop models that produce high-quality AEs. Developing such models has been much slower in natural language processing (NLP) than in areas such as computer vision. This paper introduces a practical and efficient adversarial attack model called SSCAE for \textbf{S}emantic, \textbf{S}yntactic, and \textbf{C}ontext-aware natural language \textbf{AE}s generator. SSCAE identifies important words and uses a masked language model to generate an early set of substitutions. Next, two well-known language models are employed to evaluate the initial set in terms of semantic and syntactic characteristics. We introduce (1) a dynamic threshold to capture more efficient perturbations and (2) a local greedy search to generate high-quality AEs. As a black-box method, SSCAE generates humanly imperceptible and context-aware AEs that preserve semantic consistency and the source language's syntactical and grammatical requirements. The effectiveness and superiority of the proposed SSCAE model are illustrated with fifteen comparative experiments and extensive sensitivity analysis for parameter optimization. SSCAE outperforms the existing models in all experiments while maintaining a higher semantic consistency with a lower query number and a comparable perturbation rate.

📄 PDF Abstract BibTeX arXiv:2403.11833

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial AttackLanguage Modelling

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

SSCAE: A Novel Semantic, Syntactic, and Context-Aware Natural Language Adversarial Example Generator

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Training a machine learning model with adversarial examples (AEs) improves its robustness against adversarial attacks. Hence, it is crucial to develop effective generative models to produce high-quality AEs. Developing s…

Adversarial Attack

Generating Long and Informative Reviews with Aspect-Aware Coarse-to-Fine Decoding

2019-06-11 · ACL 2019 7 · Junyi Li, Wayne Xin Zhao, Ji-Rong Wen, Yang song

Generating long and informative review text is a challenging natural language generation task. Previous work focuses on word-level generation, neglecting the importance of topical and syntactic characteristics from natur…

DecoderReview GenerationSentenceText Generation

RWEN-TTS: Relation-aware Word Encoding Network for Natural Text-to-Speech Synthesis

2022-12-15 · Shinhyeok Oh, HyeongRae Noh, Yoonseok Hong, Insoo Oh

With the advent of deep learning, a huge number of text-to-speech (TTS) models which produce human-like speech have emerged. Recently, by introducing syntactic and semantic information w.r.t the input text, various appro…

RelationSpeech Synthesistext-to-speechText to Speech+1

LOLgorithm: Integrating Semantic,Syntactic and Contextual Elements for Humor Classification

2024-08-12 · Tanisha Khurana, Kaushik Pillalamarri, Vikram Pande, Munindar Singh

This paper explores humor detection through a linguistic lens, prioritizing syntactic, semantic, and contextual features over computational methods in Natural Language Processing. We categorize features into syntactic, s…

Feature EngineeringHumor DetectionSentence

Entity-Aware Self-Attention and Contextualized GCN for Enhanced Relation Extraction in Long Sentences

2024-09-15 · Xin Wang, Xinyi Bai

Relation extraction as an important natural Language processing (NLP) task is to identify relations between named entities in text. Recently, graph convolutional networks over dependency trees have been widely used to ca…

PositionRelationRelation ExtractionRelation Prediction+1