paper-with-me

홈 › Papers

Discrete Adversarial Attacks and Submodular Optimization with Applications to Text Classification

2018-12-01 · Qi Lei, Lingfei Wu, Pin-Yu Chen, Alexandros G. Dimakis, Inderjit S. Dhillon, Michael Witbrock

Adversarial examples are carefully constructed modifications to an input that completely change the output of a classifier but are imperceptible to humans. Despite these successful attacks for continuous data (such as image and audio samples), generating adversarial examples for discrete structures such as text has proven significantly more challenging. In this paper we formulate the attacks with discrete input on a set function as an optimization task. We prove that this set function is submodular for some popular neural network text classifiers under simplifying assumption. This finding guarantees a $1-1/e$ approximation factor for attacks that use the greedy algorithm. Meanwhile, we show how to use the gradient of the attacked classifier to guide the greedy search. Empirical studies with our proposed optimization scheme show significantly improved attack ability and efficiency, on three different text classification tasks over various baselines. We also use a joint sentence and word paraphrasing technique to maintain the original semantics and syntax of the text. This is validated by a human subject evaluation in subjective metrics on the quality and semantic coherence of our generated adversarial text.

📄 PDF Abstract BibTeX arXiv:1812.00151

Code (1)

cecilialeiqi/adversarial_text 공식 구현 pytorch

Tasks

Adversarial TextGeneral ClassificationSentencetext-classificationText Classification

Similar Papers 제목 키워드 기반

Submodularity in Action: From Machine Learning to Signal Processing Applications

2020-06-17 · Ehsan Tohidi, Rouhollah Amiri, Mario Coutino, David Gesbert 외

Submodularity is a discrete domain functional property that can be interpreted as mimicking the role of the well-known convexity/concavity properties in the continuous domain. Submodular functions exhibit strong structur…

BIG-bench Machine Learning

Structured Convex Optimization under Submodular Constraints

2013-09-26 · Kiyohito Nagano, Yoshinobu Kawahara

A number of discrete and continuous optimization problems in machine learning are related to convex minimization problems under submodular constraints. In this paper, we deal with a submodular function with a directed gr…

BIG-bench Machine Learning

Reflection methods for user-friendly submodular optimization

2013-11-18 · NeurIPS 2013 12 · Stefanie Jegelka, Francis Bach, Suvrit Sra

Recently, it has become evident that submodularity naturally captures widely occurring concepts in machine learning, signal processing and computer vision. Consequently, there is need for efficient optimization procedure…

Image SegmentationSemantic Segmentation

Projection-Free Online Optimization with Stochastic Gradient: From Convexity to Submodularity

2018-02-22 · ICML 2018 7 · Lin Chen, Christopher Harshaw, Hamed Hassani, Amin Karbasi

Online optimization has been a successful framework for solving large-scale problems under computational constraints and partial information. Current methods for online convex optimization require either a projection or …

Minimax Optimization: The Case of Convex-Submodular

2021-11-01 · Arman Adibi, Aryan Mokhtari, Hamed Hassani

Minimax optimization has been central in addressing various applications in machine learning, game theory, and control theory. Prior literature has thus far mainly focused on studying such problems in the continuous doma…