paper-with-me

홈 › Papers

Cross-modal Adversarial Reprogramming

2021-02-15 · Paarth Neekhara, Shehzeen Hussain, Jinglong Du, Shlomo Dubnov, Farinaz Koushanfar, Julian McAuley

With the abundance of large-scale deep learning models, it has become possible to repurpose pre-trained networks for new tasks. Recent works on adversarial reprogramming have shown that it is possible to repurpose neural networks for alternate tasks without modifying the network architecture or parameters. However these works only consider original and target tasks within the same data domain. In this work, we broaden the scope of adversarial reprogramming beyond the data modality of the original task. We analyze the feasibility of adversarially repurposing image classification neural networks for Natural Language Processing (NLP) and other sequence classification tasks. We design an efficient adversarial program that maps a sequence of discrete tokens into an image which can be classified to the desired class by an image classification model. We demonstrate that by using highly efficient adversarial programs, we can reprogram image classifiers to achieve competitive performance on a variety of text and sequence classification benchmarks without retraining the network.

📄 PDF Abstract BibTeX arXiv:2102.07325

Code (1)

paarthneekhara/multimodal_rerprogramming 공식 구현 pytorch

Tasks

ClassificationGeneral Classificationimage-classificationImage Classification

Similar Papers 제목 키워드 기반

Why Adversarial Reprogramming Works, When It Fails, and How to Tell the Difference

2021-08-26 · Yang Zheng, Xiaoyi Feng, Zhaoqiang Xia, Xiaoyue Jiang 외

Adversarial reprogramming allows repurposing a machine-learning model to perform a different task. For example, a model trained to recognize animals can be reprogrammed to recognize digits by embedding an adversarial pro…

BIG-bench Machine LearningTransfer Learning

Adversarial Reprogramming Revisited

2022-06-07 · Matthias Englert, Ranko Lazic

Adversarial reprogramming, introduced by Elsayed, Goodfellow, and Sohl-Dickstein, seeks to repurpose a neural network to perform a different task, by manipulating its input without modifying its weights. We prove that tw…

An Investigation of Reprogramming for Cross-Language Adaptation in Speaker Verification Systems

2024-11-18 · Jingyu Li, Aemon Yat Fei Chiu, Tan Lee

Language mismatch is among the most common and challenging domain mismatches in deploying speaker verification (SV) systems. Adversarial reprogramming has shown promising results in cross-language adaptation for SV. The …

Speaker Verification

Low-Resource Music Genre Classification with Cross-Modal Neural Model Reprogramming

2022-11-02 · Yun-Ning Hung, Chao-Han Huck Yang, Pin-Yu Chen, Alexander Lerch

Transfer learning (TL) approaches have shown promising results when handling tasks with limited training data. However, considerable memory and computational resources are often required for fine-tuning pre-trained neura…

ClassificationGenre classificationMusic ClassificationMusic Genre Classification+1

WARP: Word-level Adversarial ReProgramming

2021-01-01 · ACL 2021 5 · Karen Hambardzumyan, Hrant Khachatrian, Jonathan May

Transfer learning from pretrained language models recently became the dominant approach for solving many NLP tasks. A common approach to transfer learning for multiple tasks that maximize parameter sharing trains one or …

Language ModelingLanguage ModellingTransfer LearningWord Embeddings