Robustness Reprogramming for Representation Learning
This work tackles an intriguing and fundamental open challenge in representation learning: Given a well-trained deep learning model, can it be reprogrammed to enhance its robustness against adversarial or noisy input perturbations without altering its parameters? To explore this, we revisit the core feature transformation mechanism in representation learning and propose a novel non-linear robust pattern matching technique as a robust alternative. Furthermore, we introduce three model reprogramming paradigms to offer flexible control of robustness under different efficiency requirements. Comprehensive experiments and ablation studies across diverse learning models ranging from basic linear model and MLPs to shallow and modern deep ConvNets demonstrate the effectiveness of our approaches. This work not only opens a promising and orthogonal direction for improving adversarial defenses in deep learning beyond existing methods but also provides new insights into designing more resilient AI systems with robust statistics.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningRepresentation LearningSimilar Papers 제목 키워드 기반
Model Reprogramming: Resource-Efficient Cross-Domain Machine Learning
In data-rich domains such as vision, language, and speech, deep learning prevails to deliver high-performance task-specific models and can even learn general task-agnostic representations for efficient finetuning to down…
BIG-bench Machine LearningmodelTransfer LearningReprogramming Language Models for Molecular Representation Learning
Recent advancements in transfer learning have made it a promising approach for domain adaptation via transfer of learned representations. This is especially when relevant when alternate tasks have limited samples of well…
Dictionary LearningDomain Adaptationmolecular representationRepresentation Learning+1Reprogramming Vision Foundation Models for Spatio-Temporal Forecasting
Foundation models have achieved remarkable success in natural language processing and computer vision, demonstrating strong capabilities in modeling complex patterns. While recent efforts have explored adapting large lan…
Representation LearningCellular reprogramming dynamics follow a simple one-dimensional reaction coordinate
Cellular reprogramming, the conversion of one cell type to another, has fundamentally transformed our conception of cell types. Cellular reprogramming induces global changes in gene expression involving hundreds of trans…
Time SeriesTime Series AnalysisMusic Instrument Classification Reprogrammed
The performance of approaches to Music Instrument Classification, a popular task in Music Information Retrieval, is often impacted and limited by the lack of availability of annotated data for training. We propose to add…
ClassificationInformation RetrievalMusic Information RetrievalRetrieval