paper-with-me

Papers

Robustness Reprogramming for Representation Learning

2024-10-06 · Zhichao Hou, MohamadAli Torkamani, Hamid Krim, Xiaorui Liu

This work tackles an intriguing and fundamental open challenge in representation learning: Given a well-trained deep learning model, can it be reprogrammed to enhance its robustness against adversarial or noisy input perturbations without altering its parameters? To explore this, we revisit the core feature transformation mechanism in representation learning and propose a novel non-linear robust pattern matching technique as a robust alternative. Furthermore, we introduce three model reprogramming paradigms to offer flexible control of robustness under different efficiency requirements. Comprehensive experiments and ablation studies across diverse learning models ranging from basic linear model and MLPs to shallow and modern deep ConvNets demonstrate the effectiveness of our approaches. This work not only opens a promising and orthogonal direction for improving adversarial defenses in deep learning beyond existing methods but also provides new insights into designing more resilient AI systems with robust statistics.

📄 PDF Abstract BibTeX arXiv:2410.04577

Code (0)

등록된 구현이 없습니다.

Tasks

Deep LearningRepresentation Learning

Similar Papers 제목 키워드 기반

Model Reprogramming: Resource-Efficient Cross-Domain Machine Learning

2022-02-22 · Pin-Yu Chen

In data-rich domains such as vision, language, and speech, deep learning prevails to deliver high-performance task-specific models and can even learn general task-agnostic representations for efficient finetuning to down…

BIG-bench Machine LearningmodelTransfer Learning

Reprogramming Language Models for Molecular Representation Learning

2020-12-07 · Ria Vinod, Pin-Yu Chen, Payel Das

Recent advancements in transfer learning have made it a promising approach for domain adaptation via transfer of learned representations. This is especially when relevant when alternate tasks have limited samples of well…

Dictionary LearningDomain Adaptationmolecular representationRepresentation Learning+1

Reprogramming Vision Foundation Models for Spatio-Temporal Forecasting

2025-07-14 · Changlu Chen, Yanbin Liu, Chaoxi Niu, Ling Chen 외 arxiv

Foundation models have achieved remarkable success in natural language processing and computer vision, demonstrating strong capabilities in modeling complex patterns. While recent efforts have explored adapting large lan…

Representation Learning

Cellular reprogramming dynamics follow a simple one-dimensional reaction coordinate

2015-05-14

Cellular reprogramming, the conversion of one cell type to another, has fundamentally transformed our conception of cell types. Cellular reprogramming induces global changes in gene expression involving hundreds of trans…

Time SeriesTime Series Analysis

Music Instrument Classification Reprogrammed

2022-11-15 · Hsin-Hung Chen, Alexander Lerch

The performance of approaches to Music Instrument Classification, a popular task in Music Information Retrieval, is often impacted and limited by the lack of availability of annotated data for training. We propose to add…

ClassificationInformation RetrievalMusic Information RetrievalRetrieval