paper-with-me

Papers

The Easy Path to Robustness: Coreset Selection using Sample Hardness

2025-10-13 · Pranav Ramesh, Arjun Roy, Deepak Ravikumar, Kaushik Roy, Gopalakrishnan Srinivasan arxiv

Designing adversarially robust models from a data-centric perspective requires understanding which input samples are most crucial for learning resilient features. While coreset selection provides a mechanism for efficient training on data subsets, current algorithms are designed for clean accuracy and fall short in preserving robustness. To address this, we propose a framework linking a sample's adversarial vulnerability to its \textit{hardness}, which we quantify using the average input gradient norm (AIGN) over training. We demonstrate that \textit{easy} samples (with low AIGN) are less vulnerable and occupy regions further from the decision boundary. Leveraging this insight, we present EasyCore, a coreset selection algorithm that retains only the samples with low AIGN for training. We empirically show that models trained on EasyCore-selected data achieve significantly higher adversarial accuracy than those trained with competing coreset methods under both standard and adversarial training. As AIGN is a model-agnostic dataset property, EasyCore is an efficient and widely applicable data-centric method for improving adversarial robustness. We show that EasyCore achieves up to 7\% and 5\% improvement in adversarial accuracy under standard training and TRADES adversarial training, respectively, compared to existing coreset methods.

📄 PDF Abstract BibTeX arXiv:2510.11018

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial Robustness

Similar Papers 제목 키워드 기반

The Impact of Coreset Selection on Spurious Correlations and Group Robustness

2025-07-15 · Amaya Dharmasiri, William Yang, Polina Kirichenko, Lydia Liu 외 arxiv

Coreset selection methods have shown promise in reducing the training data size while maintaining model performance for data-efficient machine learning. However, as many datasets suffer from biases that cause models to l…

Speculative Coreset Selection for Task-Specific Fine-tuning

2024-10-02 · XiaoYu Zhang, Juan Zhai, Shiqing Ma, Chao Shen 외

Task-specific fine-tuning is essential for the deployment of large language models (LLMs), but it requires significant computational resources and time. Existing solutions have proposed coreset selection methods to impro…

D2 Pruning: Message Passing for Balancing Diversity and Difficulty in Data Pruning

2023-10-11 · Adyasha Maharana, Prateek Yadav, Mohit Bansal

Analytical theories suggest that higher-quality data can lead to lower test errors in models trained on a fixed data budget. Moreover, a model can be trained on a lower compute budget without compromising performance if …

Diversity

Anti-Backdoor Coreset Selection via Cumulative Entropy

2026-07-28 · Qi Zhao, Christian Wressnegger arxiv

Recent training-time defenses against neural backdoors isolate a benign subset from poisoned training data, to learn a backdoor-free model from it. In this paper, we formulate this defense strategy as a coreset selection…

Geometry-Aware Uncertainty Coresets for Robust Visual In-Context Learning in Histopathology

2026-05-18 · Franciskus Xaverius Erick, Johanna Paula Müller, Bernhard Kainz arxiv

Vision-language models (VLMs) can couple visual perception with open-ended clinical reasoning, making them attractive for computational histopathology. However, fine-tuning billions of parameters on scarce, expert-annota…