paper-with-me

Papers

IPMix: Label-Preserving Data Augmentation Method for Training Robust Classifiers

2023-10-07 · NeurIPS 2023 11 · Zhenglin Huang, Xiaoan Bao, Na Zhang, Qingqi Zhang, Xiaomei Tu, Biao Wu, Xi Yang

Data augmentation has been proven effective for training high-accuracy convolutional neural network classifiers by preventing overfitting. However, building deep neural networks in real-world scenarios requires not only high accuracy on clean data but also robustness when data distributions shift. While prior methods have proposed that there is a trade-off between accuracy and robustness, we propose IPMix, a simple data augmentation approach to improve robustness without hurting clean accuracy. IPMix integrates three levels of data augmentation (image-level, patch-level, and pixel-level) into a coherent and label-preserving technique to increase the diversity of training data with limited computational overhead. To further improve the robustness, IPMix introduces structural complexity at different levels to generate more diverse images and adopts the random mixing method for multi-scale information fusion. Experiments demonstrate that IPMix outperforms state-of-the-art corruption robustness on CIFAR-C and ImageNet-C. In addition, we show that IPMix also significantly improves the other safety measures, including robustness to adversarial perturbations, calibration, prediction consistency, and anomaly detection, achieving state-of-the-art or comparable results on several benchmarks, including ImageNet-R, ImageNet-A, and ImageNet-O.

📄 PDF Abstract BibTeX arXiv:2310.04780

Code (1)

hzlsaber/IPMix 공식 구현 pytorch

Tasks

Anomaly DetectionData AugmentationDiversity

Similar Papers 제목 키워드 기반

Self-Training with Purpose Preserving Augmentation Improves Few-shot Generative Dialogue State Tracking

2022-11-17 · Jihyun Lee, Chaebin Lee, Yunsu Kim, Gary Geunbae Lee

In dialogue state tracking (DST), labeling the dataset involves considerable human labor. We propose a new self-training framework for few-shot generative DST that utilize unlabeled data. Our self-training method iterati…

Dialogue State Tracking

Augment with Care: Contrastive Learning for Combinatorial Problems

2022-02-17 · Haonan Duan, Pashootan Vaezipoor, Max B. Paulus, Yangjun Ruan 외

Supervised learning can improve the design of state-of-the-art solvers for combinatorial problems, but labelling large numbers of combinatorial instances is often impractical due to exponential worst-case complexity. Ins…

Contrastive Learning

Improved Mixed-Example Data Augmentation

2018-05-29 · Cecilia Summers, Michael J. Dinneen

In order to reduce overfitting, neural networks are typically trained with data augmentation, the practice of artificially generating additional training data via label-preserving transformations of existing training exa…

Data AugmentationImage Augmentation

AF-MAT: Aspect-aware Flip-and-Fuse xLSTM for Aspect-based Sentiment Analysis

2025-07-01 · Adamu Lawan, Juhua Pu, Haruna Yunusa, Muhammad Lawan 외 arxiv

Aspect-based Sentiment Analysis (ABSA) is a crucial NLP task that extracts fine-grained opinions and sentiments from text, such as product reviews and customer feedback. Existing methods often trade off efficiency for pe…

Sentiment Analysis

Feature Dropout: Revisiting the Role of Augmentations in Contrastive Learning

2023-09-21 · NeurIPS 2023 11

What role do augmentations play in contrastive learning? Recent work suggests that good augmentations are label-preserving with respect to a specific downstream task. We complicate this picture by showing that label-dest…