paper-with-me

Papers

SynerMix: Synergistic Mixup Solution for Enhanced Intra-Class Cohesion and Inter-Class Separability in Image Classification

2024-03-21 · Ye Xu, Ya Gao, Xiaorong Qiu, Yang Chen, Ying Ji

To address the issues of MixUp and its variants (e.g., Manifold MixUp) in image classification tasks-namely, their neglect of mixing within the same class (intra-class mixup) and their inadequacy in enhancing intra-class cohesion through their mixing operations-we propose a novel mixup method named SynerMix-Intra and, building upon this, introduce a synergistic mixup solution named SynerMix. SynerMix-Intra specifically targets intra-class mixup to bolster intra-class cohesion, a feature not addressed by current mixup methods. For each mini-batch, it leverages feature representations of unaugmented original images from each class to generate a synthesized feature representation through random linear interpolation. All synthesized representations are then fed into the classification and loss layers to calculate an average classification loss that significantly enhances intra-class cohesion. Furthermore, SynerMix combines SynerMix-Intra with an existing mixup approach (e.g., MixUp, Manifold MixUp), which primarily focuses on inter-class mixup and has the benefit of enhancing inter-class separability. In doing so, it integrates both inter- and intra-class mixup in a balanced way while concurrently improving intra-class cohesion and inter-class separability. Experimental results on six datasets show that SynerMix achieves a 0.1% to 3.43% higher accuracy than the best of either MixUp or SynerMix-Intra alone, averaging a 1.16% gain. It also surpasses the top-performer of either Manifold MixUp or SynerMix-Intra by 0.12% to 5.16%, with an average gain of 1.11%. Given that SynerMix is model-agnostic, it holds significant potential for application in other domains where mixup methods have shown promise, such as speech and text classification. Our code is publicly available at: https://github.com/wxitxy/synermix.git.

📄 PDF Abstract BibTeX arXiv:2403.14137

Code (2)

wxitxy/complementary_intra-class_and_inter-class_mixup 공식 구현 pytorch
wxitxy/synermix 공식 구현 pytorch

Tasks

image-classificationImage Classificationtext-classificationText Classification

Methods 이 논문이 사용한 방법론

Manifold Mixup Manifold Mixup is a regularization method that encourages neural networks to predict less confidently on interpolations of hidden representations. It leverages semantic…
FAVOR+ 설명 없음
Performer Performer is a Transformer architecture which can estimate regular…
Mixup Mixup is a data augmentation technique that generates a weighted combination of random image pairs from the training data. Given two images and their ground truth labels:…

Similar Papers 제목 키워드 기반

Intra-class Mixup for Out-of-Distribution Detection

2021-09-29 · Deepak Ravikumar, Sangamesh Kodge, Isha Garg, Kaushik Roy

Deep neural networks have found widespread adoption in solving image recognition and natural language processing tasks. However, they make confident mispredictions when presented with data that does not belong to the tra…

Out-of-Distribution DetectionOut of Distribution (OOD) Detection

RC-Mixup: A Data Augmentation Strategy against Noisy Data for Regression Tasks

2024-05-28 · Seong-Hyeon Hwang, Minsu Kim, Steven Euijong Whang

We study the problem of robust data augmentation for regression tasks in the presence of noisy data. Data augmentation is essential for generalizing deep learning models, but most of the techniques like the popular Mixup…

Data Augmentationregression

IntraMix: Intra-Class Mixup Generation for Accurate Labels and Neighbors

2024-05-02 · Shenghe Zheng, Hongzhi Wang, Xianglong Liu

Graph Neural Networks (GNNs) have shown great performance in various tasks, with the core idea of learning from data labels and aggregating messages within the neighborhood of nodes. However, the common challenges in gra…

Data AugmentationNode Classification

S-Mixup: Structural Mixup for Graph Neural Networks

2023-08-16 · Junghurn Kim, Sukwon Yun, Chanyoung Park

Existing studies for applying the mixup technique on graphs mainly focus on graph classification tasks, while the research in node classification is still under-explored. In this paper, we propose a novel mixup augmentat…

ClassificationGraph ClassificationGraph Neural NetworkNode Classification

On Mixup Regularization

2020-06-10 · Luigi Carratino, Moustapha Cissé, Rodolphe Jenatton, Jean-Philippe Vert

Mixup is a data augmentation technique that creates new examples as convex combinations of training points and labels. This simple technique has empirically shown to improve the accuracy of many state-of-the-art models i…

Data AugmentationImage Classification